The category and tag feed pages will automatically aggregate any posts that include either identifier. However, to the best of my knowledge, they are separate functions.
I don’t believe you will need to remove the tags unless you are also experiencing the same issue on the equivalent tag feed.
There may be other issues in the background that I am unaware of, so I have pinged the mod for support.