I don't think it would be an issue that I can think of. If you have the floor space and it's not a big deal to keep it can provide a couple of benefits. It's not a part that has a high chance of failure. The chance you'll have problems from it are pretty low.
I personally am a fan of remove as much old as possible when doing mods or upgrades though.
