All you really have to do is plug up the holes in the cat and air cleaner and you'll be fine. You may want to see how the car runs by just removing the belt and seeing how much performance you gain from that. I've been doing some engine work and decided to idle the car like that for a bit and it seemed to put off a lot more fumes than it used to. Long story short, if the car is running clean then maybe go for it, but if it runs like mine you may want to keep it 🙂
ETA: The pump system is basically self contained. Air comes in at the pump, then is directed to either the cat, exhaust manifold, or air cleaner. You can remove everything that comes off the pump without causing problems.