Because it is not sucking any air now. Originally cars had a road draft tube that relied on air turbulence to suck crankcase fumes. A better idea was to run a PCV valve that sucked a controlled amount through the carb via manifold vacuum yet not enough to be a vacuum leak. One breather in a valve cover drew in fresh air to displace the fumes. During low vacuum conditions the fumes exited the breather. Emissions later mandated the modern closed PCV system. The PCV valve still sucked a controlled amount during high vacuum, but at low vacuum the tube that goes from the valve cover to the air cleaner took over and sucked the fumes into the carb. Thus you had true full time Positive Crankcase Ventilation. When you ditch the tube to the air cleaner you upset the system. Now the valve cover breather acts like a vacuum leak, causing lean conditions. Older, richer, jetting could stand the extra air but our leaner emissions carbs cannot.
This bit of information is almost nowhere to be found on the internet if you google for pcv-systems and setups. Thank you man, this helps me a lot in understanding why I have this hesitating/deadspot. I will get rid of the breather and route a simple tube to the air-filter 😀