I'd think you would risk damaging the covers, but I've never tried to do it the "fast and easy" way. I removed the cover, then the bumper. Then just reinstalled in reverse.
If you're doing it as it is, you'll either only get so far and find out you have to get the cover off anyway, or the bumper comes off, one of the two. The only way I think you'd even be close is to unbolt the reinforcement from the bumper shocks. The stud plate in the reinforcement is replaceable, so you may be able to use a deadblow plastic hammer or something similar to tap the stud plates through the bumper shock bumper mount holes. Don't break them though, as finding new ones is unobtanium darn near. Otherwise you would have to move the bumper outward about 1.5 inches or so to clear the studs. This might cause some undue stress on the cover. Taking the side marker lights loose and undoing the side cover fasteners might buy you some more flexibility, but again, I haven't tried.
I'm going on record saying although it MIGHT be possible, I wouldn't recommend it. At your own risk sort of thing.