Okay, so I think I figured out what may have been tripping you up, because it tripped me up also. I just didn't remember till I took a look at the pump bracket.
First of all, loosen the bolt that the PS pump hinges on (doesn't need to be finger loose, just not tight) circled in green here:
Now find the adjustment bolt beneath the pump, facing the front of the car--circled in green: (but don't try to turn it yet)
Finally, here is the part that I bet you didn't see. Follow the adjustment bolt down below the pump and you'll see it threads into a part that I've circled in blue:
That picture is taken from the driver's side of the pump. If you look at the part circled in blue from the passenger side, you'll see that it's clamped onto that curved bracket with a bolt. When you loosen that bolt, then the power steering pump is free to be pivoted in and out by turning the adjustment bolt (the one circled in green). Get the serpentine belt snugged up to your satisfaction--should be tight, but you should also be able to deflect the belt slightly with your finger--then tighten up the blue and red bolts, and you're good to go!