Sounds like you want an L-bracket for your camera.
http://www.reallyrightstuff.com/Quick-Release/Camera-Plates-L-PlatesThis will allow you (with the right plate on your tripod) to mount the camera horizontal or vertical by easily un-clipping the camera, turning it 90 degrees and re-clipping it onto the tripod. This also avoids the need to lean the head right over to the side in order to get a vertical aspect for the camera....though your ball head should still be strong enough to hold the weight in the first place.
If you don't want to spend the money on the RRS brand then I'm sure there are many Chinese knock-offs on eBay.
Just be sure to research it before buying anything as some (cheaper versions) don't have appropriate cut-outs to gain access to things like battery compartments or other doors/ports without removing the bracket.
Dave