A couple of my thoughts on the rear swing outs. I have been thinking about this for a while for mine.I got tired of the "wood-work" and switched back on to this. Got my new Buyers box in...they build the $hit out these things...if you need a box these are beast! Got the rear stripped down so I have access to the door hinge mount points and got a little start on a wood template for a lower mount. Should be able to get a bunch of this done this weekend.
If you are planning a side mount ladder (similar to Alumness) you could incorporate the rear ladder rail into the swing out hing mounts that bolt to the rear door hinges.
Instead of latches to the bumper, I have been contemplating mounting to the rear doors on a sliding mount. So all you would have to do is open the rear doors as usual. But the bulk of the weight would bear on the swing out hinges. This may be a little tougher if your Buyers box obstructs the right door latch.
I am very eager to see what you come up with. Everything on your van so far looks great.