I have actually thought about olive drab for a VR4 before. I have mentioned it more than once. There will always be those for and against the idea. A car that gets used in the mountains like Marks will probably pull it off easier than an urban daily for sure, but I certainly don't think it would look crap if done correctly. For the record, by doing it correctly I mean make the accessories/ancillaries match. It could look good with black wheels, a roof rack, bull bars and auxiliary spot lights etc. It won't look good with the chrome strip in the bumpers and side moldings, 19 inch chrome rims, polished lips etc but you seem like you realize that already so I think you will probably pull it off okay. I vote do it. I'm interested to see how it turns out.
Edit: When I was thinking about doing this I was going to do the side moldings, window trim and JDM bumpers flat black and the body matte olive drab. I'm not a fan of the green camo and would have gone for the WWII Willis Jeep type of look but the Lambo in urban camo looks cool and I could see that working on a VR4 too, so I hope Mark decides to progress with that idea.