Damien- even when you were a snot nosed climber, other climbers like Andrew Penny worked in with local land owners to create a access that was acceptable to all the land owners and this has always involved crossing private land. What you call the "fire road" has never been public.
As a climber I explained to the buddist group very carefully how important the area was to climbers [my current climbing partner got married out there nearly 20 yrs ago!] and my initial impression was that they were pretty laid back about it, it was only yesterday that I sadly found out that that silence and privacy was integral to the retreats that they run.
Maby you should be a bit more zen about this-" If you cant beat em join em", Then you could have your own private retreat above the county and go for very long "meditation walks" throught the bush with your backpack. Who knows doing a retreat might even make you chill out about the issue, really all it means is thay tou have to walk/ride in from the dam cliffs.
The image of a bunch of robed monks and nuns chasing you down the access rd with big sticks does however tickle my fancy.