I would not be going via the Clyde Mtn and Batemans Bay. It's an hour and 100 km longer than going down Brown Mountain. The gradients are around the same on both descents. You can check them out here:

For Brown Mtn see Map of Snowy Mountains Highway, NSW

For Clyde Mtn see Map of Kings Highway

I have no preference for either road, I just take the most convenient one for each trip. I suggest you should take a positive attitude to driving these types of terrain, if you don't, you are going to miss out on a lot of good trips. When you have gained your confidence on this route you will enjoy trips across half a dozen routes across the Great Divide in both NSW and Qld plus a couple in Vic. Just use your gears to make it easy to climb the ascents and to provide engine breaking on the descents. If you slow down and shift into a low enough gear so you don't have to spend too much time on your brakes when descending, you will have good working brakes after you have descended each hill you go down.

                 

I guess it depends upon your level of experience/comfort in towing on hills. I have towed our various caravans up and down the Brown Mountain, Clyde Mountain, Macquarie Pass, and all through the Snowy Mountains (where permitted) on numerous occasions. I used to sometimes drive semi-trailers for a living on these same roads.