i know you probably shouldn't use it on high torque bolts because you risk stressing the bolt when tightening it.
This is correct; unless you use a compensation factor for fastening torque you'll end up over stressing the bolt and/or the mating surfaces and/or the threads. Most good lubricants and anti-seize compounds will have documentation with a formula or a compensation factor for calculating the torque needed to maintain the same approximate stress.
The problem now is that you've still reduced the friction in the threads (and maybe at the bolt head mating surface) which means the bolt is less likely to stay 'locked'.
On top of that if any of the lube gets at the mating surfaces of what you're clamping then the maximum allowable shear rating of the joint drops dramatically even if the normal force from the bolt is 'correct'.
Basically for anything that *must* not come loose (such has caliper bracket) no lube or anti seize compounds (most anyway) should be used unless the part has been designed for it (although a lot of people get away with it lol).
What you can usually use safely though is threadlocker... an epoxy such as loctite. Threadlockers will prevent corrosion without the problems of lubes and most anti seize compounds.
From my experience caliper bolts that have been properly torqued to begin with usually come off easily though.. a lot of people way over do it thinking that have to be super tight and hammer them on instead of using a torque wrench
