I have rods in both femurs and both shins. I have a plate in my shoulder because I broke my humerus and yeah I agree with you on that as far as pain when lifting. Although in my case, I wouldn't exactly call it "pain", it's just very uncomfortable. I can do certain movements like pressing decently well but there's definitely a noticeable difference in what I can push with my once broken arm compared to my unharmed arm.
I only use dumbbells or machines at the gym now and I don't feel confident or strong enough on the broken arm side to risk trying to go heavier. I feel like my "good arm" can push much more weight but I always use the same weight on both sides.
Externally rotating my broken arm is uncomfortable as fuck and I have minimal strength when doing so.