I think you are right in a general sense, but under-appreciate how strongly people vote of the social aspects rather than the policy aspects. Most people aren't voting on the intricacies of international trade. The problem here is that socially, the "white nationalist" or whatnot is universally panned and not considered acceptable. While the child transgender movements, 30 year old #MeToo, etc, is considered "brave and courageous". So when people say "it's absurd", the left points "outrage" at the right. It's not the same and honestly not even fair in context.
Another example of this would be the Gillette commercial previously mentioned. Yes, a few conservatives were "outraged", but mostly due to the commercial highlighting what is regular male behavior as "toxic masculinity". The bias is so overly strong to paint kids wrestling or a dude saying a pick up line as toxic. Yet if you mention the commercial was incredibly bias and counterproductive in any way, you're "outraged". If I aired a commercial promoting a self-protection app in high crime black neighborhoods, nobody would say "great way of promoting an app", they'd call for my company to be boycott and I'd very likely lose sponsors and money, while being seen as racist. Again, not nearly the same.
Because of this, I think Rogan is completely correct. That's where we are now. I think the whole "you're either all in with us or you're the bad guy" wears thin on any subject, let alone a political one. Like, I don't think all illegals should get free college? "How dare you, you racist bigot". That's the reaction. It's gone too far and has become a massive turn off for many people.