You're trying to have it both ways.
Either, it's a private company that can do what it wants, censor people, ban whoever, etc. Which also applies to Twitter before Elon owned it. If that's your rationale, then you can't have been screeching about free speech under the previous ownership. And along with that, you have to abandon any notion of Elon being a free speech warrior. It's his company. He can censor people at the behest of foreign dictators. He can let nazis in. He can ban anyone he wants. And all of that is in direct contradiction to his freeze peach culture war grift.
It's either that, OR
Twitter is the public commons and free speech laws apply to it. He cannot ban anyone. He cannot censor people at the behest of foreign governments. Obviously he's not doing any of that.
But you're trying to make arguments from both sides of this dichotomy and it's incoherent.