You're using a definition of what is "athletic" in a way that satisfies your own bias. I can't see how the 40y dash is less "niche" than running a mile. That's a personal axiom you subscribe to. Pretty sure a mile test would be equally or more important in soccer, tennis, MMA and boxing than a 40y dash, and of course, in any track event above 400mts.
I think you're in a small minority if you don't consider Phelps, Lasha Talakhadze, Mo Farah, Olympic gymnasts, or Brian Shaw insanely gifted athletically. The point about well roundedness is well taken, and I agree, but there's a difference between that and saying they are not athletic. I don't think many people will share your view on that.
The speed bit, I obviously meant it's fast for the distance. "Oh, this guy is a really slow runner, but he can outrun 99.99999% of the world's professional athletes in almost every sport in a 2 minute race" (half mile). I don't think most people would subscribe to this kind of logic.
This is false, because tons of people care about marathons and Tour de France type events, and soccer which has a pretty high aerobic requirement. Second, using "how many people care" is arbitrary, and would make soccer the pinnacle of athletics, which would make upper body strength totally irrelevant, which we already said isn't the case. Third, using the same logic, we can say no one cares globally about benching 225lbs for max reps or the 40 yard dash, only a section of the US, so it's as niche as any other event.
The difference between these events and jumping through a hoop on fire on a unicycle is that they tax the muscular/cardiovascular system to the max, and those are considered basic aspects of physical ability. Hand eye coordination or reflexes can be tested through something like shooting, which requires very little physical exertion, with the mechanical work being done by a machine. Holding your breath for time isn't required to perform mechanical work with your body. However, you can't test the muscular and cardiovascular system that way. I do think a well rounded athlete should have some coordination, reflexes and balance, and I think those are important things. Maybe if I knew more about table tennis I'd appreciate it more.