It seems to me that it takes about 2-3 trips down the court to adjust to a new defense. Vice versa for offense. I would think someone with a headshet watching the game from higher up would catch some of these changes and could shrink that margin to 1-2 trips. Additionally, someone higher up may catch on that players are going to trap the inbound even before the player receives the ball. There could be any number of advantages seeing the game from the fan's perspective.
Would that kill the experience? Maybe, maybe not. It's exciting and frustrating at the same time seeing an inbounds trap work a few times too many. It's exciting and frustrating seeing a double team work a few too many times. It could be exciting realizing that a high low pass could work really well and see it happen. I just think there are some advantages seeing the entire court versus the side you're on.