Oh no - it is this hard.

I watched a fighter pilot mimic flying in a "res cell" formation (within hundreds of feet of another jet so as to conceal the true number of aircraft in their formation - radar can't separate them if they are too close).

He was holding his fists like they were controlling the stick and throttle and he was just making quick tight little circles and looking over his shoulder.

Its hard work. Very hard.

And when they're flying like that - the person flying in formation that close can't use his own radar... he's concentrating too much on flying.

That's another thing that makes a two-seater advantageous. One can fly, the other can operate the weapons systems. Not just in air to ground, but as we see here, in air to air.