Because you don't really steer with the handle bars so much as you lean with the bike. On the road, the only purpose those bars serve is to steady the bike. Otherwise, they're there to turn at stops and the like. For that purpose, I imagine it wouldn't be too difficult.

Though, it still looks silly as Hell and would probably tire the arms out. So while control really isn't an issue, it would certainly be extremely unsafe.