You're right, I don't listen to binaural recordings because there aren't many of them. More precisely, they aren't made by the recording artists I like.
But an equally important reason why I don't listen to binaural recordings is because to me, they tend to fall into the uncanny valley. Watching the clip to which you referred, I was sitting in my chair in my office, watching the camera/dummy head bobble along the embankment. This jaunty movement, plus the wobbling as he moved the head left and right, made it all the more apparent that I was sitting in my office and watching a youtube video. Addtionally, I might have some coupling issues but the sound still felt as if it were inside my head. Maybe a VR headset is necessary to get the full experience; I don't know. But to me, watching binaurally recorded video just feels strange more than anything else.