Just tried myself and can confirm this happens to me as well (It's fun finally having 2 monitors to play with). Clicking the Youtube icon in the video player will open a browser window which can then be full screened on the second monitor but unfortunately the page doesn't automatically load the next video in the queue.
I'll let Experts know about it.
Thanks,
Dante557