Holy cow, I had no idea. This is how to do it: when on the youtube page, click on the profile button in the top right -> settings -> playback and performance on the left -> disable inline playback.

/edit: It still plays videos on hover after changing it. Only now there is no player popup anymore.