This is the same as the donation notification settings as well as master settings. Interesting fact currently you can get the settings box to move by closing it and then opening it again. It will shift the settings window diagonally right (in the case of the follower notification window)