This was tough to find. I stopped looking for it at some point but found it today while looking for something else. Here's how to change Facebook notifications:
1. Click on the blue World icon in the upper right corner:

2. Click on Settings in the upper right corner of the box that pops up.
3. Click on Desktop and Mobile.
Here you can Turn On/Off notifications here like:
- Comments on posts you're tagged in
- Comments on friends timelines you're tagged in
- Posts you're tagged in
- Updates to an event you've joined
- See your notifications in the corner of your computer screen, even when Facebook is closed