If you're allowing Chrome to show notifications for approved sites, you can remove sites that you've already approved by clicking "Manage exceptions..."
Click on the site you want to remove, and click on the x that shows up to the right of the line. This will remove the exception. And that's it!
Did you know you can disable the pop-up blocker in Chrome as well?