If you've never logged in to your Comcast router, you can follow this guide to learn how.
Once you've logged in to the router, click Gateway -> Connection -> WiFi. Here you'll find the WiFi networks. Next to your network, click Edit.
Here you can enter a new Network Password. Then click Save.