Select the Fitbit application on your phone.
Select your profile on the very top-left of the screen. (You may or not have uploaded a profile picture of yourself here.)
Scroll down until you find "App Settings," and select it.
Deselect "Set Automatically" to stop your Fitbit application from auto-setting your time.