How to stop yourself from falling too fast?

You're right, this isn't something you should lean on too fully. This guy sounds sketchy, especially since you're "together" but not boyfriend/girlfriend. You need to be up front with this guy about the girl at the gym and flat out let him know that he can't have both of you, because from what you're describing, that's what he's trying to do.