I think you are not behind
This is not the correct way to look at it. Put villain on a range, and then work out what % of the time he beats us, and what % of the time he doesn't, then look at pot odds, and decide if call is +ev or not.

By saying "I don't think we're losing", you're failing to take these steps which will massively increase your winrate. You're making the mistake of putting villain on a hand, rather than a range, and you're making the even bigger mistake of putting villain on a hand we beat to justify a call.