If you make trips using only one hole card, your worst fear is that someone else has trips as well with a better kicker. Not an issue here.
Yes, the boat beats you. But playing scared will cost you more than losing in these situations, as you lose all the profit you could have made by folding, whereas by calling here you only lose if he has the hand, which (as discussed above) isn't the most likely situation.