It's fine. I think a set either leads this flop or c/raises you for more than a minbet, unless he's trying to induce a 3-bet, but we've all seen weirder so nothing wrong with being cautious here.