He either has the nut flush, some weak TP pair and straight draw, or some form of flush draw.

ISF folding the flop seems dumb

I actually kinda like your play.