I agree with everyone else. You gotta pay this off. Given the information about your opponent thinking a lot before each act, you have to pay it off.

If he does have the flush then understand his deceptive behavior (waiting to bet or call)

Feels like he hit a lower two pair on the river and wasn't putting you on a flush so he raised.