Imo you have to raise that river. Raise to at least $6. He will call with two pair, maybe any decent Jack. If he comes back over the top then he has the flush, but just calling here is screaming that you are playing with scared money.