Once he got to the turn he has straight and flush draws, so not bad chasing then, but you are right about calling the flop. As you now say the price was there.
Also your earlier bets probably gave him a pretty good idea what hand you were playing.
Unlucky for you, but an interesting learning point for us.