Probably the main reason I wouldn't call it is not only could he have you beat with AK, AA, KK, TT, but the board is also straight friendly, even though QJ is an unlikely holding. I cant really see him playing this hand as aggressively preflop and postflop with AQ or AJ on that board.

But knowing me, if I was in that situation I prolly would've called too...