This seems like a spot where you're either way ahead or way behind. First I would take into account what type of hands my opponent has called raises with. I wouldnt think about the short stack because he could just have a 6 and make that move or nothing at all thinking he could pick up the pot right there.

Now, It's hard to image my opponent called an UTG raise with a 5 in his hand so I figure he has one of 4 hands...

55's
66's
Axs for the nut-flush draw
a mid pair.

Though I have encountered players cold calling with AA/KK and slowplaying me, in this case I would proably pay those hands off. It's just not that many hands I could see him having and other than the flush draw, thats not a scary board and I don't see quads pushing over the top on the flop.