Trying not to scare him off

If I was the opponent and I had a good draw, I would probably peel against those size bets. If the flop had 3 different suits those sizes would be a little more justified, although it would still depend on how much he clings to top pair type hands.

Also what are you putting him on?