If 6 people are seeing the flop even through a 4xBB raise, I think you need to raise more there. QQ against 6 people sounds sucktacular.

As for the hand, I would lean towards calling. No reraise preflop so the chances of AA/KK are diminished, I think he might've thought you had AK/AQ and missed on the flop which allows him to make that move.