I would've folded that too. Looks like calling stations who may have gotten some piece of that flop or are holding an A. Runner/runner flush is like a 1 in 20 chance so if you call the $1 in bets you would have to win $20 to make this a consistently winning play.
Also, you don't get implied odds with a flush draw the same way you would with a straight of full. Even a calling station may not call his whole stack down when he sees the board flush.