I think you can call the flop, but not the turn. Flushes don't have nearly as much implied odds as people like to think, and your A may well not be an out here. Plus if as you say he probably has a big hand like a set, not all your flush outs are clean either.

Leading the flop is fine imo, unless you have a read that he raises cbets light.