Why is it selfishness to not want to give your money to something just because someone bigger than you said you should?

Also selfishness is a good meaningless word to push the message you want.