One possible problem here is the precedent - will other team members now feel that they can back out without booking a substitute? "Oh but when X pulled out you all agreed you didn't need him to pay for a replacement, so why should I?".