According to GOT wiki the scene I referred to was in S01E08 and it was the third episode in which he said anything. So it's not that bad.