What he means by "you've always known" is that he's always known that his little brother he burned over a toy was eventually gonna put him down. It's consistent and the dialogue is fine. The editing of the scene was just....off. I never would have thought that's how the writers would manage their interaction. Hound quietly walking across the platform to face off, just, no.