You don't have to go all in. Just bet so that his odds are higher than 4:1, if you do that he is making a mistake calling and you have done your job no matter what the outcome. In this case he also has a pair and straight draw as well so I don't think hes folding but you didn't read him for that.