The UK's moral and legal responsibility starts when these people enter UK territory.
This is probably why we're sending boats out to stop them getting into our territorial waters.