The US president said the royals got him to do “something that nobody else was able to do”