It may not make much sense since he doesn't know the Doctor well at that point, but I still love it! I think it's supposed to show that Rory is rather insightful. That and his lines when he first goes in the TARDIS. To be fair to him though, he has had A LOT of time to think about the Doctor and he did see the Doctor in action before this episode.