Once I was at a bar, playing darts with a friend of mine that got real drunk. The guys playing at the board next to us started up a chat. I chatted back, and bet them we could beat them, my buddy couldn't even walk. I won.

They couldn't play. One guy gave me his number. I thought he was cute, and I lived close to the bar, I called him as soon as I got home, thinking I would leave a cute message, and he was already home, he lived even closer! I broke all the rules, and we ended up dating for 3 years. This was many years ago, and my current boyfriend, of over 9 years still says he was the coolest guy I ever dated. LOL!
Just follow your guts, show a little moxie. What is there to lose? Absotively nothing. Ask him to dinner before he moves. Why not?