I don't consider it a gaffe, either. Romney knows a thing or two about putting on an Olympics.
Secondly, I've long been concerned myself about the security at these Olympics. The Brits have dug themselves such a political-correctness hole, that no criticism or suspicion of Muslims is tolerated. I really worry about the safety of the Israeli athletes.