I think its less McCain took a fall, and more that Republicans expected a tough run. As a RINO, McCain has a history of working with both Dems and Republicans. If the GOP was going to retain that seat, being seen as a switch hitter was the only way to do it.
If a solid conservative got the nomination, he or she would have been destroyed at the polls, as well as their chance of ever running again.