Dropping Slow Joe would be seen as a desperation move by Obama, and along with all the other Obama appointees that have jumped ship or been thrown under the bus would provide great fodder for campaign ads.
"Why vote for Obama, he has no faith in his own appointees, and many of them had little faith in him."