I've never been a fan of Joe Rogan myself, but for a different reason:
He and fellow talentless assclown Doug Stanhope took over 'The Man Show' (Which, when hosted by Adam Carolla and pre- selling- out- to- the- Left Jimmy Kimmel, was easily one of the funniest shows on television), and their brainless, unfunny writing and hosting got it cancelled in half a season!