That's a dumbass thing to say for a BUD/S graduate and frogman with UDT. Note that I did NOT say that Ventura was a SEAL. That would not be correct.
From Wiki~
Navy career
From September 11, 1969, to September 10, 1975, during the Vietnam War era, Ventura served in the United States Navy. Ventura graduated with BUD/S class 58 in December 1970[7] and was part of Underwater Demolition Team 12 (UDT).[8] The UDTs were merged with the US Navy SEALs in 1983, 8 years after Ventura had left the Navy.
Bill Salisbury, an attorney in San Diego and a former Navy SEAL officer, accused Ventura of "pretending" to be a SEAL and wrote that Ventura would be blurring an important distinction by claiming to be a SEAL when he was actually a frogman with the UDT. Compared to SEAL Teams, UDTs saw less combat and took fewer casualties.[9][10][11] Following that, Governor Ventura's office confirmed that Ventura was a member of the UDTs. His spokesman stated that Ventura has never tried to convince people otherwise.[9] Ventura stated: "Today we refer to all of us as SEALs; that's all it is," and described the accusations of lying about being a SEAL as "[m]uch ado about nothing."[11]
Ventura has frequently referred to his military career in public statements and debates.[9][12][13] He was criticized by hunters and conservationists for stating in an interview with the Minneapolis StarTribune in April 2001, "Until you have hunted men, you haven't hunted yet."[13][14]
In January 2002, Ventura, who had never specifically claimed to have fought in Vietnam, disclosed for the first time that he did not see combat. He did not receive the Combat Action Ribbon, which was awarded to those involved in a firefight or who went on clandestine or special operations where the risk of enemy fire was great or expected.


Whether or not Ventura actually rates that Budweiser badge that he likes to wear is something of a grey area. Technically he would have had to officially apply for it after it was created in 1975, replacing the then obsolete UDT badge which he did rate.
In any event, when you've got bona fide active duty SeALs knocking you on your ass that pretty much separates the wheat from the chaff right there.