These are the rules as I understand them -
Women may segregate themselves from men, if they wish. Eg. 'Curves', Belizean Grove etc.
Men many never segregate themselves from women.
Minorities may segregate themselves from whites, if they wish. Eg. Congressional Black Caucus, NAACP, etc.
Whites may never segregate themselves from minorities.