* Within states, but regionally, there are quasi-governmental and governmental creatures like "open space districts" that make large amounts of land off-limits for building or like CA's Coastal Commission that has such absolute power in "coastal" areas that they can refuse to permit a home owner to repair damage due to weather and age, unless the home owner gives up some part of their land or gives up some sort of "public access" easement.
Speaking of permits, I encounter requirements all those time if one wants to fix up your home. I am a DIYer and fixing a door or window requires a permit. There is enough regulations which are already on the books.