When I was at the store the other day I saw a variety of dried beans for $1 a pound. Bananas were 79 cents a pounds, several apple varieties were 89 cents a pound. Oatmeal was about $3.50 a pound. Cabbages, potatoes, carrots and other root vegetables are usually fairly cheap. Basic staples aren't that expensive. It is possible to eat a healthy diet without breaking the bank.
As a diabetic, I agree to a point. Eating healthy for a diabetic is a little different than it is for one that is not. Such things that you listed are good options. I have to watch the carbs from fruits and not over do it--yes, that's right, there is a such thing as eating too much fruit.
Grocery stores in many areas don't carry the selections that you mentioned. Overall, I have found eating healthy from the gocery store is more expensive but it is cheaper than eating out or buying prepared meals.
These people expecting food stamps to buy everything that they want are nothing new. In the mid-80's, when I worked in a gorcery store, food stamp users complained about it all of the time. A woman chewed out the cashier because WIC (Women Infant and Children) vouchers didn't buy all for more expensive items, what her WIC vouchers didn't buy her foodstamps did. When I carried her groceries out, she was driving a brand new van and I was walking to work because I couldn't afford a vehicle.