They are relatively easy to care for, like any animal you have to be around every day (though with goats, if you make sure they have water and forage, and there isn't much predator threat, you have more freedom that with most anything else). Unless you are trying dairy goats, in which case you might as well forget the rest of your life and get used to muttering "Dammit, why the HELL did I ever start this?"
Downside is that will indeed climb on anything they can, they will screw up trees in their pasture unless they don't like the taste of the bark, and they are very curious and will escape to find the any outdoor pet food dish within a quarter mile as soon as your back is turned.
Upside is that they really will eat just about any vegetation once they eat down the good stuff to a closely-mowed level, they are rather mild-mannered, even affectionate, they do pay attention to electric fences once they learn what they are, and if you are not the sort that gets too attached to your critters, they are easy to butcher at home and pretty tasty (a lot like venison).