Personally, that's how it should be done. We were not made to factory farm animals. It is possible to exist, as many of us here at VegTalk are doing without any animal products, but personally, I do not have the time, resources, or the correct location to farm my own animals, or to go into the great wild and shoot a deer.
The main aim of veganism, I think, is to reduce suffering on the part of animals that we unnecessarily cause.
That being said, it sounds like you really care about your family and you seem to be doing a great job. Whether or not a person eats meat it entirely up to them.
Personally, I can say that yes. I do live an extremely healthy dietary lifestyle, and my body feels great because of it.