You are right on target. Bugging out for most folks should be done only as a last resort. Of course much depends on the crisis scenario and your environment.
Hurricane, forest fire, toxic environmental industrial accident, flooding ... there are certainly events when bugging out is the wise course of action. But most serious preppers prep their home environment as their Plan A. Obviously, you can store many more preps, secure and fortify your home, and become a part of a supportive community in your home neighborhood.
On the other hand, bugging out with little more than what's in a bag or in a vehicle for an uncertain and dangerous journey at a time when chaos may be the rule ... well, that's certainly not what most folks would choose to do with their loved ones if they have any choice at all.