The Oracle of Omaha, Warren Buffett, is known for making wise investing decisions. But what's the smartest move he didn't make? Moving out of Omaha.

Moving back from New York City in 1956, Buffett reflected that staying in Omaha has allowed him to focus. It's also allowed him to stay a bit isolated from keeping up with the Wall Street Joneses.

Interestingly, another heavyweight, Fairholme Fund manager Bruce Berkowitz, lives in Miami, far from the maddening crowd. Currently, he's staying the course on his heavy concentration in financial stocks, including his massive holding in AIG.

Time will tell on the current positions, but in the following video, analyst Anand Chokkavelu explains how location is an indication that both Buffett and Berkowitz are willing and able to distance themselves from the herd -- both figuratively and literally.

We all would like to build long-term wealth and retire well. In our free report "3 Stocks That Will Help You Retire Rich," we reveal some stocks that could help you, as well as some winning wealth-building strategies. Click here to read more.