This article was written by Whitney Tilson in 1999, a year when investor confidence was at an all-time high. Fortunes made in Amazon.com (NYSE:AMZN), Yahoo! (NASDAQ:YHOO), and Nortel (NYSE:NT) gave investors a false sense of security. Although dot-com mania is now history, these timeless lessons about investor overconfidence deserve to be repeated.

Numerous studies have shown that human beings are extraordinarily irrational about money. There are many explanations why, but the one I tend to give the most weight to is that humans just aren't "wired" properly. After all, homo sapiens have existed for approximately 2 million years, and those that have survived tended to be the ones that evidenced herding behavior and fled at the first signs of danger -- characteristics that do not lend themselves well to successful investing. In contrast, modern finance theory and capital markets have existed for only 40 years or so. Placing human history on a 24-hour scale, that's less than two seconds. What have you learned in the past two seconds?

People make dozens of common mistakes, including:

  1. Herding behavior, driven by a desire to be part of the crowd
  2. Using mental accounting to treat some money (such as gambling winnings or an unexpected bonus) differently than other money
  3. Excessive aversion to loss
  4. Fear of making an incorrect decision and feeling stupid
  5. Failing to act due to an abundance of attractive options
  6. Ignoring important data points and focusing excessively on less important ones
  7. Reluctance to admit mistakes
  8. Believing that their investment success is due to their wisdom rather than a rising market
  9. A tendency to seek only information that confirms their opinions or decisions
  10. Overconfidence

Have you ever been guilty of any of these? I doubt there's anyone who hasn't.

This is a vast topic, so for now I will focus on overconfidence. In general, an abundance of confidence is a wonderful thing. It gives us higher motivation, persistence, energy, and optimism, and can allow us to accomplish things that we otherwise might not have even undertaken. Confidence also contributes a great deal to happiness. As one author writes (in an example that resonated with me, given the age of my daughters), "Who wants to read their children a bedtime story whose main character is a train that says, 'I doubt I can, I doubt I can?'"

But humans are not just robustly confident -- they are wildly overconfident. Consider the following:

  • 82% of people say they are in the top 30% of safe drivers.
  • 86% of my Harvard Business School classmates say they are better-looking than their classmates. (Would you expect anything less from Harvard graduates?)
  • 81% of new business owners think their business has at least a 70% chance of success, but only 39% think any business like theirs would be likely to succeed.

Importantly, it turns out that the more difficult the question/task (such as predicting the future of a company or the price of a stock), the greater the degree of overconfidence. And professional investors -- so-called "experts" -- are generally even more prone to overconfidence than novices, because they have theories and models that they tend to overweight.

Perhaps more surprising than the degree of overconfidence itself is that overconfidence doesn't seem to decline over time. After all, one would think that experience would lead people to become more realistic about their capabilities, especially in an area such as investing, where results can be calculated precisely. Part of the explanation is that people often forget failures and, even if they don't, tend to focus primarily on the future, not the past. But the main reason is that people generally remember failures very differently from successes. Successes were due to one's own wisdom and ability, while failures were due to forces beyond one's control. Thus, people believe that with a little better luck or fine-tuning, the outcome will be much better next time.

You might be saying to yourself, "Ah, those silly, overconfident people. Good thing I'm not that way." Let's see. Quick! How do you pronounce the capital of Kentucky: "Loo-ee-ville" or "Loo-iss-ville"? Now, how much would you bet that you know the correct answer to the question: $5, $50, or $500? Write down your answer and I'll come back to this in a moment.

Don't be "that guy"
So people are overconfident. So what? If healthy confidence is good, why isn't overconfidence better? In some areas -- say, being a world-class athlete -- overconfidence might, in fact, be beneficial. But when it comes to financial matters, it most certainly is not. Overconfidence often leads people to:

  1. Be badly prepared for the future. For example, 83% of parents with children under 18 said that they have a financial plan, and 75% expressed confidence about their long-term financial well-being. Yet fewer than half of these people were saving for their children's education and fewer than 10% had financial plans that addressed basic issues such as investments, budgeting, insurance, savings, wills, etc.

  2. Trade stocks excessively. In Odean and Barber's landmark study of 78,000 individual investors' accounts at a large discount brokerage from 1991-1996, the average annual turnover was 80% (slightly less than the 84% average for mutual funds). Incidentally, I suspect that the number of hyperactive traders has increased dramatically, given the number of investors flocking to online brokerages like E*Trade (NYSE:ET) and optionsXpress (NASDAQ:OXPS).

  3. Believe they can be above-average stock pickers, even though there is little evidence to support this belief. The study cited above showed that, after trading costs (but before taxes), the average investor underperformed the market by approximately two percentage points per year.

  4. Believe they can pick mutual funds that will deliver superior future performance. The market-trailing performance of the average mutual fund is proof that most people fail in this endeavor. Worse yet, investors tend to trade in and out of mutual funds at the worst possible time as they chase performance.

  5. Have insufficiently diversified investment portfolios.

Final analysis
OK, I won't keep you in suspense any longer. The capital of Kentucky is Frankfort, not "Loo-ee-ville." Most people would have lost $500 on that question.

In tests like this, securities analysts and money managers are among the most overconfident. I'm not surprised, given my observation that people who go into this business tend to have a very high degree of confidence. Yet ironically, it is precisely the opposite -- a great deal of humility -- that is the key to investment success.

optionsXpress is aMotley Fool Rule Breakersselection. Yahoo! and Amazon areStock Advisorrecommendations.

Fool financial editor Joey Khattab, who updated this article, does not have a position in any of the companies mentioned. The Fool has a disclosure policy .