When you talk to investors about the costs that affect their investing the most, you'll hear a lot about broker commissions. Yet in the long run, another type of fee can cost you thousands of dollars -- giving you plenty of incentive to take the next step in your stock market education and start buying individual stocks on your own.

Mutual funds have huge advantages for beginning investors. When you're starting out, a good mutual fund gives you several benefits. You can start with a diversified portfolio, even if you only have a few hundred dollars to invest. You can read your fund manager's annual reports and shareholder letters to get insight on your fund's approach to successful investing. And over time, you can add to your investment nearly effortlessly, simply buying new shares whenever you have extra cash to put to work in the market.

But once your portfolio gets big enough, mutual funds start getting much more significant. And during tough times, you need to think twice before you pay thousands of dollars in mutual fund fees -- because whether the market rises or falls, you're losing that money year in and year out.

$1,000 pays a lot of commissions
In contrast to mutual funds, brokers are notorious for their fees. The top complaint: You can't do anything without paying something. Each time you buy a stock, there's a commission. Buy five stocks, pay five commissions. Need to sell one? Pay another commission. Meanwhile, most mutual fund purchases and sales are absolutely free.

But there's definitely a price you pay for mutual funds -- and the more you own, the more you pay. As of the end of 2008, households owned about $9.6 trillion worth of mutual funds, according to the Investment Company Institute. With an estimated 92 million investors owning mutual fund shares, the math works out to about $105,000 in fund assets for the average investor. The vast majority of these assets are mutual funds.

With an average expense ratio for stock mutual funds of about 1%, the typical investor pays more than $1,000 per year just to cover the expense ratio. And remember, expense ratios don't even include the transaction costs that funds incur to trade stock holdings -- which some analysts estimate can add as much as 2% more in costs annually.

Do-it-yourself investing
Instead, by taking charge of investing your own large portfolio, you can save a bundle. For example, say you own $100,000 in the Pioneer Cullen Value Fund (CVFCX). Because the fund owns only around 40 stocks, you could instead just buy them all in a brokerage account. And because the fund has a very low turnover ratio of 13%, you wouldn't have to make lots of transactions to track the fund's changing holdings.

In addition, by owning each stock individually, you'd open up some options you don't have as a fund shareholder. Take a closer look at some of the fund's top 10 holdings:

Stock

Share of Fund Holdings

10-Year Annualized Return

Oracle (NASDAQ:ORCL)

3.95%

12.6%

ITT (NYSE:ITT)

3.26%

10.6%

JPMorgan Chase (NYSE:JPM)

3.25%

0.1%

Johnson & Johnson (NYSE:JNJ)

3.17%

4.1%

Hewlett-Packard (NYSE:HPQ)

3.09%

1.8%

Microsoft (NASDAQ:MSFT)

3.01%

(3.5%)

Disney (NYSE:DIS)

2.93%

(0.4%)

Source: Morningstar, Yahoo! Finance. Holdings as of April 30. Returns as of June 10.

As a fund shareholder, when it comes to buying and selling, you're at the mercy of the fund. Among other areas, that makes a big difference in taxes. If the fund chooses to sell its long-term winners, you'll pay capital gains tax -- even if the fund loses money overall.

But if you own the shares yourself, you call the shots. Instead of selling shares like Oracle where you have big gains, you can choose to liquidate losers to harvest tax-loss benefits -- or simply stay put.

More importantly, as you gain experience, you'll feel more comfortable putting your own spin on a fund manager's picks. For example, if you like a certain manager but disagree with a fund's holdings in one particular industry, you can instead just focus on the fund's other picks. Eventually, you can take off the training wheels and research your own stock ideas, rather than relying on those of fund managers.

Take control now
When you consider how much you're paying for a big fund portfolio, commission costs seem like a drop in the bucket. Given how much flexibility a brokerage account of your own adds to your investing, finding the right broker really pays off.

More on investing in tough times: