1. Legal protection
This is probably the most important factor when choosing which form for your business to take. In an LLC that is being run properly (that means, especially, no co-mingling of funds), the owner of the business isn't liable for legal issues that may arise from the business.
So, for example, let's say that your company is a pet taxidermy business. You taxidermy someone's pet as a memorial, but you lose the irreplaceable finished product, and you get sued by the pet owner (your client). You aren't personally liable for that issue; your business holds all the liability. Business assets can be encumbered by the lawsuit, but your personal home, for example, can't be pulled into it.
2. Taxes
Sole proprietorships are, by default, pass-through tax vehicles. You and the business are the same entity, so there's no additional layer of taxation possible. This isn't the case for an LLC, which can and may elect to pay corporate taxes for many different reasons.