Modern society is awash in massive data sets. I'm not just talking about the Internet, although that's certainly the most obvious and diverse example you'll encounter all day. The data sources are unending:
- Every phone call and text message becomes a data point in your carrier's extensive logs. Multiply this by literally billions of global landlines and cell phones, and the Internet starts to look small by comparison.
- I once drew a map showing how to get from Miami to Jacksonville, Fla.: two points connected by a straight line representing I-95. Though that was a memorable achievement, reality is complex and maps can get incredibly large and detailed.
- Weather forecasts have moved far beyond reading the Farmer's Almanac and looking at the sun. Weather stations are constantly collecting heaps of data and passing it on to supercomputers for processing. And we still can't see something like Hurricane Katrina coming until it's too late to do much about it. Those spaghetti models sure look pretty, though.
Wal-Mart is said to own the largest database anywhere, generated by trillions of transactions at history's biggest retailer. Smaller retailers naturally have smaller data sets to analyze, but sometimes they're richer: Amazon.com
goes beyond anonymized purchasing habits by knowing what your email address is, where you live, and how you click around its sites. (Nasdaq: AMZN)
These are just a few examples from a much longer list. The list of Big Data generators is a pretty big data set in itself.
Add it all up, and market-research firm IDC says you got 180 exabytes of information in 2006, or 180 billion gigabytes. That tally rose by 56% in 2007 and is expected to multiply by 10 between 2006 and 2011.
Big problem? Big business!
If you find it hard to wrap your head around a number that large, imagine the desperation of business managers needing to mine this wealth of data to find nuggets of actionable information. Or you can visualize IT professionals breaking out in cold sweats over the scope of that task, or in bouts of evil chuckles as they realize the equally enormous business opportunity of it all.
You need to store it, which is good news for leading storage vendors EMC and NetApp
Beyond storing it all, you also need to move the data to where it's needed. That can mean streaming video to a consumer or collecting data in a centralized data warehouse. Either way, there's a network involved. Yep, networking experts from Cisco Systems
And then you need to analyze it, which is the real black magic of it all.
The real gusher
Data mining is the art and science of looking at mostly meaningless data to divine actionable patterns, and business intelligence is data mining applied to, well, business. This is where the real opportunity lies.
Wherever there's a database, you'll find Oracle
For us investors, it's better to find smaller specialists in the field. It's easier to double a billion in sales than a hundred billion, after all, and the stocks are primed to follow the same pattern. So pinpointing thought leaders on a much smaller scale will maximize your returns.
We'll shoot right past business intelligence and customer relationship management expert Salesforce.com and down to smaller but hotter data mangler Tibco Software
Or perhaps the better opportunity lies in data-mining generalist Teradata
Tibco and salesforce.com have been identified as shorting opportunities by one of our own Foolish newsletter services, even while another newsletter recommends buying salesforce.com. I disagree with the shorting theses because I see heaps of hidden value left to unlock in both stocks.
To find out more about data mining and the stupendous investing opportunities therein, you should read this free report on that very topic. This breakthrough technology is changing the face of business, and your portfolio is begging you to learn more about it. Claim your copy of The Only Stock You Need to Profit From the NEW Technology Revolution -- it's 100% free and packed with valuable information that you don't need Teradata to unlock.
Fool contributor Anders Bylund holds no position in any of the companies discussed here. The Motley Fool owns shares of IBM, EMC, Oracle, and Wal-Mart Stores and has created a bull call spread position on Cisco Systems. Motley Fool newsletter services have recommended buying shares of Amazon.com, salesforce.com, Cisco Systems, Wal-Mart Stores, and Teradata, creating a diagonal call position in Wal-Mart Stores, and shorting Tibco Software and salesforce.com. Try any of our Foolish newsletter services free for 30 days. We Fools don't all hold the same opinions, but we all believe that considering a diverse range of insights makes us better investors. You can check out Anders' holdings and a concise bio if you like, and The Motley Fool is investors writing for investors.