All Data Is More Valuable Than Big Data

Reading Time: 2 minutes

This post originally appeared on VentureBeat as Forget big data—let’s talk about all data.

We constantly hear people talking about Big Data as a monstrous mess. They usually describe it as a difficult problem to tackle, as though Big Data itself has a beginning and an end, or a neat solution. I’ve been to many conferences in the last few weeks, and over and over again, I’ve heard people talking about what they think of Big Data. Speaker after speaker, it became apparent that the way we talk about Big Data is our attempt to compartmentalize it.

Neat Data Sets

Compartmentalizing Big Data is a natural thing to do. Since we first began to track things using numbers, we had to know where the information started and ended because that’s where work began and finished. When we first computerized data, we had to know where a batch was beginning and ending because the digitized world was a transactional one, with data tracking sales, costs, inventory, all and other finite information.

That’s the reason we talk about data sets and batch jobs. It fits a paradigm we’re comfortable with. But at the same time, aren’t we missing something? Aren’t we failing to take into account all of the data being created everywhere, every day? The perceived value of different types of data will grow exponentially in the future. Today, certain types of data may not appear useful or valuable or may be too difficult to process, but I can guarantee that your future self will see things differently.

Using All Data Instead of Just Big Data

What if, instead, we think about dealing with all of the data that already exists and focus our efforts on linking data together, analyzing it more broadly, and letting it provide value to a wide range of people in our organizations? Does that sound much harder than using the patterns of the past? Maybe, but isn’t the difficulty level of something merely a measure of the value of outcome against effort? With the term ‘Big Data,’ we’re actually thinking small, solving point problems without dealing with the more pressing, more valuable outcomes that are available when we think about all data.

Some of the most successful companies in the world won’t use the term Big Data because they’ve discovered all data. One of my best customers is on a constant quest for ever-greater connectivity to any and all consumer preference data. They know that each and every day they learn more about what matters most to their customers. They aren’t putting boundaries around what they’ll monitor, and they have what is considered to be one of the most advanced data architectures in the world.

So let’s get out of the Big-Data (which is really a small-data) mindset. All data is the real mess to clean up, whether we see it right now or not. All data is waiting to be discovered and put to use. All data is where the real value is found.

See how your Big Data strategy stacks up by taking this self-assessment.

Read the original piece here

Previous articleThe Trick to Knowing What You Need to Know at Work…
Next articleData Analytics and Continuous Productivity
Matt Quinn has been with TIBCO for 14 years. During this time he has had several worldwide roles. As CTO, Quinn works with all product groups to create a common, corporate-wide vision for all of TIBCO's products and technologies; ensures interoperability between TIBCO's various products families, as well as consistent architectural approaches across all groups; and provides overall leadership and coordination of TIBCO's product plans and technology direction. Up until his new role as CTO, Quinn has been responsible for the Composite Application Group (CAG). This group encompasses TIBCO's SOA, BPM, Infrastructure, Monitoring and Management, Governance and User Experience technologies. This group is responsible end-to-end for the engineering, quality, delivery of product, product vision, and customer enablement. Earlier in his TIBCO career, Quinn was a global architect, responsible for the delivery of some of TIBCO's largest implementations in diverse areas such as transportation and logistics, energy and finance. This was a hands-on role, building real systems architecture for production customers.