IoT Data Processing Slowing You Down? Here’s How to Get the Most From Your Data

Reading Time: 3 minutes

Some of the easiest, most powerful lessons we learn when we are young seem obvious—usually after we learn them. My dad taught me one the first year he let me help him plant his garden when I was a kid. Early one spring, he gave me a shovel and a wheelbarrow and said, “Go dig a row of holes and dump all the dirt in the wheelbarrow.”

So, naturally, I placed the wheelbarrow at the far edge of the garden, put my shovel in the ground at the opposite end, walked the scooped dirt all the way over to the wheelbarrow, and then walked all the way back again to my row of holes. 

My dad watched me do this a few times (laughing under his breath, I’m sure) until he finally said, “Hey Kevin, don’t you think you’d get the job done faster if you moved your wheelbarrow closer to your holes?” Brilliant.

Believe it or not, this simple lesson can also be applied to data processing from your Internet of Things (IoT) devices. TIBCO—an innovator in microservices tooling—provides various solutions designed to process IoT data more quickly and efficiently.

Lost Opportunities Due to Latency in IoT Processing 

The modern version of the lesson goes like this: typically, IoT devices are connected directly to an edge device within a local network. The IoT devices send data they collect through the edge devices and up to an IoT platform hosted within a private or public cloud, such as the TIBCO Cloud platform. This platform processes the data—collecting, filtering, and analyzing—so that appropriate action is taken. So in network terms, the IoT devices are all close to each other. But, like my wheelbarrow and the garden holes I had dug, this topology puts quite a bit of distance between IoT devices and the IoT platform. 

The effect is a high amount of latency between the time data is collected by IoT devices and the time it is acted upon—which can translate into lost opportunities if data isn’t acted upon when it is of the highest value.  

How to Decrease Latency in IoT Processing

It would make sense then, as my dad would suggest, to move the processing of your IoT data closer to your IoT devices—such as on your edge devices. However, edge devices have limited compute resources (i.e., memory), which limits the size (and functionality) of applications that can be deployed to them when written in traditional languages such as Java. So instead of a wheelbarrow, imagine my dad had given me a teacup. 

That’s where the open-sourced Project Flogo can help. It enables developers to visually create event-driven microservices and functions and, most importantly, it builds application executables that are up to 50X smaller than those written in Java—perfectly scaled-down for (teacup-sized) edge devices and new types of serverless environments such as Function-as-a-Services (FaaS). Although small in size, these applications can embed automated decision-making with contextual rules and machine learning right into the edge device. With Project Flogo, you can process your IoT data more quickly and cost-effectively on edge devices (which are much closer to the source) rather than in the cloud. You can see how through a series of short videos.

TIBCO has commercialized Project Flogo within TIBCO Cloud Integration, our market-leading enterprise Integration Platform-as-a-Service (iPaaS). TIBCO Cloud Integration not only includes commercial technical support and pre-built enterprise connectors, but it is also designed from the ground up to enhance developer productivity and accelerate event-driven application development so you can get to market faster. 

You can try TIBCO Cloud Integration for a limited time to create applications in a development environment within TIBCO Cloud at no charge. And if you decide TIBCO is the right solution for you, have confidence knowing that you will get the lowest total cost of ownership as validated by Forrester Consulting and PushToTest

When you have the right tools and you move them close to where work is done, you can respond with speed to valuable digital moments. And you can plant gardens with your dad too!

This blog was originally published by Kevin Larsen on 11/06/2019.