• Integration
  • Analytics
  • Customer Success
  • Data Management
  • TIBCO News
Search
  • TIBCO Software Inc.
  • Support
  • Documentation
  • Community
  • Contact Us
TIBCO Software Inc The TIBCO Blog
TIBCO Software Inc
  • Integration
  • Analytics
  • Customer Success
  • Data Management
  • TIBCO News
  • Contact Us
Home Integration & API Management Flogo How to Process Your IoT Data More Efficiently
  • Integration & API Management
  • Flogo
  • Connected Intelligence
  • Trends and Innovation
  • Internet of Things (IoT)
  • TIBCO Cloud Integration

How to Process Your IoT Data More Efficiently

By
Kevin Larsen
-
November 6, 2019
Facebook
Twitter
Linkedin
    TIBCO To More Efficiently Process IoT Data, Move Your Wheelbarrow Closer to Where You Dig
    Reading Time: 3 minutes

    Some of the easiest, most powerful lessons we learn when we are young seem obvious—usually after we learn them.  My dad taught me one the first year he let me help him plant his garden when I was a kid. Early one spring, he gave me a shovel and a wheelbarrow and said, “Go dig a row of holes and dump all the dirt in the wheelbarrow.”

    So, naturally, I placed the wheelbarrow at the far edge of the garden, put my shovel in the ground at the opposite end, walked the scooped dirt all the way over to the wheelbarrow, and then walked all the way back again to my row of holes.  

    My dad watched me do this a few times (laughing under his breath I’m sure) until he finally said, “Hey Kevin, don’t you think you’d get the job done faster if you moved your wheelbarrow closer to your holes?”  Brilliant.

    Lost opportunities due to latency in IoT processing 

    Believe it or not, this simple lesson can also be applied to the processing of data from your IoT devices. TIBCO—an innovator in microservices tooling—had the opportunity to present this lesson at this year’s Microservices World event as part of a breakout session.

    The modern version of the lesson goes like this: Typically, IoT devices are connected directly to an edge device within a local network. The IoT devices send data they collect through the edge devices and up to an IoT platform hosted within a private or public cloud, such as TIBCO Cloud.  This platform processes the data—collecting, filtering, and analyzing so that appropriate action is taken. So in network terms, the IoT devices are all close to each other. But, like my wheelbarrow and the garden holes I had dug, this topology puts quite a bit of distance between IoT devices and the IoT platform.  

    The effect is a high amount of latency between the time data is collected by IoT devices and the time it is acted upon—which can translate into lost opportunities if data isn’t acted upon when it is of highest value.  

    How to decrease latency in IoT processing

    It would seem to make sense then, as my dad would suggest, to move the processing of your IoT data closer to your IoT devices—such as on your edge devices. However, edge devices have limited compute resources (i.e. memory), which in turn limits the size (and functionality) of applications that can be deployed to them when written in traditional languages such as Java.  So instead of a wheelbarrow, imagine my dad had given me a teacup. 

    That’s where the open-sourced Project Flogo can help. It enables developers to visually create event-driven microservices and functions and, most importantly, it builds application executables that are up to 50x smaller than those written in Java—perfectly scaled-down for (teacup-sized) edge devices and new types of serverless environments such as Function-as-a-Services (FaaS).  Although small in size, these applications can embed automated decision making with contextual rules and/or machine learning right into the edge device. With Project Flogo, you can process your IoT data more quickly and cost-effectively on edge devices (which are much closer to the source) rather than the cloud. You can see how through a series of short videos.

    TIBCO has commercialized Project Flogo within TIBCO Cloud Integration, our market-leading enterprise Integration Platform-as-a-Service (iPaaS).  TIBCO Cloud Integration not only includes commercial technical support and a wide variety of enterprise connectors, it also includes many productivity features that simplify and accelerate event-driven application development.  You can try TIBCO Cloud Integration for a limited time to create applications in a development environment within TIBCO Cloud at no charge.

    When you have the right tools, and you move them close to where work is done, you can respond with speed to valuable digital moments.  And you can plant gardens with your dad too!

    • TAGS
    • Flogo Enterprise
    • IOT
    • microservices
    • Project Flogo
    • TIBCO Cloud Integration
    Facebook
    Twitter
    Linkedin
      Previous articleTESCO Bank and PostNL Discuss Their Journey to the Cloud: The Pitfalls, Challenges, and Benefits
      Next articleTurning Big Data into Actionable Analytics at TIBCO NOW London
      Kevin Larsen
      Kevin Larsen is the Senior Product Marketing Manager at TIBCO Software. Over his 25+ year career, he has held positions in Software Development, Technical Education, Business Development, and Product Marketing Management. Kevin holds a B.A. in Mathematics, an M.S. in Software Engineering, and an M.B.A.

      RELATED ARTICLESMORE FROM AUTHOR

      TIBCO Data in Healthcare

      Why Healthcare Needs New Data and Analytics Solutions Before the Next Pandemic

      TIBCO Master Data Management Relationships

      Understanding Key Facets of Your Master Data; Facet #2: Relationships

      TIBCO How to Become a Data Scientist

      Invest Your Time in the Right Skills to Become a Data Scientist in 2021

      Master your API strategy ebook download
      Design a Successful Data Strategy
      Readying Enterprises for the New Generation of Analytics

      CATEGORIES

      Advanced Analytics Analytics Big Data Analytics Cloud Cloud Analytics Connected Intelligence Customer Success Data Analytics Digital Transformation Enterprise Social Featured Finance General Industries Integration & API Management Messaging & Event Processing Mobile Analytics TIBCO News TIBCO NOW Trends and Innovation
      • PRIVACY POLICY
      • TERMS OF USE
      • CONTACT US
      Copyright © 2021 TIBCO Software Inc. All Rights Reserved.
      Edit with Live CSS
      Save
      Write CSS OR LESS and hit save. CTRL + SPACE for auto-complete.