Welcome!

@CloudExpo Authors: Corey Roth, Elizabeth White, Liz McMillan, Pat Romanski, Yeshim Deniz

Related Topics: @ThingsExpo, @CloudExpo, @DXWorldExpo

@ThingsExpo: Blog Post

Accelerating IoT Deployments to Achieve Business Goals Faster | @ThingsExpo #IoT #M2M #API

IoT creates an opportunity to measure, collect and analyze an ever-increasing variety of behavioral statistics

Accelerating IoT Deployments to Achieve Business Goals Faster

The "Internet of Things" is an exciting area of tech, one in which industry experts estimate there will be more than 30 billion connected IoT devices by 2020. IoT is the inter-networking and instrumentation of physical devices - everything from streets, cars, factories, power grids, ice caps, satellites, and clothing to phones, microwaves, milk containers, planets, human bodies, etc.

IoT creates an opportunity to measure, collect and analyze an ever-increasing variety of behavioral statistics. That being said, data, and more importantly insight into the data, is key for enhanced business value and achieving goals quickly. The proliferation of IoT devices and the sheer volume of large data streams have changed the data processing characteristics that we were accustomed to, forcing new architectures and infrastructure that are designed for streaming data, real-time insights, and real-time analytics.

In order to gain real-time insights to facilitate automation, data about these devices needs to be collected and analyzed with the help of various technologies making up IoT Architecture. For example, by providing IoT monitoring and control companies can optimize plant safety and security, as well as extend into asset management allowing forpredictive maintenance thatdrives efficiencies and maximizes reliability.

Another example of IoT is home automation (also known as smart home devices) to control and automate lighting, heating, air conditioning and household appliances. IoT in infrastructure management monitors and controls urban and rural solar panels, railway tracks, wind-farms, and manufacturing.

Today's modern applications require action. For developers, in order to take appropriate action given the type of data they are working with, it's becoming essential to have an IoT data platform that can provide a set of tools and services to get metrics and events data from sensors, devices, systems, machines, containers, and applications. With an IoT data platform, developers can closely monitor and analyze data for collecting, normalizing, detecting events, as well as storing, managing and automating the entire system.

Given the potential for mixed workloads and data requirements, and to fully evaluate and manipulate IoT data, companies need to consider an IoT platform that specializes in handling a high volume of writes and queries over large and changing data sets. In addition, consideration of storing time stamped data - and looking at changes over a period of time - has to be taken into account. This leads to using a Time Series Database (TSDB), which makes sense because IoT data is time series data and modern TSDBs are built specifically for handling metrics and events or measurements that are time-stamped. A TSDB is optimized for measuring change over time, which is important because time series data, including IoT data, is very different than other data workloads because it must collect data lifecycle management, summarization and large range scans of many records.

Regarding analytics, there are specific kinds of analytics that are looking at real-time change over time - and for deriving insights from these changes -  a TSDB is critical. Time series data such as IoT data comes in two forms: traditional regular (metrics) and irregular (events). Both data forms are present in IoT data. Today's more advanced TSDB platforms are optimized for both regular (example a sensor sending temperature readings every millisecond) and irregular time series data (for example a sensor sending pressure data only if it is above 1000psi). In addition, this class of TSDBs has evolved their data model over earlier time series solutions and have no limits on the number of tags and fields that can be used. This allows timestamp precision in nanoseconds, which is important as sub-millisecond operations become more common with IoT architectures.

Developers also need the ability to perform correlation, aggregation, and pattern detection of the streaming data before it gets to the database - in short the delivery of streaming analytics. They also need the ability to visualize real-time data and set up notification, control and action services to automate the entire IoT system. This can all be delivered by today's advanced TSDB platforms.

Using TSDB platform to help solve the business goals of developing an IoT application - there are three steps that are critical for success:

Accumulate
Developers need to accumulate a comprehensive set of tools and services to get metrics and events data from sensors, devices, systems, machines, containers, and applications. With an open source solution, users can access a number of integrations to popular databases, containers, services, applications, and other monitoring and alerting products.

Analyze
With the right platform, developers can analyze and access real-time stream processing of the data and storage of the time-series data. They are able to graph and visualize data and perform ad hoc exploration of data as needed.

Act
Today's modern applications require actions. Using plugin custom logic or user-defined functions, developers can process alerts with dynamic thresholds, match metrics for patterns or compute statistical anomalies, automatically scale containers, and basically do anything that can programmed.

The world of IoT seems limitless. Developers need to have visibility into all aspects of their data in real time to help meet the demands of even the largest monitoring and IoT deployments.

More Stories By Mark Herring

Mark Herring is a zealous marketer who believes that the road to marketing success always leads with the developer. Before InfluxData, he was VP of corporate marketing and developer marketing at Hortonworks, SVP of Products at Software AG, VP of Middleware, Java and MySQL Marketing at Sun Microsystems, and VP of Marketing at Forte Software. Earlier in his career, he was a developer and technical support engineer for Oracle. He holds a BS from the University of Witwatersrand, South Africa.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
Amazon started as an online bookseller 20 years ago. Since then, it has evolved into a technology juggernaut that has disrupted multiple markets and industries and touches many aspects of our lives. It is a relentless technology and business model innovator driving disruption throughout numerous ecosystems. Amazon’s AWS revenues alone are approaching $16B a year making it one of the largest IT companies in the world. With dominant offerings in Cloud, IoT, eCommerce, Big Data, AI, Digital Assista...
The taxi industry never saw Uber coming. Startups are a threat to incumbents like never before, and a major enabler for startups is that they are instantly “cloud ready.” If innovation moves at the pace of IT, then your company is in trouble. Why? Because your data center will not keep up with frenetic pace AWS, Microsoft and Google are rolling out new capabilities. In his session at 20th Cloud Expo, Don Browning, VP of Cloud Architecture at Turner, posited that disruption is inevitable for comp...
Organizations planning enterprise data center consolidation and modernization projects are faced with a challenging, costly reality. Requirements to deploy modern, cloud-native applications simultaneously with traditional client/server applications are almost impossible to achieve with hardware-centric enterprise infrastructure. Compute and network infrastructure are fast moving down a software-defined path, but storage has been a laggard. Until now.
High-velocity engineering teams are applying not only continuous delivery processes, but also lessons in experimentation from established leaders like Amazon, Netflix, and Facebook. These companies have made experimentation a foundation for their release processes, allowing them to try out major feature releases and redesigns within smaller groups before making them broadly available. In his session at 21st Cloud Expo, Brian Lucas, Senior Staff Engineer at Optimizely, discussed how by using ne...
In his session at 20th Cloud Expo, Mike Johnston, an infrastructure engineer at Supergiant.io, discussed how to use Kubernetes to set up a SaaS infrastructure for your business. Mike Johnston is an infrastructure engineer at Supergiant.io with over 12 years of experience designing, deploying, and maintaining server and workstation infrastructure at all scales. He has experience with brick and mortar data centers as well as cloud providers like Digital Ocean, Amazon Web Services, and Rackspace. H...
Without a clear strategy for cost control and an architecture designed with cloud services in mind, costs and operational performance can quickly get out of control. To avoid multiple architectural redesigns requires extensive thought and planning. Boundary (now part of BMC) launched a new public-facing multi-tenant high resolution monitoring service on Amazon AWS two years ago, facing challenges and learning best practices in the early days of the new service.
@DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises - and delivering real results.
In his general session at 19th Cloud Expo, Manish Dixit, VP of Product and Engineering at Dice, discussed how Dice leverages data insights and tools to help both tech professionals and recruiters better understand how skills relate to each other and which skills are in high demand using interactive visualizations and salary indicator tools to maximize earning potential. Manish Dixit is VP of Product and Engineering at Dice. As the leader of the Product, Engineering and Data Sciences team at D...
Digital Transformation is much more than a buzzword. The radical shift to digital mechanisms for almost every process is evident across all industries and verticals. This is often especially true in financial services, where the legacy environment is many times unable to keep up with the rapidly shifting demands of the consumer. The constant pressure to provide complete, omnichannel delivery of customer-facing solutions to meet both regulatory and customer demands is putting enormous pressure on...
DXWorldEXPO LLC announced today that All in Mobile, a mobile app development company from Poland, will exhibit at the 22nd International CloudEXPO | DXWorldEXPO. All In Mobile is a mobile app development company from Poland. Since 2014, they maintain passion for developing mobile applications for enterprises and startups worldwide.
Both SaaS vendors and SaaS buyers are going “all-in” to hyperscale IaaS platforms such as AWS, which is disrupting the SaaS value proposition. Why should the enterprise SaaS consumer pay for the SaaS service if their data is resident in adjacent AWS S3 buckets? If both SaaS sellers and buyers are using the same cloud tools, automation and pay-per-transaction model offered by IaaS platforms, then why not host the “shrink-wrapped” software in the customers’ cloud? Further, serverless computing, cl...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, @CloudEXPO and DXWorldEXPO are two of the most important technology events of the year. Since its launch over eight years ago, @CloudEXPO and DXWorldEXPO have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors!
DXWorldEXPO LLC announced today that the upcoming DXWorldEXPO | CloudEXPO New York event will feature 10 companies from Poland to participate at the "Poland Digital Transformation Pavilion" on November 12-13, 2018.
22nd International Cloud Expo, taking place June 5-7, 2018, at the Javits Center in New York City, NY, and co-located with the 1st DXWorld Expo will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud ...
@DevOpsSummit at Cloud Expo, taking place November 12-13 in New York City, NY, is co-located with 22nd international CloudEXPO | first international DXWorldEXPO and will feature technical sessions from a rock star conference faculty and the leading industry players in the world.
"DivvyCloud as a company set out to help customers automate solutions to the most common cloud problems," noted Jeremy Snyder, VP of Business Development at DivvyCloud, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
More and more brands have jumped on the IoT bandwagon. We have an excess of wearables – activity trackers, smartwatches, smart glasses and sneakers, and more that track seemingly endless datapoints. However, most consumers have no idea what “IoT” means. Creating more wearables that track data shouldn't be the aim of brands; delivering meaningful, tangible relevance to their users should be. We're in a period in which the IoT pendulum is still swinging. Initially, it swung toward "smart for smart...
"We were founded in 2003 and the way we were founded was about good backup and good disaster recovery for our clients, and for the last 20 years we've been pretty consistent with that," noted Marc Malafronte, Territory Manager at StorageCraft, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
As data explodes in quantity, importance and from new sources, the need for managing and protecting data residing across physical, virtual, and cloud environments grow with it. Managing data includes protecting it, indexing and classifying it for true, long-term management, compliance and E-Discovery. Commvault can ensure this with a single pane of glass solution – whether in a private cloud, a Service Provider delivered public cloud or a hybrid cloud environment – across the heterogeneous enter...
We all know that end users experience the internet primarily with mobile devices. From an app development perspective, we know that successfully responding to the needs of mobile customers depends on rapid DevOps – failing fast, in short, until the right solution evolves in your customers' relationship to your business. Whether you’re decomposing an SOA monolith, or developing a new application cloud natively, it’s not a question of using microservices - not doing so will be a path to eventual ...
We all know that end users experience the internet primarily with mobile devices. From an app development perspective, we know that successfully responding to the needs of mobile customers depends on rapid DevOps – failing fast, in short, until the right solution evolves in your customers' relationship to your business. Whether you’re decomposing an SOA monolith, or developing a new application cloud natively, it’s not a question of using microservices - not doing so will be a path to eventual ...