Welcome!

@CloudExpo Authors: Elizabeth White, Zakia Bouachraoui, Liz McMillan, Roger Strukhoff, Pat Romanski

Related Topics: @CloudExpo, Agile Computing

@CloudExpo: Blog Post

Leveraging Big Data in Real Time

Analyzing multiple sources of information to improve business outcomes

After writing my last blog on the government use of cloud solutions, I attended two events and found solutions that can address the need of leveraging data analytics toimproving business outcomes. The internet of things has been a hot term for a long time and the associated challenge has always been on how to leverage this data. Challenges facing governments in collecting a wide realm of data from multiple sources has been a perpetual challenge but cloud computing and big data analytics makes it a “solvable” problem.

There are some major characteristics that such solutions need to have:

  • 1. Extract, Transform, Load (ETL) tools or similar process capabilities
  • 2. Data Warehouse
  • 3. Data Mining
  • 4. Real Time Stream Processing
  • 5. Dashboard Capability


If you want to learn more on how to start on this path, do plan to attend Cloud Computing Bootcamp held as a track with 10th Cloud Expo in NYC from June 11-14, 2012.

Here were the two events I referred to above:

1.  At IBM Pulse, I found an IBM offering called Intelligent Operations Center providing a dashboard to view various government services.  However, any dashboard has to be powered by data.  Behind the scenes in this offering is the infrastructure and framework required to collect real time data from multiple sources.  As any new software offering, it boasts being available through the cloud or by any city’s own data center.  As a middleware provider, IBM has taken this platform and built smarter city offerings around transportation and water use cases.

2. The GigaOM Structure Data conference in New York City was primarily focused on BigData with a number of emerging companies demonstrating solutions monetizing the process of turning data into intelligence.  After visiting the SQLStream exhibit, I met Damian Black, the CEO of SQLStream who explained the business value of their product and how it helped New South Wales, Australia with their transportation problems. SQLStream seems to specialize on the real time stream processing as their niche capability that makes it simple to implement for specific use cases that needs that capability.

The examples of SQLStream and IBM shows that there is movement to process this data into actionable insights.

The challenge for both solutions is delivery of solutions to the vast customer set of customers in multiple geographies and under different regulations.  The key would be to leverage ISV’s and partners to enable execution for very real problems faced today.

As big data and cloud computing progresses, there will be more vendors pouncing on the opportunity to provide a platform for the internet of things to feed data into a warehouse and then being able to provide users with insight never possible before.  There is plenty of room of opportunity for multiple solutions.

Organizations need to build a strategy in helping them evaluate their current business processes.  If you want to learn more on how to start on this path, do plan to attend Cloud Computing Bootcamp held as a track with Cloud Computing Expo in NYC from June 11-14.

More Stories By Larry Carvalho

Larry Carvalho runs Robust Cloud LLC, an advisory services company helping various ecosystem players develop a strategy to take advantage of cloud computing. As the 2010-12 Instructor of Cloud Expo's popular Cloud Computing Bootcamp, he has already led the bootcamp in New York, Silicon Valley, and Prague, receiving strong positive feedback from attendees about the value gained at these events. Carvalho has facilitated all-day sessions at customer locations to set a clear roadmap and gain consensus among attendees on strategy and product direction. He has participated in multiple discussion panels focused on cloud computing trends at information technology events, and he has delivered all-day cloud computing training to customers in conjunction with CloudCamps. To date, his role has taken him to clients in three continents.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


CloudEXPO Stories
Cloud-Native thinking and Serverless Computing are now the norm in financial services, manufacturing, telco, healthcare, transportation, energy, media, entertainment, retail and other consumer industries, as well as the public sector. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete at launch. DevOps may be disruptive, but it is essential. DevOpsSUMMIT at CloudEXPO expands the DevOps community, enable a wide sharing of knowledge, and educate delegates and technology providers alike.
IT professionals are also embracing the reality of Serverless architectures, which are critical to developing and operating real-time applications and services. Serverless is particularly important as enterprises of all sizes develop and deploy Internet of Things (IoT) initiatives. Serverless and Kubernetes are great examples of continuous, rapid pace of change in enterprise IT. They also raise a number of critical issues and questions about employee training, development processes, and operational metrics. There's a real need for serious conversations about Serverless and Kubernetes among the people who are doing this work and managing it. So we are very pleased today to announce the ServerlessSUMMIT at CloudEXPO.
AI and machine learning disruption for Enterprises started happening in the areas such as IT operations management (ITOPs) and Cloud management and SaaS apps. In 2019 CIOs will see disruptive solutions for Cloud & Devops, AI/ML driven IT Ops and Cloud Ops. Customers want AI-driven multi-cloud operations for monitoring, detection, prevention of disruptions. Disruptions cause revenue loss, unhappy users, impacts brand reputation etc.
This month @nodexl announced that ServerlessSUMMIT & DevOpsSUMMIT own the world's top three most influential Kubernetes domains which are more influential than LinkedIn, Twitter, YouTube, Medium, Infoworld and Microsoft combined. NodeXL is a template for Microsoft® Excel® (2007, 2010, 2013 and 2016) on Windows (XP, Vista, 7, 8, 10) that lets you enter a network edge list into a workbook, click a button, see a network graph, and get a detailed summary report, all in the familiar environment of the Excel® spreadsheet application. A collection of network maps and reports created with NodeXL can be seen in the NodeXL Graph Gallery, an archive of data sets uploaded by the NodeXL user community.
"There is a huge interest in Kubernetes. People are now starting to use Kubernetes and implement it," stated Sebastian Scheele, co-founder of Loodse, in this SYS-CON.tv interview at DevOps at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.