Welcome!

@CloudExpo Authors: Elizabeth White, Zakia Bouachraoui, Liz McMillan, Roger Strukhoff, Pat Romanski

Related Topics: @CloudExpo, Agile Computing

@CloudExpo: Blog Feed Post

Twitter, DarkStar & Telescope – Delivering Sentiment to an Equities Broker

Cloud Event Processing has moved off the white board and into the real world of, ‘hey, we’ve got customers!’

Cloud Event Processing has moved off the white board and into the real world of, ‘hey, we’ve got customers!’

Twitter

When building a system like DarkStar, one can always run into difficulties – how does one demo a cloud based, distributed event processing system incorporating streaming map/reduce, complex event processing, and event driven pattern matching agents to prospective customers?  Our background includes very high velocity feeds, like equities and option market data feeds, but using those for demo purposes can be difficult.  So we decided on using Twitter.  We decided to use Twitter because we could access tweets via a feed, Twitter is relevant, and using DarkStar to analyze the relatively unstructured contents of a tweet seemed like a good way to strut our stuff.

Little Did We Know

Our demo has turned into a lot more than just a demo.  In addition to analyzing the twitter stream for things like most popular links, #hash tags, mentions, etc, we thought it might be cool to analyze the sentiment expressed in tweets relative to certain topics.  So we went ahead and incorporated that into DarkStar.  Our first public display of this was calculating the sentiment, as expressed within Twitter, regarding VMware’s acquisition of RabbitMQ.  DarkStar gave the acquisition a ‘thumbs-up’ with a streaming sentiment rating of ~.45 – which is pretty darn good.  We’d been doing a lot of work in Ze Bunkah (our lab), but had yet to go public with any results or announcement.

What’s Going On In There?

While DarkStar is really good at consuming both structured and unstructured data and doing neat stuff with it, it’s not too good at displaying the results of its parallel ruminations in any other way than a streaming data feed.  So to help our customers find out what’s going on inside of DarkStar, we began work on Telescope.  Telescope is our rich internet application, written predominantly in Flex.  Using DarkStar, customer’s can submit queries to our cloud, have DarkStar compute the results, and submit those results back to Telescope for further manipulation and visualization.

Another First for CEP and Cloud Event Processing

Although other firms certainly have adapters for submitting queries and obtaining results from Twitter, this is the first application of complex event processing to sentiment analysis that uses Twitter to deliver results.  At least as far as we know of.  And we’re excited about it.  Almost as excited as the customers we’re dealing with.  I’m sure that once we’re up and running that we’ll have some customer specific results to share.

Until then, thanks for reading!

More Stories By Colin Clark

Colin Clark is the CTO for Cloud Event Processing, Inc. and is widely regarded as a thought leader and pioneer in both Complex Event Processing and its application within Capital Markets.

Follow Colin on Twitter at http:\\twitter.com\EventCloudPro to learn more about cloud based event processing using map/reduce, complex event processing, and event driven pattern matching agents. You can also send topic suggestions or questions to [email protected]

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


CloudEXPO Stories
Cloud-Native thinking and Serverless Computing are now the norm in financial services, manufacturing, telco, healthcare, transportation, energy, media, entertainment, retail and other consumer industries, as well as the public sector. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete at launch. DevOps may be disruptive, but it is essential. DevOpsSUMMIT at CloudEXPO expands the DevOps community, enable a wide sharing of knowledge, and educate delegates and technology providers alike.
IT professionals are also embracing the reality of Serverless architectures, which are critical to developing and operating real-time applications and services. Serverless is particularly important as enterprises of all sizes develop and deploy Internet of Things (IoT) initiatives. Serverless and Kubernetes are great examples of continuous, rapid pace of change in enterprise IT. They also raise a number of critical issues and questions about employee training, development processes, and operational metrics. There's a real need for serious conversations about Serverless and Kubernetes among the people who are doing this work and managing it. So we are very pleased today to announce the ServerlessSUMMIT at CloudEXPO.
AI and machine learning disruption for Enterprises started happening in the areas such as IT operations management (ITOPs) and Cloud management and SaaS apps. In 2019 CIOs will see disruptive solutions for Cloud & Devops, AI/ML driven IT Ops and Cloud Ops. Customers want AI-driven multi-cloud operations for monitoring, detection, prevention of disruptions. Disruptions cause revenue loss, unhappy users, impacts brand reputation etc.
This month @nodexl announced that ServerlessSUMMIT & DevOpsSUMMIT own the world's top three most influential Kubernetes domains which are more influential than LinkedIn, Twitter, YouTube, Medium, Infoworld and Microsoft combined. NodeXL is a template for Microsoft® Excel® (2007, 2010, 2013 and 2016) on Windows (XP, Vista, 7, 8, 10) that lets you enter a network edge list into a workbook, click a button, see a network graph, and get a detailed summary report, all in the familiar environment of the Excel® spreadsheet application. A collection of network maps and reports created with NodeXL can be seen in the NodeXL Graph Gallery, an archive of data sets uploaded by the NodeXL user community.
"There is a huge interest in Kubernetes. People are now starting to use Kubernetes and implement it," stated Sebastian Scheele, co-founder of Loodse, in this SYS-CON.tv interview at DevOps at 19th Cloud Expo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA.