@CloudExpo Authors: Pat Romanski, Zakia Bouachraoui, Elizabeth White, Liz McMillan, Yeshim Deniz

Blog Feed Post

If You Store My Tweets Today, I’ll Gladly Look at Them Next Tuesday

Cloud Event Processing – Where’s The Data?

There are several things left to cover in our #TwitYourl proejct.  One of the most glaring absences so far is storage – where do we put all of these Tweets?  What happens if we’d like to make changes to our RuleBots and test them with historical data?  Right now, we can’t.

In keeping with some of the rules of our implementation, an OnRamp is not allowed to update a database directly.  This would tie the OnRamp to the database implementation and make our architecture more brittle than it has to be.  Also, it would mean that the OnRamp had to have specific information about where it was sending a message – this is not allowed.

Remember, we are architecting for the cloud – the idea of baked in, point to point, connections inside of our cloud should have you recoiling in horror by now.  So how can we update databases easily within our Cloud Event Processing framework?

Well, it would be really easy if we had some metadata that described all of the data, or events, that the OnRamps were publishing on the bus.  And it would be even neater if all of that metadata was available in a central database or directory.  This way, when the infrastructure that #TwitYourl is built on top of is running, all one would need to do is go to some management console, bring up the information about how we’d like to handle a particular event, click the ‘Store in a Database” button and be done with it.  Click, click, click and we’re storing events – automagically; somewhere in the cloud!

So, let’s do this for #TwitYourl – I vote for MongoDB.  I know that Cassandra seems to be a fairly popular choice this past week, but we’re going to buck that trend and hook up MondoDB inside of our cloud and we’re going to feed Mongo some yummy Tweets!

Sorry, I couldn’t resist.

But before feeding Mongo, we’re going to work on some visualization this week.  We’re running a little behind schedule here and we need to get caught up!

Read the original blog entry...

More Stories By Colin Clark

Colin Clark is the CTO for Cloud Event Processing, Inc. and is widely regarded as a thought leader and pioneer in both Complex Event Processing and its application within Capital Markets.

Follow Colin on Twitter at http:\\twitter.com\EventCloudPro to learn more about cloud based event processing using map/reduce, complex event processing, and event driven pattern matching agents. You can also send topic suggestions or questions to [email protected]

CloudEXPO Stories
Despite being the market leader, we recognized the need to transform and reinvent our business at Dynatrace, before someone else disrupted the market. Over the course of three years, we changed everything - our technology, our culture and our brand image. In this session we'll discuss how we navigated through our own innovator's dilemma, and share takeaways from our experience that you can apply to your own organization.
Nutanix has been named "Platinum Sponsor" of CloudEXPO | DevOpsSUMMIT | DXWorldEXPO New York, which will take place November 12-13, 2018 in New York City. Nutanix makes infrastructure invisible, elevating IT to focus on the applications and services that power their business. The Nutanix Enterprise Cloud Platform blends web-scale engineering and consumer-grade design to natively converge server, storage, virtualization and networking into a resilient, software-defined solution with rich machine intelligence.
Intel is an American multinational corporation and technology company headquartered in Santa Clara, California, in the Silicon Valley. It is the world's second largest and second highest valued semiconductor chip maker based on revenue after being overtaken by Samsung, and is the inventor of the x86 series of microprocessors, the processors found in most personal computers (PCs). Intel supplies processors for computer system manufacturers such as Apple, Lenovo, HP, and Dell. Intel also manufactures motherboard chipsets, network interface controllers and integrated circuits, flash memory, graphics chips, embedded processors and other devices related to communications and computing.
Digital transformation is about embracing digital technologies into a company's culture to better connect with its customers, automate processes, create better tools, enter new markets, etc. Such a transformation requires continuous orchestration across teams and an environment based on open collaboration and daily experiments. In his session at 21st Cloud Expo, Alex Casalboni, Technical (Cloud) Evangelist at Cloud Academy, explored and discussed the most urgent unsolved challenges to achieve full cloud literacy in the enterprise world.
Wasabi is the hot cloud storage company delivering low-cost, fast, and reliable cloud storage. Wasabi is 80% cheaper and 6x faster than Amazon S3, with 100% data immutability protection and no data egress fees. Created by Carbonite co-founders and cloud storage pioneers David Friend and Jeff Flowers, Wasabi is on a mission to commoditize the storage industry. Wasabi is a privately held company based in Boston, MA. Follow and connect with Wasabi on Twitter, Facebook, Instagram and the Wasabi blog.