Welcome!

@CloudExpo Authors: Elizabeth White, Zakia Bouachraoui, Liz McMillan, Pat Romanski, Roger Strukhoff

Related Topics: @CloudExpo

@CloudExpo: Blog Post

What's Really Industry Changing About Cloud Computing?

Four exciting new directions in massively parallel cloud computing

Bill McColl's "Cloud N" Blog

This is an incredibly important time for the cloud computing area. But let’s try and move the discussion of it in the press along from an obsession with new datacenter buildings located by power stations, with the total server numbers at Microsoft and Google, and with Amazon’s hourly pricing for EC2. Interesting though those aspects of cloud computing appear to be to journalists, they hardly represent what is really industry changing about cloud computing
.

What are some of the new directions in the massively parallel cloud computing space? I’ll mention four that I’m particularly interested in, that are exciting and challenging, and that I think will have a huge impact on the industry. If you have others in mind, then feel free to add your ideas.

Here are my four areas for what they’re worth:

  • Cloudbursting. Seamlessly and automatically migrating (parts of) a massively parallel computation back and forth between private and public clouds in real-time driven by changing resource demands, performance demands, hardware availability, and economics. Lots of existing vendors, such as Microsoft, will want/need great solutions to this challenge. I expect it will emerge and become widespread pretty quickly.
  • Libraries and App Stores. Developing apps from scratch in MapReduce is great, but we also need to begin to see application libraries and app stores that provide modules that are massively parallel and ready to run on both private and public clouds (and on both at the same time via cloudbursting). Libraries for major enterprise apps, for machine learning and recommendation, for scientific computing, and for semantic web and Datalog apps would be particularly interesting. Projects like Mahout are a small first step in this direction. As more and more leading universities start to teach MapReduce to their students, and pursue MapReduce-based research projects, we will hopefully see a lot more in this area.
  • Live Data. Massively parallel real-time programming on live data streams (complementing what MapReduce provides for historical/stored data). In addition to the exabytes of private live streams within businesses, web companies, telcos, scientific research centers, and government departments, there are also now torrential flows of live streaming data available from commercial companies such as Thomson Reuters, Bloomberg, Nasdaq, Xignite, StrikeIron, Spinn3r and many others. This is the area we are aiming to disrupt at Cloudscale.
  • Domain Specific Development Tools. Eclipse, Visual Studio or even Emacs is probably OK as a development environment for a computer science Ph.D. at a major bank developing a Hadoop application to support algorthmic trading. However, for each one of those CS PhDs working in financial services, there are probably thousands of portfolio managers around the world who could benefit enormously and immediately from the power of massively parallel cloud computing, but today use only basic tools such as spreadsheets. As the demand for the consumerization of software accelerates, there is a tremendous opportunity now for innovation that can deliver the power of massively parallel processing behind very high level user interfaces that are extremely easy-to-use, targeted at specific domains, and where the parallelism is implicit. The gold standard for power and ease-of-use is of course Google’s “one-search-box-on-a-white-page”. Ten years of incredible innovation behind the scenes to deliver improved scale and power, but no change to the ultra-simple user interface. We won’t be able to achieve that kind of ultrasimplicity in very many other areas, but it’s a great target to aim for. Massively parallel processing is great, but hey let’s also try to build some high level interfaces that begin to unleash its power to the mass market. That’s a real innovation challenge, and a real opportunity. I expect it will be at least as hard as (probably much harder than) building the back-end engine. As I noted in a previous blog, “simplicity and ease-of-use combined with scalability and power is the future” in referring to Bernard Lunn’s remark on what we need from software “Usable without a manual within 30 minutes, still valuable for a sophisticated power user 2 years later. That is the mark of greatness. It is a real art. The great ones make it look simple - it is not simple!”

More Stories By Bill McColl

Bill McColl left Oxford University to found Cloudscale. At Oxford he was Professor of Computer Science, Head of the Parallel Computing Research Center, and Chairman of the Computer Science Faculty. Along with Les Valiant of Harvard, he developed the BSP approach to parallel programming. He has led research, product, and business teams, in a number of areas: massively parallel algorithms and architectures, parallel programming languages and tools, datacenter virtualization, realtime stream processing, big data analytics, and cloud computing. He lives in Palo Alto, CA.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


CloudEXPO Stories
The platform combines the strengths of Singtel's extensive, intelligent network capabilities with Microsoft's cloud expertise to create a unique solution that sets new standards for IoT applications," said Mr Diomedes Kastanis, Head of IoT at Singtel. "Our solution provides speed, transparency and flexibility, paving the way for a more pervasive use of IoT to accelerate enterprises' digitalisation efforts. AI-powered intelligent connectivity over Microsoft Azure will be the fastest connected path for IoT innovators to scale globally, and the smartest path to cross-device synergy in an instrumented, connected world.
There are many examples of disruption in consumer space – Uber disrupting the cab industry, Airbnb disrupting the hospitality industry and so on; but have you wondered who is disrupting support and operations? AISERA helps make businesses and customers successful by offering consumer-like user experience for support and operations. We have built the world’s first AI-driven IT / HR / Cloud / Customer Support and Operations solution.
ScaleMP is presenting at CloudEXPO 2019, held June 24-26 in Santa Clara, and we’d love to see you there. At the conference, we’ll demonstrate how ScaleMP is solving one of the most vexing challenges for cloud — memory cost and limit of scale — and how our innovative vSMP MemoryONE solution provides affordable larger server memory for the private and public cloud. Please visit us at Booth No. 519 to connect with our experts and learn more about vSMP MemoryONE and how it is already serving some of the world’s largest data centers. Click here to schedule a meeting with our experts and executives.
Darktrace is the world's leading AI company for cyber security. Created by mathematicians from the University of Cambridge, Darktrace's Enterprise Immune System is the first non-consumer application of machine learning to work at scale, across all network types, from physical, virtualized, and cloud, through to IoT and industrial control systems. Installed as a self-configuring cyber defense platform, Darktrace continuously learns what is ‘normal' for all devices and users, updating its understanding as the environment changes.
Codete accelerates their clients growth through technological expertise and experience. Codite team works with organizations to meet the challenges that digitalization presents. Their clients include digital start-ups as well as established enterprises in the IT industry. To stay competitive in a highly innovative IT industry, strong R&D departments and bold spin-off initiatives is a must. Codete Data Science and Software Architects teams help corporate clients to stay up to date with the modern business digitalization solutions. Achieve up to 50% early-stage technological process development cost cutdown with science and R&D-driven investment strategy with Codete's support.