@CloudExpo Authors: Pat Romanski, Yeshim Deniz, Liz McMillan, Elizabeth White, Charles Araujo

Related Topics: @CloudExpo

@CloudExpo: Blog Feed Post

Could Cloud Exchanges Work For Storage?

Interoperability, security, and inertia threaten to derail this new concept before it starts

CNET's Gordon Haff wrote a great piece on the shortcomings of the exchange model for cloud computing. His prognosis is right there in his title: "Why cloud exchanges won't work."

I've done some thinking and writing on the topic, and it's easy to see Haff's point: Interoperability, security, and inertia threaten to derail this new concept before it starts.

Shortcomings of the Exchange Model

Haff's concept is centered on the following three simple qualifiers for cloud exchanges:

  1. Any platform involved in an exchange must be compatible, allowing a workload to seamlessly move between interoperable systems. This is both critical and absent with many of the cloud computing services available today. Most are incompatible on a basic level, using different hypervisors for example. No cloud exchange can seamlessly move an EC2 Xen instance to a Terremark VMware environment, although Rightscale is working on clever translation systems.
  2. Not all service providers are equal when it comes to security and compliance, either. I've often bemoaned the fact that so many service providers are not enterprise-ready, and this will be even more of an issue with an intermediary deciding where to run a particular job. How can a buyer be sure his workload will be safe?
  3. Haff also points out that a compelling service must be cost-effective, and certain elements stand in the way of this. He questions the value economies of scale will bring to very-large service providers. He also wisely points out that additional costs to move supporting stored data could derail the return on investment

These are not intractable problems, but they are real concerns. The issue of portability is especially thorny for cloud computing, as vendors focus more on basic functionality and innovative features than compatibility. Yet one can envision a future in which even these issues are resolved: Haff worries about service providers moving "up the stack", but this is exactly where compatibility is likely to emerge. It is easier for me to imagine a number of interoperable Java or .NET platforms than truly compatible Xen environments!

It also seems that the current efforts to define cloud service description and provisioning APIs addresses many of these concerns. If a standard API could specify compatibility, the network environment, and security requirements, an exchange could offer a wide variety of service providers with these capabilities. I imagine an airline model, where not every airport is served by every airline, but there is enough competition even at the fringes to keep the resellers viable.

I am also much less concerned about return on investment than Haff. I have seen amazing economies of scale achieved at Nirvanix (where I am Director of Consulting) and can imagine these in many areas. Cloud service providers are driving cost out of many areas by standardizing and centralizing management operation and provisioning as well as hardware and environmental costs. As cloud providers set up shop in super-efficient data centers and train highly focused management staff, they are likely to surpass the economies of even the largest abd best-run end user environment.

What About Storage?

As I wrote in December, spot pricing for cloud storage is much less attractive due to the sheer inertia of data. But an exchange model might actually be attractive even after this is taken into account. The major public cloud storage providers have already moved up from the infrastructure (bytes and blocks) to the platform (object) level, though the "ammo provider" private cloud market remains focused on the former. And many efforts are already underway to create basic standard interfaces for both provisioning and access across these major vendors.

Let's take Haff's concerns in order:

  1. Interoperability of cloud storage is likely to come well before compute thanks to the more constrained workload involved. While a compute platform could be asked to perform almost any task, storage in general is focused on a simple usage model sometimes called CRUD: Data is created, read, updated, and deleted. This has already led to a proliferation of pre-standard or de-facto standard generic interfaces to multiple cloud storage services. SNIA's rapid work on a standard cloud data management interface shows that interoperable public cloud storage isn't that far off.
  2. Security and compliance is much less standardized among private and public cloud storage providers. I believe that all enterprise-focused public cloud storage providers should focus their efforts on offering solid, reliable, and secure systems, but this has clearly not been the case universally. And although efforts like the SNIA CDMI would standardize provisioning of services, we will need a much more robust vocabulary to specify the level of security and compliance required for a specific application. But not every application is right for cloud storage anyway. Surely a minimum standard for security can be agreed upon by multiple providers, allowing at least some bulky applications to use cloud storage without worry. We will eventually develop a more complete mechanism which will allow more sensitive applications to use a cloud exchange.
  3. Cost effectiveness is another thorny issue. Public cloud storage for the enterprise isn't a race to the bottom in terms of cost; it has to be about more than just cheap capacity. Indeed, the public cloud storage market is already splitting into three categories: Cheap personal storage and backup, inexpensive storage for developers and web applications, and feature-rich enterprise-grade offerings for businesses. But cost will always be a factor, and cloud storage must prove its value. An exchange that resulted in higher prices or surprise fees to move data wouldn't be a success. This last is worth noting: Since moving storage between providers will always require time and costly bandwidth, I expect such an exchange to focus on net-new data, not migration of existing capacity to a cheaper provider.

Cloud storage is significantly different from cloud compute, and spot pricing and exchanges might make more sense for data. Indeed, many of the concerns voiced by CNET's Haff are less troubling in the storage world. But the issue of return on investment remains: Could a business cost-effectively use varying cloud storage providers? I suspect some will soon set up shop and try to find out!

Read the original blog entry...

More Stories By Stephen Foskett

Stephen Foskett has provided vendor-independent end user consulting on storage topics for over 10 years. He has been a storage columnist and has authored numerous articles for industry publications. Stephen is a popular presenter at industry events and recently received Microsoft’s MVP award for contributions to the enterprise storage community. As the director of consulting for Nirvanix, Foskett provides strategic consulting to assist Fortune 500 companies in developing strategies for service-based tiered and cloud storage. He holds a bachelor of science in Society/Technology Studies, from Worcester Polytechnic Institute.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

@CloudExpo Stories
@DevOpsSummit at Cloud Expo, taking place November 12-13 in New York City, NY, is co-located with 22nd international CloudEXPO | first international DXWorldEXPO and will feature technical sessions from a rock star conference faculty and the leading industry players in the world.
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, @CloudEXPO and DXWorldEXPO are two of the most important technology events of the year. Since its launch over eight years ago, @CloudEXPO and DXWorldEXPO have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors!
22nd International Cloud Expo, taking place June 5-7, 2018, at the Javits Center in New York City, NY, and co-located with the 1st DXWorld Expo will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud ...
HyperConvergence came to market with the objective of being simple, flexible and to help drive down operating expenses. It reduced the footprint by bundling the compute/storage/network into one box. This brought a new set of challenges as the HyperConverged vendors are very focused on their own proprietary building blocks. If you want to scale in a certain way, let's say you identified a need for more storage and want to add a device that is not sold by the HyperConverged vendor, forget about it...
In his keynote at 19th Cloud Expo, Sheng Liang, co-founder and CEO of Rancher Labs, discussed the technological advances and new business opportunities created by the rapid adoption of containers. With the success of Amazon Web Services (AWS) and various open source technologies used to build private clouds, cloud computing has become an essential component of IT strategy. However, users continue to face challenges in implementing clouds, as older technologies evolve and newer ones like Docker c...
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
The next XaaS is CICDaaS. Why? Because CICD saves developers a huge amount of time. CD is an especially great option for projects that require multiple and frequent contributions to be integrated. But… securing CICD best practices is an emerging, essential, yet little understood practice for DevOps teams and their Cloud Service Providers. The only way to get CICD to work in a highly secure environment takes collaboration, patience and persistence. Building CICD in the cloud requires rigorous ar...
"We're focused on how to get some of the attributes that you would expect from an Amazon, Azure, Google, and doing that on-prem. We believe today that you can actually get those types of things done with certain architectures available in the market today," explained Steve Conner, VP of Sales at Cloudistics, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Sanjeev Sharma Joins November 11-13, 2018 @DevOpsSummit at @CloudEXPO New York Faculty. Sanjeev Sharma is an internationally known DevOps and Cloud Transformation thought leader, technology executive, and author. Sanjeev's industry experience includes tenures as CTO, Technical Sales leader, and Cloud Architect leader. As an IBM Distinguished Engineer, Sanjeev is recognized at the highest levels of IBM's core of technical leaders.
As Cybric's Chief Technology Officer, Mike D. Kail is responsible for the strategic vision and technical direction of the platform. Prior to founding Cybric, Mike was Yahoo's CIO and SVP of Infrastructure, where he led the IT and Data Center functions for the company. He has more than 24 years of IT Operations experience with a focus on highly-scalable architectures.
JETRO showcased Japan Digital Transformation Pavilion at SYS-CON's 21st International Cloud Expo® at the Santa Clara Convention Center in Santa Clara, CA. The Japan External Trade Organization (JETRO) is a non-profit organization that provides business support services to companies expanding to Japan. With the support of JETRO's dedicated staff, clients can incorporate their business; receive visa, immigration, and HR support; find dedicated office space; identify local government subsidies; get...
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.
Bill Schmarzo, author of "Big Data: Understanding How Data Powers Big Business" and "Big Data MBA: Driving Business Strategies with Data Science," is responsible for setting the strategy and defining the Big Data service offerings and capabilities for EMC Global Services Big Data Practice. As the CTO for the Big Data Practice, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He's written several white papers, is an avid blogge...
DXWorldEXPO LLC announced today that Dez Blanchfield joined the faculty of CloudEXPO's "10-Year Anniversary Event" which will take place on November 11-13, 2018 in New York City. Dez is a strategic leader in business and digital transformation with 25 years of experience in the IT and telecommunications industries developing strategies and implementing business initiatives. He has a breadth of expertise spanning technologies such as cloud computing, big data and analytics, cognitive computing, m...
Bill Schmarzo, author of "Big Data: Understanding How Data Powers Big Business" and "Big Data MBA: Driving Business Strategies with Data Science," is responsible for setting the strategy and defining the Big Data service offerings and capabilities for EMC Global Services Big Data Practice. As the CTO for the Big Data Practice, he is responsible for working with organizations to help them identify where and how to start their big data journeys. He's written several white papers, is an avid blogge...
In past @ThingsExpo presentations, Joseph di Paolantonio has explored how various Internet of Things (IoT) and data management and analytics (DMA) solution spaces will come together as sensor analytics ecosystems. This year, in his session at @ThingsExpo, Joseph di Paolantonio from DataArchon, added the numerous Transportation areas, from autonomous vehicles to “Uber for containers.” While IoT data in any one area of Transportation will have a huge impact in that area, combining sensor analytic...
Charles Araujo is an industry analyst, internationally recognized authority on the Digital Enterprise and author of The Quantum Age of IT: Why Everything You Know About IT is About to Change. As Principal Analyst with Intellyx, he writes, speaks and advises organizations on how to navigate through this time of disruption. He is also the founder of The Institute for Digital Transformation and a sought after keynote speaker. He has been a regular contributor to both InformationWeek and CIO Insight...
Michael Maximilien, better known as max or Dr. Max, is a computer scientist with IBM. At IBM Research Triangle Park, he was a principal engineer for the worldwide industry point-of-sale standard: JavaPOS. At IBM Research, some highlights include pioneering research on semantic Web services, mashups, and cloud computing, and platform-as-a-service. He joined the IBM Cloud Labs in 2014 and works closely with Pivotal Inc., to help make the Cloud Found the best PaaS.
It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
In a world where the internet rules all, where 94% of business buyers conduct online research, and where e-commerce sales are poised to fall between $427 billion and $443 billion by the end of this year, we think it's safe to say that your website is a vital part of your business strategy. Whether you're a B2B company, a local business, or an e-commerce site, digital presence is key to maintain in your drive towards success. Digital Performance will take priority in 2018 for the following reason...