Welcome!

@CloudExpo Authors: John Worthington, Liz McMillan, Stackify Blog, Elizabeth White, Pat Romanski

Related Topics: @CloudExpo, Microservices Expo, Agile Computing, Release Management

@CloudExpo: Article

Avoiding Unexpected Cloud Economics Pitfalls

There's more to the utility computing benefit of the Cloud than turning a faucet

Anybody who is considering a move to the Cloud knows that the greatest economic motivation for Cloud Computing is the pay-as-you-go, pay-for-what-you-need utility computing benefit, right? Deal with spikes in demand much more cost-effectively, the public Cloud service providers gush, since we can spread the load over many customers and pass the savings from our economies of scale on to you. The utility benefit is also a central premise of Private Clouds. Build a Private Cloud for your enterprise, the vendors promise, and you can achieve the same economies of scale as Public Clouds without all that risk.

Unfortunately, what sounds too good to be true usually is. There are a number of gotchas on both the Public and Private Cloud provider sides that limit—or even prevent—organizations from obtaining a full measure of the utility benefit. Let’s go back to economics class and take a closer look.

Clouds Like Water?
Turn on the faucet, only instead of water, you get Cloud. Sounds good, but we use water very differently than we do IT resources. With water, we generally use all we need without worrying about price. We may try to economize, and perhaps we’ll go through the trouble of digging a well if we need to fill our pool, but generally we don’t think about the cost of each flush or load of laundry.

The Cloud is just the opposite. The techies might not be thinking in terms of cost, but the bean counters definitely are. For a CIO or purchasing manager comfortable with entering resource costs into annual budget spreadsheets, the unknown nature of the Cloud bill strikes fear into their hearts—and their wallets. Instead of focusing on lowered costs, their worry is increased costs, since Cloud usage is inherently unpredictable. After all, that’s why landlords don’t like including heating costs in the rent. If the tenants aren’t responsible for keeping costs down then pay-as-you-go inevitably translates into pay more—and just how much more is a mystery until the bill arrives.

Enterprise Cloud customers in particular are beginning to push back, and as a result, Public Cloud providers must change their pricing model accordingly. Unfortunately, there aren’t many alternatives to simple pay-as-you go. One increasingly popular alternative that might ease Cloud purchasers’ minds is for providers to offer a tiered pricing system, with a fixed price for any consumption up to a pre-defined threshold, and pay-as-you-go above that. However, tiered pricing is not a panacea. While such a pricing model is straightforward and gives organizations an increased measure of predictability, it still doesn’t solve the problem of cost spikes.

If tiered pricing sounds more like paying for your mobile phone service than for utilities like water or electricity, you’re right. Not only does this approach reduce perceived risks for Cloud purchasers, it’s also a familiar model for the telcos, all of whom are looking to enter the Cloud market, or at the least, grow their existing Cloud offerings. As a result, ZapThink expects tiered pricing to become the norm for Public Cloud services over time, in spite of its drawbacks.

The irony with tiered Cloud pricing is that the more you require elasticity, the greater the risk that you’ll use up your allotted consumption for the month—but elasticity is the most important benefit of the Cloud. Sure, if you have steady, predictable consumption then tiered pricing is low risk, but if all you want is steady, predictable availability, then chances are keeping your resources on-premise or in a traditional hosted facility will be more cost-effective than moving to the Cloud in the first place, since you’re not particularly worried about spikes in demand.

To make matters worse, not everyone likes tiered pricing, of course. Anyone who’s used up their minutes or texts for the month only to be surprised by an excessive phone bill knows what I’m talking about. It seems the mobile phone providers love to play games with their pricing plans for the sole purpose of squeezing every penny out of their hapless customers. I’m sure we don’t want our Cloud providers to play the same dirty tricks.

The Subtleties of Cloud Churn
While it’s a common water cooler pastime to demonize mobile phone companies for their underhanded pricing policies, there is a downside for the providers as well: the dreaded customer churn. Since it’s relatively easy for customers to change phone providers, especially now that number portability is a reality, shifty behavior on the part of providers simply chases away customers.

Cloud churn is a very real problem for Public Cloud providers as well, as the ease of deprovisioning Cloud resources naturally eases the deprovisioning of customers. But there is an extra complication with Cloud churn that doesn’t have a parallel in the mobile phone world: Cloud resources that are no longer being used but still remain allocated to customers. Depending on the provider’s pricing model, the cost to the customer to maintain such resources may be minimal, but it’s not always clear whether those minimal amounts sufficiently cover the providers’ costs.

For example, I get monthly charges on my credit card from Amazon Web Services (AWS) for a few cents each month. I can’t remember how I signed up for AWS, but the amounts are so minimal, it’s not worth my time or trouble to cancel the service. Do those few cents per month cover Amazon’s costs, assuming there are potentially millions of such customers? Perhaps in Amazon’s case—but for less experienced providers with wafer thin margins, the economics might work to their disadvantage.

Furthermore, the proliferation of such idle instances may be a more significant issue for Private Cloud providers, since they typically have constrained budgets for data center buildouts. Amazon may be building new data centers as fast as they can, but your Private Cloud likely has a maximum practical size given your budget for the effort. The last thing you want is to fill it up with idle resources that various people in your organization can’t be bothered to fully deprovision.

The Demotivation Paradox
For the Public Cloud provider, the obvious solution to the problem of idle resources left over from Cloud churn is to charge enough for those resources. Either the cost will motivate people to fully deprovision them, so the argument goes, or at the very least, they generate enough money so that keeping them around is worthwhile for the providers.

But what if we’re talking about Private Clouds here? The way to charge internal customers for using Cloud resources is via chargebacks. And everybody hates chargebacks. Not only are they a bookkeeping hassle, but they also demotivate the consumption of shared resources. We went through this problem when we dealt with shared Services and SOA, and now we’re sharing Cloud resources, but the problem remains: the whole point to the Private Cloud is to achieve economies of scale across the enterprise, but the only way to make such economies work is if most or all divisions participate. Chargebacks, however, discourage that participation.

As it was with shared Services, the way to compensate for chargebacks is through effective governance: establish and enforce Cloud consumption policies that counteract the demotivational effects of chargebacks, and come up with a way to motivate people to follow such policies. While you’re at it, formulate policies governing the deprovisioning of instances that no one needs any more. But in the Cloud, such governance is especially challenging because of the diversity of resources and their corresponding consumption scenarios: policies for provisioning virtual machines as part of IaaS is quite different from, say, provisioning development tools on PaaS. It will take organizations with Private Clouds a good bit of trial and error to get the balance right.

The ZapThink Take
Another downside to the idle-resource-masquerading-as-paying-customer problem is that it makes it very difficult for financial analysts to gauge the health of a Public Cloud provider. This obfuscation can skew traditional metrics like number of customers or revenue per customer, and the distortion may be different from one provider to another. Combine the resulting confusion with the lean profit margins in today’s Cloud space, as providers push their prices ever lower to encourage growth, and you have a recipe for disaster. An ostensibly healthy Cloud provider might suddenly collapse due to a foundation of underperforming customers and idle resources.

Private Clouds face a corresponding problem, as executives review the financials for the Cloud effort. ZapThink predicts a backlash against Private Clouds in the next year or two, as vendors underdeliver on their Cloud promises—not necessarily through any fault of their technology, but rather because the reality of achieving cost advantages with Private Clouds is far more difficult than the vendors’ and analysts’ spreadsheets might have you believe.

If you’d like to learn more about the subtleties of Cloud economics, I’d be happy to have a deeper discussion at Cloud Expo in New York or The Business of Cloud Computing in Dallas, or any of the other conferences I’ll be presenting at. Please drop me a line if you’re interested. I’m curious as to whether issues of Cloud churn or Private Cloud demotivation are concerns in your organization.

Image source: Vegan Feast Catering

More Stories By Jason Bloomberg

Jason Bloomberg is the leading expert on architecting agility for the enterprise. As president of Intellyx, Mr. Bloomberg brings his years of thought leadership in the areas of Cloud Computing, Enterprise Architecture, and Service-Oriented Architecture to a global clientele of business executives, architects, software vendors, and Cloud service providers looking to achieve technology-enabled business agility across their organizations and for their customers. His latest book, The Agile Architecture Revolution (John Wiley & Sons, 2013), sets the stage for Mr. Bloomberg’s groundbreaking Agile Architecture vision.

Mr. Bloomberg is perhaps best known for his twelve years at ZapThink, where he created and delivered the Licensed ZapThink Architect (LZA) SOA course and associated credential, certifying over 1,700 professionals worldwide. He is one of the original Managing Partners of ZapThink LLC, the leading SOA advisory and analysis firm, which was acquired by Dovel Technologies in 2011. He now runs the successor to the LZA program, the Bloomberg Agile Architecture Course, around the world.

Mr. Bloomberg is a frequent conference speaker and prolific writer. He has published over 500 articles, spoken at over 300 conferences, Webinars, and other events, and has been quoted in the press over 1,400 times as the leading expert on agile approaches to architecture in the enterprise.

Mr. Bloomberg’s previous book, Service Orient or Be Doomed! How Service Orientation Will Change Your Business (John Wiley & Sons, 2006, coauthored with Ron Schmelzer), is recognized as the leading business book on Service Orientation. He also co-authored the books XML and Web Services Unleashed (SAMS Publishing, 2002), and Web Page Scripting Techniques (Hayden Books, 1996).

Prior to ZapThink, Mr. Bloomberg built a diverse background in eBusiness technology management and industry analysis, including serving as a senior analyst in IDC’s eBusiness Advisory group, as well as holding eBusiness management positions at USWeb/CKS (later marchFIRST) and WaveBend Solutions (now Hitachi Consulting).

@CloudExpo Stories
"Cloud Academy is an enterprise training platform for the cloud, specifically public clouds. We offer guided learning experiences on AWS, Azure, Google Cloud and all the surrounding methodologies and technologies that you need to know and your teams need to know in order to leverage the full benefits of the cloud," explained Alex Brower, VP of Marketing at Cloud Academy, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clar...
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
While some developers care passionately about how data centers and clouds are architected, for most, it is only the end result that matters. To the majority of companies, technology exists to solve a business problem, and only delivers value when it is solving that problem. 2017 brings the mainstream adoption of containers for production workloads. In his session at 21st Cloud Expo, Ben McCormack, VP of Operations at Evernote, discussed how data centers of the future will be managed, how the p...
"NetApp is known as a data management leader but we do a lot more than just data management on-prem with the data centers of our customers. We're also big in the hybrid cloud," explained Wes Talbert, Principal Architect at NetApp, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"We're focused on how to get some of the attributes that you would expect from an Amazon, Azure, Google, and doing that on-prem. We believe today that you can actually get those types of things done with certain architectures available in the market today," explained Steve Conner, VP of Sales at Cloudistics, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
It is of utmost importance for the future success of WebRTC to ensure that interoperability is operational between web browsers and any WebRTC-compliant client. To be guaranteed as operational and effective, interoperability must be tested extensively by establishing WebRTC data and media connections between different web browsers running on different devices and operating systems. In his session at WebRTC Summit at @ThingsExpo, Dr. Alex Gouaillard, CEO and Founder of CoSMo Software, presented ...
Enterprises are adopting Kubernetes to accelerate the development and the delivery of cloud-native applications. However, sharing a Kubernetes cluster between members of the same team can be challenging. And, sharing clusters across multiple teams is even harder. Kubernetes offers several constructs to help implement segmentation and isolation. However, these primitives can be complex to understand and apply. As a result, it’s becoming common for enterprises to end up with several clusters. Thi...
"There's plenty of bandwidth out there but it's never in the right place. So what Cedexis does is uses data to work out the best pathways to get data from the origin to the person who wants to get it," explained Simon Jones, Evangelist and Head of Marketing at Cedexis, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, introduced two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a multip...
"We work around really protecting the confidentiality of information, and by doing so we've developed implementations of encryption through a patented process that is known as superencipherment," explained Richard Blech, CEO of Secure Channels Inc., in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
High-velocity engineering teams are applying not only continuous delivery processes, but also lessons in experimentation from established leaders like Amazon, Netflix, and Facebook. These companies have made experimentation a foundation for their release processes, allowing them to try out major feature releases and redesigns within smaller groups before making them broadly available. In his session at 21st Cloud Expo, Brian Lucas, Senior Staff Engineer at Optimizely, discussed how by using ne...
The question before companies today is not whether to become intelligent, it’s a question of how and how fast. The key is to adopt and deploy an intelligent application strategy while simultaneously preparing to scale that intelligence. In her session at 21st Cloud Expo, Sangeeta Chakraborty, Chief Customer Officer at Ayasdi, provided a tactical framework to become a truly intelligent enterprise, including how to identify the right applications for AI, how to build a Center of Excellence to oper...
"IBM is really all in on blockchain. We take a look at sort of the history of blockchain ledger technologies. It started out with bitcoin, Ethereum, and IBM evaluated these particular blockchain technologies and found they were anonymous and permissionless and that many companies were looking for permissioned blockchain," stated René Bostic, Technical VP of the IBM Cloud Unit in North America, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventi...
In his session at 21st Cloud Expo, James Henry, Co-CEO/CTO of Calgary Scientific Inc., introduced you to the challenges, solutions and benefits of training AI systems to solve visual problems with an emphasis on improving AIs with continuous training in the field. He explored applications in several industries and discussed technologies that allow the deployment of advanced visualization solutions to the cloud.
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
"We're developing a software that is based on the cloud environment and we are providing those services to corporations and the general public," explained Seungmin Kim, CEO/CTO of SM Systems Inc., in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Enterprises are moving to the cloud faster than most of us in security expected. CIOs are going from 0 to 100 in cloud adoption and leaving security teams in the dust. Once cloud is part of an enterprise stack, it’s unclear who has responsibility for the protection of applications, services, and data. When cloud breaches occur, whether active compromise or a publicly accessible database, the blame must fall on both service providers and users. In his session at 21st Cloud Expo, Ben Johnson, C...
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...