@CloudExpo Authors: Liz McMillan, APM Blog, Elizabeth White, Xenia von Wedel, Mauro Carniel

Related Topics: @CloudExpo, Microservices Expo

@CloudExpo: Blog Feed Post

Private Cloud: Elastic or a Hair Ball of Rubber?

Private cloud elasticity

Is your private cloud elastic, or just a tightly wrapped ball of rubber. One of the essential characteristics defined by NIST for cloud computing is “Rapid Elasticity.”  I blogged about Workload Elasticity Profiles in a previous post , but in the war between private and public cloud, people question whether you can actually unleash the elasticity from that ball of rubber bands.

“Can a private cloud can be elastic?”

To answer the question first need to understand elasticity in the cloud. A simple definition is the ability to “scale-up”  & “scale down” capacity automatically based on demand, and only pay for what is provisioned.

The issue is not the technology you implement. The technology that powers the public cloud is the same technology available to power the private cloud at every level in the stack.  You can create a private cloud using all the same building blocks. The biggest issues is; Can you take advantage of this ?

Let’s think about the problem from two perspectives:

  • Tactical - where time frame is measured in minutes and hours
  • Strategic - time is measured in years and multiples of years

Tactical Elasticity
This is the most common problem space when people design private clouds. Creating a platform that auto-scales can be a technical challenge but if you are thinking about it this way, your going about it the wrong way. The first problem you should be solving is:

“Can your application scale?”

If you throw more infrastructure underneath it, will it respond with the ability to support more workload with the same level of performance? Will it do this automagically, or will it require modification (reconfig, recoding) at the application level to allow this to happen? At the utopian end of the scale you have a nice, horizontally scalable application that is designed based on infrastructure building blocks, providing “infinite scalability” (cough). It doesn’t have to be utopian though.

Mainframes & Grids

Elastic scaling based on older school technologies from mainframe (PR/SM, LPAR) and mid-range vendors (Domains, vPAR, nPAR, Containers) have done ostensibly the same thing with little modification to the application by dynamically configuring the resources from one domain to another. There are limitations to this method because it usually only works within a smaller pool of resources contained in a single or smaller number of racks/frames.

Grids are another architectural solution to this problem. They are essentially designed to provide the horizontal scalability at a operating system level in comparison to a classic cloud which requires that capability at the application layer.

Horizontal, in-box vertical and GRID all have limitations. The sensitivity to these limitations depends on the type of processing or I/O requirements, but they will always be evident at massive scale.

The next challenge is: “Do you have multiple complementary workloads?”

Many people have it wrong when they talk about the clouds dependency on multi-tenancy. Multi-tenancy (MT) is a proxy concept for complementary workloads. If you have multiple tenants with similar workloads then you have correlated peaks which result in low efficiency for capacity. You need complementary workloads for public or private clouds for tactical elasticity to work.

A complementary workload is where peaks in one workload correspond to troughs in other workloads. At a minimum, alternating peaks are critical to resource effiiciency. The more uncorrelated the workloads, the more benefit from elasticity.

Strategic Elasticity

Where the variable of time expands to between one and five years, then matching supply and demand is based on several different factors. The first is;

“What’s you gross average workload profile?”

The profile of your business volume is a key indicator for benefits from elasticity.  It’s obvious that aggressively growing companies will get most benefit of elasticity. This is true tactically, but also strategically. The growing workloads allows for the constant consumption of capacity, giving the greatest flexibility. As this growth curve approximates to a flat line, the ability to provide elasticity becomes less and the efficiency of the infrastructure decreases. Therefore, gross workload explains the demand for capacity and its benefit from elasticity. For strategic elasticity, supply is dependent on the question:

“How dynamic is your asset lifecycle?”

As the normal volume of business ebbs and flows, the amount of physical infrastructure required to process the same workload changes. This creates a complex supply/demand curve that has a large dependency on the ways assets are acquired, and more importantly disposed.  If your cycles of business approach a 1-2 year cycle, then your asset lifecycle needs to approximate the same timeframe. The financials of asset lifecycle should no longer be based solely on an asset depreciation schedule. Years of TCO calculation have already told us that sweet spot of asset disposal is based on the convergence of asset residual value, efficiency (power, cpu, space), vendor maintenance, support/management and licensing.

Elasticity Quotient
How much tactical or strategic elasticity is enough for a private cloud to be effective? The Armada Group uses an ‘elasticity quotient’ as part of its Cloud Evaluation Framework, Workload Analysis to determine the ROI of cloud deployment. It calculates the efficiency of matching supply and demand in comparison to a baseline of traditional capacity management. A positive number represents a benefit over traditional methods and negative number shows that the elasticity profile does not work.

To have rapid elasticity (large +ve elastic quotient) in a private cloud you need:

  • Ability to scale in the application
  • Complementary workloads
  • Faster asset lifecycle
  • +ve gross average workload growth

(For the private cloud haters: Public clouds have the same problems, but at larger scale they can be less sensitive to some of the variables. Should another bubble burst, supply and demand could very well be out of sync for them as well, with even more serious consequences).

More Stories By Brad Vaughan

Brad Vaughan is a twenty year veteran consultant working with companies around the globe to transform technology infrastructure to deliver enhanced business services.

@CloudExpo Stories
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, discussed how from store operations and ...
In his session at 21st Cloud Expo, Carl J. Levine, Senior Technical Evangelist for NS1, will objectively discuss how DNS is used to solve Digital Transformation challenges in large SaaS applications, CDNs, AdTech platforms, and other demanding use cases. Carl J. Levine is the Senior Technical Evangelist for NS1. A veteran of the Internet Infrastructure space, he has over a decade of experience with startups, networking protocols and Internet infrastructure, combined with the unique ability to it...
"There's plenty of bandwidth out there but it's never in the right place. So what Cedexis does is uses data to work out the best pathways to get data from the origin to the person who wants to get it," explained Simon Jones, Evangelist and Head of Marketing at Cedexis, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Agile has finally jumped the technology shark, expanding outside the software world. Enterprises are now increasingly adopting Agile practices across their organizations in order to successfully navigate the disruptive waters that threaten to drown them. In our quest for establishing change as a core competency in our organizations, this business-centric notion of Agile is an essential component of Agile Digital Transformation. In the years since the publication of the Agile Manifesto, the conn...
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5–7, 2018, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buye...
Enterprises are moving to the cloud faster than most of us in security expected. CIOs are going from 0 to 100 in cloud adoption and leaving security teams in the dust. Once cloud is part of an enterprise stack, it’s unclear who has responsibility for the protection of applications, services, and data. When cloud breaches occur, whether active compromise or a publicly accessible database, the blame must fall on both service providers and users. In his session at 21st Cloud Expo, Ben Johnson, C...
"We're developing a software that is based on the cloud environment and we are providing those services to corporations and the general public," explained Seungmin Kim, CEO/CTO of SM Systems Inc., in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Enterprises are adopting Kubernetes to accelerate the development and the delivery of cloud-native applications. However, sharing a Kubernetes cluster between members of the same team can be challenging. And, sharing clusters across multiple teams is even harder. Kubernetes offers several constructs to help implement segmentation and isolation. However, these primitives can be complex to understand and apply. As a result, it’s becoming common for enterprises to end up with several clusters. Thi...
"MobiDev is a software development company and we do complex, custom software development for everybody from entrepreneurs to large enterprises," explained Alan Winters, U.S. Head of Business Development at MobiDev, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"Codigm is based on the cloud and we are here to explore marketing opportunities in America. Our mission is to make an ecosystem of the SW environment that anyone can understand, learn, teach, and develop the SW on the cloud," explained Sung Tae Ryu, CEO of Codigm, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
SYS-CON Events announced today that Telecom Reseller has been named “Media Sponsor” of SYS-CON's 22nd International Cloud Expo, which will take place on June 5-7, 2018, at the Javits Center in New York, NY. Telecom Reseller reports on Unified Communications, UCaaS, BPaaS for enterprise and SMBs. They report extensively on both customer premises based solutions such as IP-PBX as well as cloud based and hosted platforms.
Data scientists must access high-performance computing resources across a wide-area network. To achieve cloud-based HPC visualization, researchers must transfer datasets and visualization results efficiently. HPC clusters now compute GPU-accelerated visualization in the cloud cluster. To efficiently display results remotely, a high-performance, low-latency protocol transfers the display from the cluster to a remote desktop. Further, tools to easily mount remote datasets and efficiently transfer...
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, introduced two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a multip...
In his session at 21st Cloud Expo, James Henry, Co-CEO/CTO of Calgary Scientific Inc., introduced you to the challenges, solutions and benefits of training AI systems to solve visual problems with an emphasis on improving AIs with continuous training in the field. He explored applications in several industries and discussed technologies that allow the deployment of advanced visualization solutions to the cloud.
"Infoblox does DNS, DHCP and IP address management for not only enterprise networks but cloud networks as well. Customers are looking for a single platform that can extend not only in their private enterprise environment but private cloud, public cloud, tracking all the IP space and everything that is going on in that environment," explained Steve Salo, Principal Systems Engineer at Infoblox, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Conventio...
"We're focused on how to get some of the attributes that you would expect from an Amazon, Azure, Google, and doing that on-prem. We believe today that you can actually get those types of things done with certain architectures available in the market today," explained Steve Conner, VP of Sales at Cloudistics, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
"NetApp is known as a data management leader but we do a lot more than just data management on-prem with the data centers of our customers. We're also big in the hybrid cloud," explained Wes Talbert, Principal Architect at NetApp, in this SYS-CON.tv interview at 21st Cloud Expo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
"Space Monkey by Vivent Smart Home is a product that is a distributed cloud-based edge storage network. Vivent Smart Home, our parent company, is a smart home provider that places a lot of hard drives across homes in North America," explained JT Olds, Director of Engineering, and Brandon Crowfeather, Product Manager, at Vivint Smart Home, in this SYS-CON.tv interview at @ThingsExpo, held Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA.
The question before companies today is not whether to become intelligent, it’s a question of how and how fast. The key is to adopt and deploy an intelligent application strategy while simultaneously preparing to scale that intelligence. In her session at 21st Cloud Expo, Sangeeta Chakraborty, Chief Customer Officer at Ayasdi, provided a tactical framework to become a truly intelligent enterprise, including how to identify the right applications for AI, how to build a Center of Excellence to oper...