Welcome!

@CloudExpo Authors: Harry Trott, Elizabeth White, Liz McMillan, Stackify Blog, Pat Romanski

Related Topics: @CloudExpo, Microservices Expo

@CloudExpo: Blog Feed Post

Private Cloud: Elastic or a Hair Ball of Rubber?

Private cloud elasticity

Is your private cloud elastic, or just a tightly wrapped ball of rubber. One of the essential characteristics defined by NIST for cloud computing is “Rapid Elasticity.”  I blogged about Workload Elasticity Profiles in a previous post , but in the war between private and public cloud, people question whether you can actually unleash the elasticity from that ball of rubber bands.

“Can a private cloud can be elastic?”

To answer the question first need to understand elasticity in the cloud. A simple definition is the ability to “scale-up”  & “scale down” capacity automatically based on demand, and only pay for what is provisioned.

The issue is not the technology you implement. The technology that powers the public cloud is the same technology available to power the private cloud at every level in the stack.  You can create a private cloud using all the same building blocks. The biggest issues is; Can you take advantage of this ?

Let’s think about the problem from two perspectives:

  • Tactical - where time frame is measured in minutes and hours
  • Strategic - time is measured in years and multiples of years

Tactical Elasticity
This is the most common problem space when people design private clouds. Creating a platform that auto-scales can be a technical challenge but if you are thinking about it this way, your going about it the wrong way. The first problem you should be solving is:

“Can your application scale?”

If you throw more infrastructure underneath it, will it respond with the ability to support more workload with the same level of performance? Will it do this automagically, or will it require modification (reconfig, recoding) at the application level to allow this to happen? At the utopian end of the scale you have a nice, horizontally scalable application that is designed based on infrastructure building blocks, providing “infinite scalability” (cough). It doesn’t have to be utopian though.

Mainframes & Grids

Elastic scaling based on older school technologies from mainframe (PR/SM, LPAR) and mid-range vendors (Domains, vPAR, nPAR, Containers) have done ostensibly the same thing with little modification to the application by dynamically configuring the resources from one domain to another. There are limitations to this method because it usually only works within a smaller pool of resources contained in a single or smaller number of racks/frames.

Grids are another architectural solution to this problem. They are essentially designed to provide the horizontal scalability at a operating system level in comparison to a classic cloud which requires that capability at the application layer.

Horizontal, in-box vertical and GRID all have limitations. The sensitivity to these limitations depends on the type of processing or I/O requirements, but they will always be evident at massive scale.

The next challenge is: “Do you have multiple complementary workloads?”

Many people have it wrong when they talk about the clouds dependency on multi-tenancy. Multi-tenancy (MT) is a proxy concept for complementary workloads. If you have multiple tenants with similar workloads then you have correlated peaks which result in low efficiency for capacity. You need complementary workloads for public or private clouds for tactical elasticity to work.

A complementary workload is where peaks in one workload correspond to troughs in other workloads. At a minimum, alternating peaks are critical to resource effiiciency. The more uncorrelated the workloads, the more benefit from elasticity.

Strategic Elasticity

Where the variable of time expands to between one and five years, then matching supply and demand is based on several different factors. The first is;

“What’s you gross average workload profile?”

The profile of your business volume is a key indicator for benefits from elasticity.  It’s obvious that aggressively growing companies will get most benefit of elasticity. This is true tactically, but also strategically. The growing workloads allows for the constant consumption of capacity, giving the greatest flexibility. As this growth curve approximates to a flat line, the ability to provide elasticity becomes less and the efficiency of the infrastructure decreases. Therefore, gross workload explains the demand for capacity and its benefit from elasticity. For strategic elasticity, supply is dependent on the question:

“How dynamic is your asset lifecycle?”

As the normal volume of business ebbs and flows, the amount of physical infrastructure required to process the same workload changes. This creates a complex supply/demand curve that has a large dependency on the ways assets are acquired, and more importantly disposed.  If your cycles of business approach a 1-2 year cycle, then your asset lifecycle needs to approximate the same timeframe. The financials of asset lifecycle should no longer be based solely on an asset depreciation schedule. Years of TCO calculation have already told us that sweet spot of asset disposal is based on the convergence of asset residual value, efficiency (power, cpu, space), vendor maintenance, support/management and licensing.

Elasticity Quotient
How much tactical or strategic elasticity is enough for a private cloud to be effective? The Armada Group uses an ‘elasticity quotient’ as part of its Cloud Evaluation Framework, Workload Analysis to determine the ROI of cloud deployment. It calculates the efficiency of matching supply and demand in comparison to a baseline of traditional capacity management. A positive number represents a benefit over traditional methods and negative number shows that the elasticity profile does not work.

Summary
To have rapid elasticity (large +ve elastic quotient) in a private cloud you need:

  • Ability to scale in the application
  • Complementary workloads
  • Faster asset lifecycle
  • +ve gross average workload growth

(For the private cloud haters: Public clouds have the same problems, but at larger scale they can be less sensitive to some of the variables. Should another bubble burst, supply and demand could very well be out of sync for them as well, with even more serious consequences).

More Stories By Brad Vaughan

Brad Vaughan is a twenty year veteran consultant working with companies around the globe to transform technology infrastructure to deliver enhanced business services.

@CloudExpo Stories
While some vendors scramble to create and sell you a fancy solution for monitoring your spanking new Amazon Lambdas, hear how you can do it on the cheap using just built-in Java APIs yourself. By exploiting a little-known fact that Lambdas aren’t exactly single-threaded, you can effectively identify hot spots in your serverless code. In his session at @DevOpsSummit at 21st Cloud Expo, Dave Martin, Product owner at CA Technologies, will give a live demonstration and code walkthrough, showing how ...
SYS-CON Events announced today that CA Technologies has been named “Platinum Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business – from apparel to energy – is being rewritten by software. From planning to development to management to security, CA creates software that fuels transformation for companies in the applic...
Cloud adoption is often driven by a desire to increase efficiency, boost agility and save money. All too often, however, the reality involves unpredictable cost spikes and lack of oversight due to resource limitations. In his session at 20th Cloud Expo, Joe Kinsella, CTO and Founder of CloudHealth Technologies, tackled the question: “How do you build a fully optimized cloud?” He will examine: Why TCO is critical to achieving cloud success – and why attendees should be thinking holistically ab...
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
As more and more companies are making the shift from on-premises to public cloud, the standard approach to DevOps is evolving. From encryption, compliance and regulations like GDPR, security in the cloud has become a hot topic. Many DevOps-focused companies have hired dedicated staff to fulfill these requirements, often creating further siloes, complexity and cost. This session aims to highlight existing DevOps cultural approaches, tooling and how security can be wrapped in every facet of the bu...
WebRTC is great technology to build your own communication tools. It will be even more exciting experience it with advanced devices, such as a 360 Camera, 360 microphone, and a depth sensor camera. In his session at @ThingsExpo, Masashi Ganeko, a manager at INFOCOM Corporation, will introduce two experimental projects from his team and what they learned from them. "Shotoku Tamago" uses the robot audition software HARK to track speakers in 360 video of a remote party. "Virtual Teleport" uses a...
yperConvergence came to market with the objective of being simple, flexible and to help drive down operating expenses. It reduced the footprint by bundling the compute/storage/network into one box. This brought a new set of challenges as the HyperConverged vendors are very focused on their own proprietary building blocks. If you want to scale in a certain way, let’s say you identified a need for more storage and want to add a device that is not sold by the HyperConverged vendor, forget about it....
SYS-CON Events announced today that Calligo has been named “Bronze Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Calligo is an innovative cloud service provider offering mid-sized companies the highest levels of data privacy. Calligo offers unparalleled application performance guarantees, commercial flexibility and a personalized support service from its globally located cloud platform...
As DevOps methodologies expand their reach across the enterprise, organizations face the daunting challenge of adapting related cloud strategies to ensure optimal alignment, from managing complexity to ensuring proper governance. How can culture, automation, legacy apps and even budget be reexamined to enable this ongoing shift within the modern software factory?
SYS-CON Events announced today that Elastifile will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Elastifile Cloud File System (ECFS) is software-defined data infrastructure designed for seamless and efficient management of dynamic workloads across heterogeneous environments. Elastifile provides the architecture needed to optimize your hybrid cloud environment, by facilitating efficient...
SYS-CON Events announced today that Cloudistics, an on-premises cloud computing company, has been named “Bronze Sponsor” of SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Launched in 2016, Cloudistics helps anyone bring the power of the cloud to the data center in an easy-to-use, on- premises cloud platform that automatically provides high performance resources for all types of applications: Docke...
With Cloud Foundry you can easily deploy and use apps utilizing websocket technology, but not everybody realizes that scaling them out is not that trivial. In his session at 21st Cloud Expo, Roman Swoszowski, CTO and VP, Cloud Foundry Services, at Grape Up, will show you an example of how to deal with this issue. He will demonstrate a cloud-native Spring Boot app running in Cloud Foundry and communicating with clients over websocket protocol that can be easily scaled horizontally and coordinate...
SYS-CON Events announced today that Golden Gate University will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Since 1901, non-profit Golden Gate University (GGU) has been helping adults achieve their professional goals by providing high quality, practice-based undergraduate and graduate educational programs in law, taxation, business and related professions. Many of its courses are taug...
@DevOpsSummit at Cloud Expo taking place Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center, Santa Clara, CA, is co-located with the 21st International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is ...
SYS-CON Events announced today that Golden Gate University will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Since 1901, non-profit Golden Gate University (GGU) has been helping adults achieve their professional goals by providing high quality, practice-based undergraduate and graduate educational programs in law, taxation, business and related professions. Many of its courses are taug...
DevOps at Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to w...
SYS-CON Events announced today that Secure Channels, a cybersecurity firm, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Secure Channels, Inc. offers several products and solutions to its many clients, helping them protect critical data from being compromised and access to computer networks from the unauthorized. The company develops comprehensive data encryption security strategie...
Vulnerability management is vital for large companies that need to secure containers across thousands of hosts, but many struggle to understand how exposed they are when they discover a new high security vulnerability. In his session at 21st Cloud Expo, John Morello, CTO of Twistlock, will address this pressing concern by introducing the concept of the “Vulnerability Risk Tree API,” which brings all the data together in a simple REST endpoint, allowing companies to easily grasp the severity of t...
Recently, WebRTC has a lot of eyes from market. The use cases of WebRTC are expanding - video chat, online education, online health care etc. Not only for human-to-human communication, but also IoT use cases such as machine to human use cases can be seen recently. One of the typical use-case is remote camera monitoring. With WebRTC, people can have interoperability and flexibility for deploying monitoring service. However, the benefit of WebRTC for IoT is not only its convenience and interopera...
SYS-CON Events announced today that SkyScale will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. SkyScale is a world-class provider of cloud-based, ultra-fast multi-GPU hardware platforms for lease to customers desiring the fastest performance available as a service anywhere in the world. SkyScale builds, configures, and manages dedicated systems strategically located in maximum-security...