@CloudExpo Authors: Zakia Bouachraoui, Elizabeth White, Liz McMillan, Pat Romanski, Roger Strukhoff

Related Topics: @CloudExpo, Microservices Expo, Containers Expo Blog

@CloudExpo: Article

If Only Your Internal Cloud Had a Brain

The benefits of a more intelligent approach to cloud management can be staggering

Internal clouds are gaining momentum in large organizations, both as a means to drive agility and efficiency and as a stepping stone to hybrid and external cloud models. Although establishing and managing an internal cloud seems simple and elegant in principle, in practice they rarely resemble the simple, fluffy white cartoons seen in presentations. More often than not, today's cloud strategy involves piecing together hypervisor management layers with self-service portals, orchestration solutions, provisioning tools, and other base components. While this will yield a functioning cloud, it tends to operate at a relatively basic level, with little intelligence powering its action. This is a lot like having a body with no brain: if you tap its knee it might kick, but it is only capable of basic, reactive behavior.

Some might argue that this is no different from traditional IT physical environments, where disjoint tools and processes can be effectively used to handle specific aspects of operations and management. But the difference in these new environments is that there is a much tighter inter-relationship between all of the physical and virtual components. Physical complexity is replaced by virtual complexity, and characteristics like multi-tenancy and resource overcommit add a new twist. All of these factors combine to create an interesting challenge in the management of these environments, taking it beyond the realm of what intuition, spreadsheets and simple load-balancers can effectively handle.

In order to host cloud workloads in an efficient and low-risk way, the equivalent of a brain is needed. Like a human brain, it must aggregate and correlate information regarding the configuration and operation of the components in the system in order to maintain a certain level of "situational awareness." But this alone is not sufficient, as it provides visibility but not action, and is reactive, not proactive. To safely, reliably and proactively manage cloud environments there are two equally critical inputs that are required: cloud management policies and future capacity bookings.

Cloud management policies are the rules, constraints and preferences that govern the relationship between capacity and the workloads that run on it. These policies are critical to cloud management, and affect everything from utilization levels to resource overcommit, technical compatibilities and business rules. Interestingly, most of these considerations have existed for quite some time in IT environments, but there was less of a need to formalize them into a true policy until now. This is mainly because physical environments are not flexible enough to warrant it, and early virtual environments have targeted the "low hanging fruit," typically at the departmental level, which tends to be comparatively simple to manage. But a cloud with no policy is not viable, as it by definition hosts disparate applications from different business groups, each having different performance, availability and security requirements. Throwing these together randomly is a recipe for failure, and can lead to many performance, compliance and efficiency issues.

Once policies have been established, the other key ingredient is a representation of the future capacity bookings. This is the piece of the puzzle that allows an organization to attain a level of predictive analysis, which is essential to proactive management. These bookings can be thought of as hotel reservations, and represent the up-coming demands related to new application deployment, migration and consolidation activity, and other requirements. While most think of clouds as a way to get capacity "right now," in many organizations the goal is more strategic than tactical, and booking capacity with some level of advanced notice is far more consistent with the operational model. This provides tremendous advantages in terms of agility by removing the procurement cycle from the critical path, while also providing a level of control over IT assets. Immediate requests can still be accommodated, of course, but may incur a premium due to the volatility they introduce.

With these inputs in mind, let's get back to the brain. Data gathered from the "eyes and ears" of the environment (e.g., monitoring and alerting tools) provides situational awareness through a knowledge of current and historical activity, configurations and status. Leveraging a brain, or applying analytics to interpret this information in the context of the prevailing policy for a cloud or specific workload within it, enables risks to be identified and efficiency quantified, thus providing judgement as to whether action is needed to improve the environment. Factoring in future bookings enables "future situational awareness," where policies can be used to drive predictive analysis of potential risks and inefficiencies. Just like the brain, these current and future actions can then be communicated to the "arms and legs" of the environment (e.g., management, provisioning and orchestration tools) to achieve the desired outcome.

The benefits of a more intelligent approach to cloud management can be staggering. Isolated and reactive tools, however well integrated, are simply not capable of managing IT to a high degree of efficiency. But the combination of these tools with proactive, policy-based analytics provides significantly greater control, yielding higher efficiency while at the same time significantly reducing operational risk. In today's virtual and cloud environments, this translates into better performance and significantly higher density, saving millions of dollars in infrastructure costs.

More Stories By Andrew Hillier

Andrew Hillier is CTO and co-founder of CiRBA, Inc., a data center intelligence analytics software provider that determines optimal workload placements and resource allocations required to safely maximize the efficiency of Cloud, virtual and physical infrastructure. Reach Andrew at [email protected]

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.

CloudEXPO Stories
The precious oil is extracted from the seeds of prickly pear cactus plant. After taking out the seeds from the fruits, they are adequately dried and then cold pressed to obtain the oil. Indeed, the prickly seed oil is quite expensive. Well, that is understandable when you consider the fact that the seeds are really tiny and each seed contain only about 5% of oil in it at most, plus the seeds are usually handpicked from the fruits. This means it will take tons of these seeds to produce just one bottle of the oil for commercial purpose. But from its medical properties to its culinary importance, skin lightening, moisturizing, and protection abilities, down to its extraordinary hair care properties, prickly seed oil has got lots of excellent rewards for anyone who pays the price.
The platform combines the strengths of Singtel's extensive, intelligent network capabilities with Microsoft's cloud expertise to create a unique solution that sets new standards for IoT applications," said Mr Diomedes Kastanis, Head of IoT at Singtel. "Our solution provides speed, transparency and flexibility, paving the way for a more pervasive use of IoT to accelerate enterprises' digitalisation efforts. AI-powered intelligent connectivity over Microsoft Azure will be the fastest connected path for IoT innovators to scale globally, and the smartest path to cross-device synergy in an instrumented, connected world.
There are many examples of disruption in consumer space – Uber disrupting the cab industry, Airbnb disrupting the hospitality industry and so on; but have you wondered who is disrupting support and operations? AISERA helps make businesses and customers successful by offering consumer-like user experience for support and operations. We have built the world’s first AI-driven IT / HR / Cloud / Customer Support and Operations solution.
ScaleMP is presenting at CloudEXPO 2019, held June 24-26 in Santa Clara, and we’d love to see you there. At the conference, we’ll demonstrate how ScaleMP is solving one of the most vexing challenges for cloud — memory cost and limit of scale — and how our innovative vSMP MemoryONE solution provides affordable larger server memory for the private and public cloud. Please visit us at Booth No. 519 to connect with our experts and learn more about vSMP MemoryONE and how it is already serving some of the world’s largest data centers. Click here to schedule a meeting with our experts and executives.
Darktrace is the world's leading AI company for cyber security. Created by mathematicians from the University of Cambridge, Darktrace's Enterprise Immune System is the first non-consumer application of machine learning to work at scale, across all network types, from physical, virtualized, and cloud, through to IoT and industrial control systems. Installed as a self-configuring cyber defense platform, Darktrace continuously learns what is ‘normal' for all devices and users, updating its understanding as the environment changes.