Welcome!

@CloudExpo Authors: William Schmarzo, Kevin Jackson, Liz McMillan, Pat Romanski, David H Deans

Related Topics: @CloudExpo

@CloudExpo: Blog Feed Post

Cloud Management – Various Solutions and Standards

At Kaavo we have already have an implementation which is very close to TOSCA vision

The growing use of Infrastructure as a Service to run custom applications, SaaS, and PaaS offerings is increasing the demand of management solutions to leverage the automation offered by IaaS.  One of the biggest advantages of IaaS is the ability to automate tasks which were not possible before.  E.g. a crashed server can be restored with an API call by launching a new instance.  Effective use of the IaaS APIs can dramatically reduce the time and resources it takes to deploy and provide production support for services and applications.

Various solutions and standards are available for automating the application management tasks which are usually performed manually.  Before looking at various solutions and standards, let’s take a look at what is needed to fully automate the deployment and runtime management of applications and business services on IaaS.

  1. Low level orchestration for configuring cloud resources.  E.g. launching cloud servers and configuring them via dynamic scripting, performing lifecycle tasks.

  2. High level orchestration for handling complex workflows and long running processes. E.g. ability to bring up an entire multi-tier application stack with a single click, performing dependent workflows spanning across multiple application tiers and distributed components.

Some of the common tools and approaches which handle low level orchestration are solutions like Puppet, Chef, RightScripts along with RightScale Server Templates, etc.  In Kaavo IMOD, we handle this type of automation using Actions which dynamically generate scripts or configuration files.  The files are generated and copied on the servers just in time using the Velocity Template Engine and the available deployment application metadata.  Unlike other approaches, Kaavo Actions don’t require software agents, see my blog on agent vs. agentless cloud management approach.

A very basic use case for High-level orchestration is the  ability to bring up an entire complex multi-tier application stack with all dependent resources and services with a single click.  Standards and solutions addressing this are Amazon CloudFormation Service, Kaavo IMOD / Kaavo System Definition, OVF, and TOSCA. OVF is one of the early standards which tried to tackle this basic use case using custom images and using startup time delays for ordering the boot sequence for servers (e.g. bring up application server 60 seconds after the database server).  OVF standard is from the pre-cloud virtualization days when there was no IaaS and hasn’t kept up with new developments, e.g. there is no concept of dynamic configuration or runtime maintenance workflows for an application.  Also, maintaining images for all the dependent servers as a part of the OVF package makes it difficult to apply and maintain patches on a running application.  In Kaavo IMOD, we do support OVF by providing the ability to bring up vApps as part of our integration with vCloud Director.

Amazon CloudFormation Service captures the higher level orchestration for bringing up the entire service stack; however, you need to use it with your own custom scripts or external low level orchestration solution like Chef or Puppet to properly configure the resources.  Kaavo IMOD handles the high-level orchestration using a workflow engine.  Kaavo System Definition captures both high level and low level orchestration information in one XML file and then Kaavo engine uses the information in the System Definition (XML) to automate both the deployment and runtime management of the application or service.  For more on comparison of Amazon CloudFormation Service and Kaavo IMOD please refer to my earlier blog on the subject.

Topology and Orchestration Specification for Cloud Applications (TOSCA) is an interesting emerging standard, it is in very early stages and there is no working implementation for TOSCA.  Version 1.0 draft of the specification was recently published.  At a high-level, TOSCA vision is very similar to what we are doing at Kaavo, i.e. capture the deployment and operational behavior of a service or application in one template to not only achieve automation but also to achieve portability of an application across various clouds.  We believe that the biggest benefit of using cloud will come from leveraging cloud to automate the operational processes for deployment and production support of applications.

Interestingly, similar to Kaavo, TOSCA is using XML to capture the deployment and management information for any given application.  The major difference between TOSCA and Kaavo System definition is that TOSCA calls for using BPEL (Business Process Execution Language) for specifying the operational behavior of the services.  At Kaavo, we allow users to define workflows by sequencing one or multiple actions in response to any event.  So for example, if you have to shut-down a database cluster, as a part of the shut-down process you may have to run vendor provided scripts or tools to take a backup of the database before shut-down. You can’t do these types of tasks using BPEL as most of the current software and middleware packages don’t provide web services api for performing this type of low level orchestration work and we have to use the tried and tested command-line tools.  We will keep an eye on TOSCA as it evolves and matures.  At Kaavo we have already have an implementation which is very close to TOSCA vision, to learn more about how we have done it, checkout IBM Developerworks article on Application Centric Cloud Management.  Also checkout the guide for Kaavo System Definition.

More Stories By Jamal Mazhar

Jamal Mazhar is Founder & CEO of Kaavo. He possesses more than 15 years of experience in technology, engineering and consulting with a range of Fortune 500 companies including GE and ING. He established ING’s “Center of Excellence for B2B” which streamlined $2 billion per month in electronic money transfer operations. As Lead Architect at GE Capital e-Business team, Jamal directed analysis and implementation efforts and improved the performance of the website generating more than $1 billion in annual lease revenues. At Trilogy he provided technical and managerial expertise for several large scale e-business implementation projects for companies such as Boeing, NCR, Gartner, British Airways, Quantas Airways and Alltel. Jamal has BS in Electrical and Computer Engineering from the University of Texas at Austin and MBA from NYU Stern School of Business.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
Artificial intelligence, machine learning, neural networks. We’re in the midst of a wave of excitement around AI such as hasn’t been seen for a few decades. But those previous periods of inflated expectations led to troughs of disappointment. Will this time be different? Most likely. Applications of AI such as predictive analytics are already decreasing costs and improving reliability of industrial machinery. Furthermore, the funding and research going into AI now comes from a wide range of com...
For organizations that have amassed large sums of software complexity, taking a microservices approach is the first step toward DevOps and continuous improvement / development. Integrating system-level analysis with microservices makes it easier to change and add functionality to applications at any time without the increase of risk. Before you start big transformation projects or a cloud migration, make sure these changes won’t take down your entire organization.
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
We build IoT infrastructure products - when you have to integrate different devices, different systems and cloud you have to build an application to do that but we eliminate the need to build an application. Our products can integrate any device, any system, any cloud regardless of protocol," explained Peter Jung, Chief Product Officer at Pulzze Systems, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA
21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Me...
SYS-CON Events announced today that Ayehu will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on October 31 - November 2, 2017 at the Santa Clara Convention Center in Santa Clara California. Ayehu provides IT Process Automation & Orchestration solutions for IT and Security professionals to identify and resolve critical incidents and enable rapid containment, eradication, and recovery from cyber security breaches. Ayehu provides customers greater control over IT infras...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
SYS-CON Events announced today that MobiDev, a client-oriented software development company, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MobiDev is a software company that develops and delivers turn-key mobile apps, websites, web services, and complex software systems for startups and enterprises. Since 2009 it has grown from a small group of passionate engineers and business...
SYS-CON Events announced today that GrapeUp, the leading provider of rapid product development at the speed of business, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market acr...
"We are a monitoring company. We work with Salesforce, BBC, and quite a few other big logos. We basically provide monitoring for them, structure for their cloud services and we fit into the DevOps world" explained David Gildeh, Co-founder and CEO of Outlyer, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that Enzu will exhibit at SYS-CON's 21st Int\ernational Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Enzu’s mission is to be the leading provider of enterprise cloud solutions worldwide. Enzu enables online businesses to use its IT infrastructure to their competitive advantage. By offering a suite of proven hosting and management services, Enzu wants companies to focus on the core of their ...
DevOps at Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to w...
New competitors, disruptive technologies, and growing expectations are pushing every business to both adopt and deliver new digital services. This ‘Digital Transformation’ demands rapid delivery and continuous iteration of new competitive services via multiple channels, which in turn demands new service delivery techniques – including DevOps. In this power panel at @DevOpsSummit 20th Cloud Expo, moderated by DevOps Conference Co-Chair Andi Mann, panelists examined how DevOps helps to meet the de...
Cloud Expo, Inc. has announced today that Andi Mann and Aruna Ravichandran have been named Co-Chairs of @DevOpsSummit at Cloud Expo Silicon Valley which will take place Oct. 31-Nov. 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. "DevOps is at the intersection of technology and business-optimizing tools, organizations and processes to bring measurable improvements in productivity and profitability," said Aruna Ravichandran, vice president, DevOps product and solutions marketing...
Automation is enabling enterprises to design, deploy, and manage more complex, hybrid cloud environments. Yet the people who manage these environments must be trained in and understanding these environments better than ever before. A new era of analytics and cognitive computing is adding intelligence, but also more complexity, to these cloud environments. How smart is your cloud? How smart should it be? In this power panel at 20th Cloud Expo, moderated by Conference Chair Roger Strukhoff, pane...
SYS-CON Events announced today that Cloud Academy named "Bronze Sponsor" of 21st International Cloud Expo which will take place October 31 - November 2, 2017 at the Santa Clara Convention Center in Santa Clara, CA. Cloud Academy is the industry’s most innovative, vendor-neutral cloud technology training platform. Cloud Academy provides continuous learning solutions for individuals and enterprise teams for Amazon Web Services, Microsoft Azure, Google Cloud Platform, and the most popular cloud com...
What's the role of an IT self-service portal when you get to continuous delivery and Infrastructure as Code? This general session showed how to create the continuous delivery culture and eight accelerators for leading the change. Don Demcsak is a DevOps and Cloud Native Modernization Principal for Dell EMC based out of New Jersey. He is a former, long time, Microsoft Most Valuable Professional, specializing in building and architecting Application Delivery Pipelines for hybrid legacy, and cloud ...
SYS-CON Events announced today that IBM has been named “Diamond Sponsor” of SYS-CON's 21st Cloud Expo, which will take place on October 31 through November 2nd 2017 at the Santa Clara Convention Center in Santa Clara, California.
In his session at Cloud Expo, Alan Winters, an entertainment executive/TV producer turned serial entrepreneur, presented a success story of an entrepreneur who has both suffered through and benefited from offshore development across multiple businesses: The smart choice, or how to select the right offshore development partner Warning signs, or how to minimize chances of making the wrong choice Collaboration, or how to establish the most effective work processes Budget control, or how to ma...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.