Welcome!

@CloudExpo Authors: Yeshim Deniz, Pat Romanski, Liz McMillan, Elizabeth White, Harry Trott

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Containers Expo Blog, Machine Learning , Agile Computing

@CloudExpo: Article

Avoiding the Hidden Costs That Derail Cloud Projects

The Challenge: Making Your Private Cloud Fit Your IT Infrastructure Puzzle

Most companies that have embarked on a private cloud journey find themselves in one of two unfortunate positions: they've already spent much more than they had planned or they're struggling with how to make sure costs don't get out of hand. These are typically companies with sophisticated IT organizations - organizations that ask tough questions and put detailed plans in place. For example, an international bank spent millions of dollars and six months of professional services time before scrapping their existing cloud project and restarting it with a completely new approach and toolset.

The Challenge: Making Your Private Cloud Fit Your IT Infrastructure Puzzle
Cloud automation vendors make deploying a private cloud sound easy. If you take their basic out-of-the-box capability, the good ones will probably take you anywhere from a few hours to a few days to get a simple self-service private cloud working. While that may make a nice proof-of-concept demo, will that actually meet the needs of how you manage your infrastructure or will you need to replace prior technology and best practice investments to make your cloud work?

Cloud management is not a standalone entity. For your cloud to be successful, it needs to integrate and work with your existing management infrastructure and best practices. As you evaluate cloud management platforms, you need to assess how each tool works with your current and future management ecosystem. Your cloud management choice will not only impact prior investments, it can also limit your future choices. In order to avoid some of the hidden private cloud costs, evaluate how cloud management options will fit with your existing IT ecosystem.

  • Deployment Technologies
    Does your cloud management plaform work with the current technologies used to deploy your infrastructure? This includes both the private resources in your data centers and public cloud resources. Does it support the operating system, server virtualization tools, and desktop technologies being used today as well as the ones you may want to use in the future?
  • Management Infrastructure
    Typically, the delivery of a private cloud service requires a work order ticket to be generated, an internal database accessed, and that specific tools be used to deploy software, monitor the environment and take corrective action. How easily does your cloud management platform work with your current management tools and processess? Will you need to replace these tools or pay for extensive customization to make your cloud management solution work?
  • Best Practices
    As part of continuous process improvement, companies should always be looking to streamline and improve their processess. Deploying a private cloud is a large paradigm shift and some process changes will likely be needed to facilitate end-to-end automation. However, your cloud management software should not force changes on you that don't make sense within the guidelines established for your company. Remember that substantial changes required by the vendor are likely to be costly in terms of time and effort, if not also technology.
  • Custom Self-Service Portal
    All cloud management products provide some level of self-service capabilities. An out-of-the-box self-service portal simplifies initial deployment. However, what if your company already has a self-service portal or existing work order ticketing system? The last thing you will need is yet another portal. How easily can your existing portal be integrated with your cloud management services and will you need to spend time and money reproducing all the security in the custom portal?

Cloud Management Extensibility
Extensibility is also a critical factor in private cloud costs. Wikipedia defines extensibility as: "In systems architecture, extensibility means the system is designed to include hooks and mechanisms for expanding and enhancing the capabilities without having to make major changes to the system infrastructure." Often this means making modifications at runtime without requiring changes to the original source code.

Most cloud automation products will only automate a portion of your provisioning, ongoing management, or decommissioning processes. Therefore, an extensible architecture, combined with multi-vendor support, are fundamental components of cloud management platforms as they're needed to facilitate integration with the current IT infrastructure and management ecosystem.

With regard to extensibility, cloud management software products typically fall into one of the following two categories:

  • Prescriptive Tools
    Many cloud management solutions were built for a specific problem, like lab management, and have prescribed processes, limited interoperability, and lack the extensibility features needed to adapt to more broad-scale deployment requirements.

Any tool that requires drastic changes to existing management tools, infrastructure components, or operational processes will result in additional capital costs required to replace existing technology as well as additional investment in people who can use this new technology and processes.

The other challenge is that your company will likely be unable to achieve the savings you have envisioned because the automation solution will not meet the needs of the various business units. These business groups will either stay with their current manual process, reducing the percentage of your infrastructure that can be moved to an on-demand cloud, or they will implement a different cloud solution that does not provide your company with the operational scalability and savings you could have had with a single integrated solution.

  • Automation Toolkits
    Some vendors provide very basic cloud management capabilities and augment their cloud management offering by providing separate run book toolkits or "orchestration" products. This option allows companies to completely customize their cloud solution. However, there are multiple hidden costs associated with this implementation choice:

Initial services costs outweigh the software costs
These solutions tend to require lengthy and expensive custom services projects where services typically cost three times as much as the software.

Customized solutions are not easily extended to other business
In addition to the higher upfront costs, cloud automation solutions built with an automation toolkit tend to be built specifically for the needs of a single business. When companies try and expand the use of the highly customized solutions, they either have further customization costs or suffer from limited adoption across the enterprise.

Customized solutions make upgrades to newer release difficult
Many customizations strand the implementation at a specific release, making upgrades to newer versions difficult and costly.

Mitigating Private Cloud's Hidden Costs
Hopefully you now have a better understanding of some of the hidden cloud deployment costs and how your automation choice can not only affect costs but also impact your actual savings. It's important that you can adapt and expand automation with tools targeted at both IT operations as well as developers. In order to enable the quickest time-to-cloud value, companies should consider the following capabilities when evaluating cloud management platform software:

  • Comprehensive out-of-the-box functionality
    First and foremost, you will want a cloud management solution with a comprehensive set of out-of-the-box cloud management features. Many vendors only focus on initial provisioning capabilities. Make sure your cloud management platform automates the complete life cycle including ongoing management, resource reclamation, and decommissioning including archiving. The more features available out-of-the-box, the less need for costly custom services to extend the product's core functionality.
  • Broad multi-vendor support
    When evaluating cloud management options, make sure that the tool you choose can orchestrate end-to-end delivery across all the technology and management components that make up your implementation. Most vendors only support components from their own offerings. Unless you're a single-vendor shop, that means you may need to discard your prior investments and be locked into that vendor's technology in the future. Multi-vendor support includes technologies used in your private cloud as well as public cloud resources.
  • Policy enabled extensibility
    How extensible is your cloud management platform by just changing configuration parameters? Can you select different provisioning workflows, collect custom data, define resource limits and service levels, or create custom approvals or reclamation workflows? These are just a few of the many customizations you should be able to make via policies. The more you can customize your cloud deployment via policies, the quicker and more cost-effectively you will be able to deploy a private cloud infrastructure that meets company's specific needs.
  • Business-aware governance
    Being able to modify the behavior of your cloud via policies is important, but just as important is the granularity of the policies that can be configured. They must be granular enough to allow different business groups to have different services that are built and constructed using different processes, resources and service levels. For example, the way you provision and manage IT resources can be quite different for dev/test vs. production vs. desktops. Business-aware governance and control is fundamental to meeting the unique needs of each business and driving broader cross-group adoption of cloud services.
  • Modify out-of-the-box automation
    Can you easily add tasks or call scripts at various states in the machine's life cycle? Is there a visual workflow editing tool and a library of predefined activities that simplify the customization process? For example: How easily can you add a self-service command to perform a specific function, access/retrieve information from a custom DB as part of the provisioning process, or execute a script to customize a machine configuration? Are you modifying the workflows that ship with the product or is this a separate run book automation or "orchestration" tool that you need to bolt onto the cloud management tool?
  • Automate additional tasks
    Can the cloud automation platform be used to automate additional tasks that go well beyond simple modifications to out-of-the-box processes? For example, one company extended the process used to provision new desktops to also automate the process of onboarding new employees. If you need this level of extensibility, one factor that should be considered is the availability of developers with this skill set. Automation tools based on de facto standards like Visual Studio and .NET will be much easier to find developers for than a vendor-specific automation tool.

Implementing and managing a private or hybrid cloud doesn't have to be so expensive. Make sure you're armed with the knowledge needed to fully evaluate your cloud vendor's offerings for potential hidden costs. Otherwise your business may find itself putting cloud projects on hold or having to justify a much-increased budget.

More Stories By Rich Bourdeau

Rich Bourdeau is VP of Marketing at DynamicOps. He has over 20 years of experience in developing, managing and marketing IT infrastructure management solutions for enterprises. Rich has spent the last four years at DynamicOps helping companies deploy and manage their private cloud infrastructures. He is a regular contributor to the DynamicOps blog and has authored papers on Must Have Cloud Management Capabilities as well as Building the Business Case for Private Cloud. Rich can be reached at [email protected] if you want to learn more about cloud management.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
SYS-CON Events announced today that GrapeUp, the leading provider of rapid product development at the speed of business, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market acr...
From 2013, NTT Communications has been providing cPaaS service, SkyWay. Its customer’s expectations for leveraging WebRTC technology are not only typical real-time communication use cases such as Web conference, remote education, but also IoT use cases such as remote camera monitoring, smart-glass, and robotic. Because of this, NTT Communications has numerous IoT business use-cases that its customers are developing on top of PaaS. WebRTC will lead IoT businesses to be more innovative and address...
SYS-CON Events announced today that CA Technologies has been named "Platinum Sponsor" of SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business - from apparel to energy - is being rewritten by software. From planning to development to management to security, CA creates software that fuels transformation for companies in the applic...
For financial firms, the cloud is going to increasingly become a crucial part of dealing with customers over the next five years and beyond, particularly with the growing use and acceptance of virtual currencies. There are new data storage paradigms on the horizon that will deliver secure solutions for storing and moving sensitive financial data around the world without touching terrestrial networks. In his session at 20th Cloud Expo, Cliff Beek, President of Cloud Constellation Corporation, d...
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
In his opening keynote at 20th Cloud Expo, Michael Maximilien, Research Scientist, Architect, and Engineer at IBM, discussed the full potential of the cloud and social data requires artificial intelligence. By mixing Cloud Foundry and the rich set of Watson services, IBM's Bluemix is the best cloud operating system for enterprises today, providing rapid development and deployment of applications that can take advantage of the rich catalog of Watson services to help drive insights from the vast t...
As DevOps methodologies expand their reach across the enterprise, organizations face the daunting challenge of adapting related cloud strategies to ensure optimal alignment, from managing complexity to ensuring proper governance. How can culture, automation, legacy apps and even budget be reexamined to enable this ongoing shift within the modern software factory?
SYS-CON Events announced today that Elastifile will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Elastifile Cloud File System (ECFS) is software-defined data infrastructure designed for seamless and efficient management of dynamic workloads across heterogeneous environments. Elastifile provides the architecture needed to optimize your hybrid cloud environment, by facilitating efficient...
While some vendors scramble to create and sell you a fancy solution for monitoring your spanking new Amazon Lambdas, hear how you can do it on the cheap using just built-in Java APIs yourself. By exploiting a little-known fact that Lambdas aren’t exactly single-threaded, you can effectively identify hot spots in your serverless code. In his session at @DevOpsSummit at 21st Cloud Expo, Dave Martin, Product owner at CA Technologies, will give a live demonstration and code walkthrough, showing how ...
SYS-CON Events announced today that Golden Gate University will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Since 1901, non-profit Golden Gate University (GGU) has been helping adults achieve their professional goals by providing high quality, practice-based undergraduate and graduate educational programs in law, taxation, business and related professions. Many of its courses are taug...
@DevOpsSummit at Cloud Expo taking place Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center, Santa Clara, CA, is co-located with the 21st International Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is ...
Historically, some banking activities such as trading have been relying heavily on analytics and cutting edge algorithmic tools. The coming of age of powerful data analytics solutions combined with the development of intelligent algorithms have created new opportunities for financial institutions. In his session at 20th Cloud Expo, Sebastien Meunier, Head of Digital for North America at Chappuis Halder & Co., discussed how these tools can be leveraged to develop a lasting competitive advantage ...
DevOps at Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to w...
SYS-CON Events announced today that DXWorldExpo has been named “Global Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Digital Transformation is the key issue driving the global enterprise IT business. Digital Transformation is most prominent among Global 2000 enterprises and government institutions.
An increasing number of companies are creating products that combine data with analytical capabilities. Running interactive queries on Big Data requires complex architectures to store and query data effectively, typically involving data streams, an choosing efficient file format/database and multiple independent systems that are tied together through custom-engineered pipelines. In his session at @BigDataExpo at @ThingsExpo, Tomer Levi, a senior software engineer at Intel’s Advanced Analytics ...
21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Me...
When shopping for a new data processing platform for IoT solutions, many development teams want to be able to test-drive options before making a choice. Yet when evaluating an IoT solution, it’s simply not feasible to do so at scale with physical devices. Building a sensor simulator is the next best choice; however, generating a realistic simulation at very high TPS with ease of configurability is a formidable challenge. When dealing with multiple application or transport protocols, you would be...
In his session at 20th Cloud Expo, Scott Davis, CTO of Embotics, discussed how automation can provide the dynamic management required to cost-effectively deliver microservices and container solutions at scale. He also discussed how flexible automation is the key to effectively bridging and seamlessly coordinating both IT and developer needs for component orchestration across disparate clouds – an increasingly important requirement at today’s multi-cloud enterprise.
Any startup has to have a clear go –to-market strategy from the beginning. Similarly, any data science project has to have a go to production strategy from its first days, so it could go beyond proof-of-concept. Machine learning and artificial intelligence in production would result in hundreds of training pipelines and machine learning models that are continuously revised by teams of data scientists and seamlessly connected with web applications for tenants and users.
In his session at 20th Cloud Expo, Chris Carter, CEO of Approyo, discussed the basic set up and solution for an SAP solution in the cloud and what it means to the viability of your company. Chris Carter is CEO of Approyo. He works with business around the globe, to assist them in their journey to the usage of Big Data in the forms of Hadoop (Cloudera and Hortonwork's) and SAP HANA. At Approyo, we support firms who are looking for knowledge to grow through current business process, where even 1%...