Welcome!

@CloudExpo Authors: Elizabeth White, Liz McMillan, Pat Romanski, Steve Wilson, Jason Bloomberg

Related Topics: @CloudExpo

@CloudExpo: Article

Unity Builds Its Federated Cloud with OpenNebula

Based on SoftLayer, Ceph, Ubuntu and AWS

Unity Technologies is shaping a booming global games market. The Unity engine is far and away the dominant global game development software. More games are made with Unity than with any other game technology! And guess what? Unity uses OpenNebula to run their IaaS infrastructure to support their development services, among other things.

Unity Technologies contacted OpenNebula Systems, the company behind OpenNebula, due to its expert knowledge of OpenNebula, to jointly design and deploy Unity cloud infrastructure, dubbed uCloud. OpenNebula Systems offers this service through the Jumpstart packages, on their Basic and Advanced modalities, based on the different Open Cloud Reference Architecture corresponding types.

The basic principle that Unity applies to their infrastructure is the KISS approach, which is very much aligned with the OpenNebula design principle.

The Requirements
Unity Technologies offers its services globally, and as such required to deploy a cloud across three different data centers to serve EMEA, US and ASIA Unity users. The data centers were to be based on SoftLayer bare metal servers, and the users of the Cloud were expected to be able to access resources across these different data centers.

Regarding networking, a certain degree of federation was expected, particularly the ability to interconnect virtual machines from different data centers in different virtual networks. Unity Technologies suggested the use of network gateways to manage this interconnections, so the challenge was to integrate them in the OpenNebula workflow.

Other requirements were the use of Active Directory to authenticate users, and also to have a complete isolation between groups of users (that is, the workloads of one group of users should not affect the others), as well as hybrid access to public cloud providers, in particular SoftLayer and Amazon EC2, to be able to cloud burst Virtual Machine to them in case the allocated bare metal in SoftLayer cannot cope with the fluctuating demands.

The Design
OpenNebula Systems and Unity got to work right away, to deliver the best possible OpenNebula cloud design taking into account the requirements. Take a look at the picture to get a glimpse of the final design of uCloud.

unity

The use of Ceph was a no brainer, Unity used Ceph internally and OpenNebula Systems agreed right away since this cloud is expected to grow to a medium to large scale. This is aligned with the OpenNebula Advanced Reference Architecture, intended for clouds of this magnitude. Also, Ubuntu was preferred by Unity sysadmins, and given OpenNebula full support for it; the decision was arrived to easily enough as well.

Using OpenNebula federation capabilities solved right away the need to federate at the authentication level the different datacenters. The SoftLayer dedicated link low latency allowed the several instances of OpenNebula (one per data center) to communicate quickly enough to keep them synchronized and provide a top-notch user experience.

The need of serving different groups of people, with different needs in terms of physical and virtual resources, was also solved using the powerful OpenNebula provisioning model, by assigning physical resources to Virtual Data Centers, and providing access to them via Groups of users, to which virtual resources can be assigned.

Networking was trickier. The limitations of using only traffic encapsulated within VLANs imposed the use of VXLAN, which OpenNebula fully supports. Special integrations were made into OpenNebula to operate the Gateways as soon as a new virtual network is created; so new routes are created dynamically enabling the interconnection of different data centers virtual networks on demand. The OpenNebula flexible architecture proved that it is a great asset to solve complex designs.

Cgroups was the technology picked up for workload isolation, so VMs from one groups of users cannot eat up all the CPU resources if they are needed by another VMs. For memory, not allowing for over commitment was the decision.

The Result
uCloud is a state of the art cloud, with authentication and network federation, prepared to scale to support thousands and even millions of users as Unity Technology requires. Unity Technologies can arguably be given the credit of making the right call, contacting OpenNebula Systems, the creators of the technology, to push it to its limits to create a cloud infrastructure ahead of its time.

"We engaged OpenNebula Systems to verify our design thoughts and to speed up the deployment phase of our uCloud project.", said Karsten Nielsen, IT Manager at Unity Technologies. "OpenNebula Systems is very professional and executed within the tight death-line the project was under. I am very pleased with the process and the result of the project."

This is post is a reprint of a post published at the OpenNebula blog


More Stories By Ignacio M. Llorente

Dr. Llorente is Director of the OpenNebula Project and CEO & co-founder at C12G Labs. He is an entrepreneur and researcher in the field of cloud and distributed computing, having managed several international projects and initiatives on Cloud Computing, and authored many articles in the leading journals and proceedings books. Dr. Llorente is one of the pioneers and world's leading authorities on Cloud Computing. He has held several appointments as independent expert and consultant for the European Commission and several companies and national governments. He has given many keynotes and invited talks in the main international events in cloud computing, has served on several Groups of Experts on Cloud Computing convened by international organizations, such as the European Commission and the World Economic Forum, and has contributed to several Cloud Computing panels and roadmaps. He founded and co-chaired the Open Grid Forum Working Group on Open Cloud Computing Interface, and has participated in the main European projects in Cloud Computing. Llorente holds a Ph.D in Computer Science (UCM) and an Executive MBA (IE Business School), and is a Full Professor (Catedratico) and the Head of the Distributed Systems Architecture Group at UCM.

@CloudExpo Stories
SYS-CON Events announced today that Massive Networks will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Massive Networks mission is simple. To help your business operate seamlessly with fast, reliable, and secure internet and network solutions. Improve your customer's experience with outstanding connections to your cloud.
DevOps is under attack because developers don’t want to mess with infrastructure. They will happily own their code into production, but want to use platforms instead of raw automation. That’s changing the landscape that we understand as DevOps with both architecture concepts (CloudNative) and process redefinition (SRE). Rob Hirschfeld’s recent work in Kubernetes operations has led to the conclusion that containers and related platforms have changed the way we should be thinking about DevOps and...
Everything run by electricity will eventually be connected to the Internet. Get ahead of the Internet of Things revolution and join Akvelon expert and IoT industry leader, Sergey Grebnov, in his session at @ThingsExpo, for an educational dive into the world of managing your home, workplace and all the devices they contain with the power of machine-based AI and intelligent Bot services for a completely streamlined experience.
Because IoT devices are deployed in mission-critical environments more than ever before, it’s increasingly imperative they be truly smart. IoT sensors simply stockpiling data isn’t useful. IoT must be artificially and naturally intelligent in order to provide more value In his session at @ThingsExpo, John Crupi, Vice President and Engineering System Architect at Greenwave Systems, will discuss how IoT artificial intelligence (AI) can be carried out via edge analytics and machine learning techn...
FinTechs use the cloud to operate at the speed and scale of digital financial activity, but are often hindered by the complexity of managing security and compliance in the cloud. In his session at 20th Cloud Expo, Sesh Murthy, co-founder and CTO of Cloud Raxak, showed how proactive and automated cloud security enables FinTechs to leverage the cloud to achieve their business goals. Through business-driven cloud security, FinTechs can speed time-to-market, diminish risk and costs, maintain continu...
"Cloud computing is certainly changing how people consume storage, how they use it, and what they use it for. It's also making people rethink how they architect their environment," stated Brad Winett, Senior Technologist for DDN Storage, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
Existing Big Data solutions are mainly focused on the discovery and analysis of data. The solutions are scalable and highly available but tedious when swapping in and swapping out occurs in disarray and thrashing takes place. The resolution for thrashing through machine learning algorithms and support nomenclature is through simple techniques. Organizations that have been collecting large customer data are increasingly seeing the need to use the data for swapping in and out and thrashing occurs ...
As many know, the first generation of Cloud Management Platform (CMP) solutions were designed for managing virtual infrastructure (IaaS) and traditional applications. But that’s no longer enough to satisfy evolving and complex business requirements. In his session at 21st Cloud Expo, Scott Davis, Embotics CTO, will explore how next-generation CMPs ensure organizations can manage cloud-native and microservice-based application architectures, while also facilitating agile DevOps methodology. He wi...
SYS-CON Events announced today that Datera, that offers a radically new data management architecture, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Datera is transforming the traditional datacenter model through modern cloud simplicity. The technology industry is at another major inflection point. The rise of mobile, the Internet of Things, data storage and Big...
Blockchain is a shared, secure record of exchange that establishes trust, accountability and transparency across business networks. Supported by the Linux Foundation's open source, open-standards based Hyperledger Project, Blockchain has the potential to improve regulatory compliance, reduce cost as well as advance trade. Are you curious about how Blockchain is built for business? In her session at 21st Cloud Expo, René Bostic, Technical VP of the IBM Cloud Unit in North America, will discuss th...
“Why didn’t testing catch this” must become “How did this make it to testing?” Traditional quality teams are the crutch and excuse keeping organizations from making the necessary investment in people, process, and technology to accelerate test automation. Just like societies that did not build waterways because the labor to keep carrying the water was so cheap, we have created disincentives to automate. In her session at @DevOpsSummit at 20th Cloud Expo, Anne Hungate, President of Daring System...
SYS-CON Events announced today that GrapeUp, the leading provider of rapid product development at the speed of business, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market acr...
From 2013, NTT Communications has been providing cPaaS service, SkyWay. Its customer’s expectations for leveraging WebRTC technology are not only typical real-time communication use cases such as Web conference, remote education, but also IoT use cases such as remote camera monitoring, smart-glass, and robotic. Because of this, NTT Communications has numerous IoT business use-cases that its customers are developing on top of PaaS. WebRTC will lead IoT businesses to be more innovative and address...
SYS-CON Events announced today that CA Technologies has been named "Platinum Sponsor" of SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business - from apparel to energy - is being rewritten by software. From planning to development to management to security, CA creates software that fuels transformation for companies in the applic...
For financial firms, the cloud is going to increasingly become a crucial part of dealing with customers over the next five years and beyond, particularly with the growing use and acceptance of virtual currencies. There are new data storage paradigms on the horizon that will deliver secure solutions for storing and moving sensitive financial data around the world without touching terrestrial networks. In his session at 20th Cloud Expo, Cliff Beek, President of Cloud Constellation Corporation, d...
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
In his opening keynote at 20th Cloud Expo, Michael Maximilien, Research Scientist, Architect, and Engineer at IBM, discussed the full potential of the cloud and social data requires artificial intelligence. By mixing Cloud Foundry and the rich set of Watson services, IBM's Bluemix is the best cloud operating system for enterprises today, providing rapid development and deployment of applications that can take advantage of the rich catalog of Watson services to help drive insights from the vast t...
As DevOps methodologies expand their reach across the enterprise, organizations face the daunting challenge of adapting related cloud strategies to ensure optimal alignment, from managing complexity to ensuring proper governance. How can culture, automation, legacy apps and even budget be reexamined to enable this ongoing shift within the modern software factory?
SYS-CON Events announced today that Elastifile will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Elastifile Cloud File System (ECFS) is software-defined data infrastructure designed for seamless and efficient management of dynamic workloads across heterogeneous environments. Elastifile provides the architecture needed to optimize your hybrid cloud environment, by facilitating efficient...
While some vendors scramble to create and sell you a fancy solution for monitoring your spanking new Amazon Lambdas, hear how you can do it on the cheap using just built-in Java APIs yourself. By exploiting a little-known fact that Lambdas aren’t exactly single-threaded, you can effectively identify hot spots in your serverless code. In his session at @DevOpsSummit at 21st Cloud Expo, Dave Martin, Product owner at CA Technologies, will give a live demonstration and code walkthrough, showing how ...