Welcome!

@CloudExpo Authors: Roger Strukhoff, Yeshim Deniz, Pat Romanski, Zakia Bouachraoui, Elizabeth White

Related Topics: @CloudExpo

@CloudExpo: Article

Unity Builds Its Federated Cloud with OpenNebula

Based on SoftLayer, Ceph, Ubuntu and AWS

Unity Technologies is shaping a booming global games market. The Unity engine is far and away the dominant global game development software. More games are made with Unity than with any other game technology! And guess what? Unity uses OpenNebula to run their IaaS infrastructure to support their development services, among other things.

Unity Technologies contacted OpenNebula Systems, the company behind OpenNebula, due to its expert knowledge of OpenNebula, to jointly design and deploy Unity cloud infrastructure, dubbed uCloud. OpenNebula Systems offers this service through the Jumpstart packages, on their Basic and Advanced modalities, based on the different Open Cloud Reference Architecture corresponding types.

The basic principle that Unity applies to their infrastructure is the KISS approach, which is very much aligned with the OpenNebula design principle.

The Requirements
Unity Technologies offers its services globally, and as such required to deploy a cloud across three different data centers to serve EMEA, US and ASIA Unity users. The data centers were to be based on SoftLayer bare metal servers, and the users of the Cloud were expected to be able to access resources across these different data centers.

Regarding networking, a certain degree of federation was expected, particularly the ability to interconnect virtual machines from different data centers in different virtual networks. Unity Technologies suggested the use of network gateways to manage this interconnections, so the challenge was to integrate them in the OpenNebula workflow.

Other requirements were the use of Active Directory to authenticate users, and also to have a complete isolation between groups of users (that is, the workloads of one group of users should not affect the others), as well as hybrid access to public cloud providers, in particular SoftLayer and Amazon EC2, to be able to cloud burst Virtual Machine to them in case the allocated bare metal in SoftLayer cannot cope with the fluctuating demands.

The Design
OpenNebula Systems and Unity got to work right away, to deliver the best possible OpenNebula cloud design taking into account the requirements. Take a look at the picture to get a glimpse of the final design of uCloud.

unity

The use of Ceph was a no brainer, Unity used Ceph internally and OpenNebula Systems agreed right away since this cloud is expected to grow to a medium to large scale. This is aligned with the OpenNebula Advanced Reference Architecture, intended for clouds of this magnitude. Also, Ubuntu was preferred by Unity sysadmins, and given OpenNebula full support for it; the decision was arrived to easily enough as well.

Using OpenNebula federation capabilities solved right away the need to federate at the authentication level the different datacenters. The SoftLayer dedicated link low latency allowed the several instances of OpenNebula (one per data center) to communicate quickly enough to keep them synchronized and provide a top-notch user experience.

The need of serving different groups of people, with different needs in terms of physical and virtual resources, was also solved using the powerful OpenNebula provisioning model, by assigning physical resources to Virtual Data Centers, and providing access to them via Groups of users, to which virtual resources can be assigned.

Networking was trickier. The limitations of using only traffic encapsulated within VLANs imposed the use of VXLAN, which OpenNebula fully supports. Special integrations were made into OpenNebula to operate the Gateways as soon as a new virtual network is created; so new routes are created dynamically enabling the interconnection of different data centers virtual networks on demand. The OpenNebula flexible architecture proved that it is a great asset to solve complex designs.

Cgroups was the technology picked up for workload isolation, so VMs from one groups of users cannot eat up all the CPU resources if they are needed by another VMs. For memory, not allowing for over commitment was the decision.

The Result
uCloud is a state of the art cloud, with authentication and network federation, prepared to scale to support thousands and even millions of users as Unity Technology requires. Unity Technologies can arguably be given the credit of making the right call, contacting OpenNebula Systems, the creators of the technology, to push it to its limits to create a cloud infrastructure ahead of its time.

"We engaged OpenNebula Systems to verify our design thoughts and to speed up the deployment phase of our uCloud project.", said Karsten Nielsen, IT Manager at Unity Technologies. "OpenNebula Systems is very professional and executed within the tight death-line the project was under. I am very pleased with the process and the result of the project."

This is post is a reprint of a post published at the OpenNebula blog


More Stories By Ignacio M. Llorente

Dr. Llorente is Director of the OpenNebula Project and CEO & co-founder at C12G Labs. He is an entrepreneur and researcher in the field of cloud and distributed computing, having managed several international projects and initiatives on Cloud Computing, and authored many articles in the leading journals and proceedings books. Dr. Llorente is one of the pioneers and world's leading authorities on Cloud Computing. He has held several appointments as independent expert and consultant for the European Commission and several companies and national governments. He has given many keynotes and invited talks in the main international events in cloud computing, has served on several Groups of Experts on Cloud Computing convened by international organizations, such as the European Commission and the World Economic Forum, and has contributed to several Cloud Computing panels and roadmaps. He founded and co-chaired the Open Grid Forum Working Group on Open Cloud Computing Interface, and has participated in the main European projects in Cloud Computing. Llorente holds a Ph.D in Computer Science (UCM) and an Executive MBA (IE Business School), and is a Full Professor (Catedratico) and the Head of the Distributed Systems Architecture Group at UCM.

CloudEXPO Stories
As you know, enterprise IT conversation over the past year have often centered upon the open-source Kubernetes container orchestration system. In fact, Kubernetes has emerged as the key technology -- and even primary platform -- of cloud migrations for a wide variety of organizations. Kubernetes is critical to forward-looking enterprises that continue to push their IT infrastructures toward maximum functionality, scalability, and flexibility. As they do so, IT professionals are also embracing the reality of Serverless architectures, which are critical to developing and operating real-time applications and services. Serverless is particularly important as enterprises of all sizes develop and deploy Internet of Things (IoT) initiatives.
Signs of a shift in the usage of public clouds are everywhere. Previously, as organizations outgrew old IT methods, the natural answer was to try the public cloud approach; however, the public platform alone is not a complete solution. Complaints include unpredictable/escalating costs and mounting security concerns in the public cloud. Ultimately, public cloud adoption can ultimately mean a shift of IT pains instead of a resolution. That's why the move to hybrid, custom, and multi-cloud will become more and more prevalent. At the heart of this technology trend exists a custom solution to meet the needs and concerns of enterprise organizations, including compliance, security, and cost issues. The "new normal" of enterprise clients is a world of hybrid and multi-cloud solutions, and it is slowly changing the IT technology landscape. Better tools, better management, and easier adoption a...
The Japan External Trade Organization (JETRO) is a non-profit organization that provides business support services to companies expanding to Japan. With the support of JETRO's dedicated staff, clients can incorporate their business; receive visa, immigration, and HR support; find dedicated office space; identify local government subsidies; get tailored market studies; and more.
While a hybrid cloud can ease that transition, designing and deploy that hybrid cloud still offers challenges for organizations concerned about lack of available cloud skillsets within their organization. Managed service providers offer a unique opportunity to fill those gaps and get organizations of all sizes on a hybrid cloud that meets their comfort level, while delivering enhanced benefits for cost, efficiency, agility, mobility, and elasticity.
Signs of a shift in the usage of public clouds are everywhere Previously, as organizations outgrew old IT methods, the natural answer was to try the public cloud approach; however, the public platform alone is not a complete solutionThe move to hybrid, custom, and multi-cloud will become more and more prevalent At the heart of this technology trend exists a custom solution to meet the needs and concerns of these organizations, including compliance, security, and cost issues Blending Service and Deployment Models