Welcome!

@CloudExpo Authors: Liz McMillan, Elizabeth White, Pat Romanski, Yeshim Deniz, Aruna Ravichandran

Related Topics: @CloudExpo, Java IoT, Microservices Expo, Containers Expo Blog

@CloudExpo: Blog Post

High Availability, Fault Tolerance and Disaster Recovery in AWS

Introducing elastic cloud computing for Disaster Recovery, Fault Tolerance and High Availability

Amazon Web Services – Disaster Recovery, High Availability and Fault Tolerance

Abbreviations used:

  • AWS - Amazon Web Services
  • AMI - Amazon Machine Instance
  • DR - Disaster Recovery
  • FT - Fault Tolerance
  • HA - High Availability

Non-technical introduction.
H
igh Availability and Fault Tolerance – the requirement that a computer application be seemlessly available to users without interruption, literally “no (or very little) fault will be tolerated”. In simple speak, this means that I am able to use a computer application even though in the background there may be outages, for example hardware failure, network congestion or maximum CPU utilization.  The application is “highly available”, it  is available “(almost) all the time.”

Disaster Recovery – what it takes for your organization to recover from a computer disaster and be operational again. Simple example: suppose a hard-drive fails, do you need a duplicate hard-drive with an identical copy of the data available  within micro-seconds? Or can your application be unavailable to end-users while a new hard-drive is installed and data restored from a backup, knowing that there will be data missing between the time of the last backup and the failure of the hard-drive?

Organizations such as an “online auction company” and a “major search engine” cannot tolerate down-time nor data loss. Your personal computer, though, can likely tolerate some downtime and even data loss. Sometimes DR is automatic, when the primary hardware/software fails, the secondary automatically takes over; other times DR requires manual intervention.  Whichever you configure, depends on your tolerance for downtime. When considering FT and DR, there are two important terms:

  • Recovery Time Objective: how long it takes your organization to recover from an outage.
  • Recovery Point Objective:how much data can you afford to lose.

What does Fault Tolerance, High Availability and Disaster Recovery cost?
Organizations that require almost 100% availability and fractional if any data loss,  build redundant datacenters. Entire datacenters with hardware and software and identical copies of the appliction and data. Sometimes these extra datacenter(s) are used to offload traffic from the primary datacenter(s) during times of peak usage. Example, during the November/December shopping season or March/April tax season, companies like an “online auction company” and an “online tax company”, will offload some traffic from their primary servers to secondary servers. Other times, these extra datacenter(s) are simply sitting idle waiting for a disaster to occur at the primary datacenter. Hardware, software, electric power, air conditioning,  building rent and physical security all “just in case” or “when we need it. The invesment in the secondary datacenter(s) is up-front capital expenditure. Secondary datacenters are expensive for computing power that is often idle!

Introducing elastic cloud computing for Disaster Recovery, Fault Tolerance and High Availability.
What is an elastic band? A thin strip of rubber that stretches or contracts. If I need to bind three DVDs together before loaning them to a friend, the elastic band may stretch to perhaps 50% of capacity. If I  am loaning six or seven DVDs, the elastic band may stretch to maximum capacity, but either way I only need one elastic band, I don’t need to buy two. This concept illustrates the elasticity of cloud computing:  use and pay for computing services only when you need it.

In my above example, when tax season begins, “online tax company” can request and purchase computing services from a provider, such as Amazon Web Services,  and then at the end of tax season cease using and paying for those computing services. Thus “online tax company” can provide a HA tax processing service to their customers, because their primary datacenter(s) will not be overloaded. “Online tax company” will automatically scale out to a cloud provider such as Amazon as needed.  Secondly, the extra computing services provide FT, in case there is a disaster at their physical site during peak tax season.

High Availability, Fault Tolerance and Disaster Recovery in the Cloud
What about an organization that does not own a physical datacenter, but instead runs their entire operation in the cloud. How does their cloud provider provide FT, HA and DR? How does this compare to HA, FT and DR in physical datacenters?

What follows is a precis of two white-papers from Amazon Web Services, Building Fault Tolerant Applications on AWS and Using AWS for Disaster Recovery

This table is  a technical overview of AWS’s FT, HA and DR features compared to a physical environment:

Failure or fault

Physical server

Amazon Web Services

Server failure

To provide fault tolerance I need to have a second server on standby, with an identical copy of the application. I also need to re-direct traffic to the second server by changing the IP address of the second server to the IP address of the primary server.

I launch a new instance of my failed AMI from an AMI template using a script, an API call or the web console. I then map my elastic IP address to the new instance.  AWS CloudFormation allows me to create a collection of AMIs and resources.

Backups for FT

Physical backups often use tape or other mediume for duplication often stored offsite. Backup and Restore can be time consuming.

AWS backups are snapshots of an AMI that can be easily restored using command line or the web console in near instantaneous time.

Storage

If a physical server uses Network Attached Storage, the data is preserved if the server fails. If the server uses an internal drive, the drive is unavailable and potentially lost if the server fails.

Elastic Block Storage is separate from the AMI and persists even if the AMI does not. EBS is built on highly redundant storage that has a failure rate of 0.1 to 0.5% compared to 4% for a standard hard-drive.

IP addressing

An IP address is bound to a physical server and manual configuration is required to modify the IP address of a server.

AWS IP addresses are bound to an AWS account and separate from the AMI. They can be dynamically associated or disassociated from an AMI.

Scale/Growth for HA

To extend the capacity, while maintaining High Availability, of an application running on physical servers, I have to purchase more hardware, rackspace, electrical power and cooling. When I have excess capacity, these servers are idle, consume space, power and waste money.

To extend the capacity of an application running in an AWS cloud, I can use autoscaling which automatically adds AMIs to my capacity based on rules. Similary, I can terminate instances when no longer needed. This also allows me to refresh instances if they degrade.

Load Balancing for HA and FT

A physical load balancer balances traffic across known physical servers. It can detect a server is overloaded and direct traffic to other less utilized servers.

Elastic Load Balancing distributes traffic across AMIs, detects which AMIs may be less responsive and redirects traffic away from them until they are restored.

Multiple Geographies for HA

Physical servers are stored in datacenters around the world to provide HA.

AWS is distributed across geographic regions with Availability Zones within each region to provide HA.

Guaranteed Failover and FT

An organization that purchases its own physical servers is guaranteed failover to those servers.

An AWS customer can purchase Reserved AMIs that are guaranteed to the customer, regardless of what overall load AWS  may experience.

An AWS customer can purchase Reserved AMIs that are guaranteed to the customer, regardless of what overall load AWS  may experience.

I can maintain a physical data center and use the AWS as needed. There are four configuration options.

  1. AWS as backup - I can back up my physical environment to AWS using DirectConnect or AWS import/export, thus using AWS as for backup.
  2. Minimal AWS - In this scenario I have core services permanently running in AWS, for example copies of my data/databases. In case of failure of my physical datacenter, I need to startup AMIs that contain my applications that then connect to my redundant datastores in AWS and modify DNS settings to route traffic to AWS.
  3. Partial AWS - In this scenario I have a complete duplicate of my services permanently running in AWS, but on a minimal number of AMIs. In case of failure of my physical datacenter, I scale up the configuration of my AMIs to cope with the increased load.
  4. Complete AWS - In this scenario I have a complete duplicated configuration of my physical datacenter in AWS. I can use weighted 53 DNS service from AWS to redirect traffic, application logic to use theAWS datastores and EC2 auto-scaling to grow capacity within AWS.

More Stories By Jonathan Gershater

Jonathan Gershater has lived and worked in Silicon Valley since 1996, primarily doing system and sales engineering specializing in: Web Applications, Identity and Security. At Red Hat, he provides Technical Marketing for Virtualization and Cloud. Prior to joining Red Hat, Jonathan worked at 3Com, Entrust (by acquisition) two startups, Sun Microsystems and Trend Micro.

(The views expressed in this blog are entirely mine and do not represent my employer - Jonathan).

@CloudExpo Stories
Gemini is Yahoo’s native and search advertising platform. To ensure the quality of a complex distributed system that spans multiple products and components and across various desktop websites and mobile app and web experiences – both Yahoo owned and operated and third-party syndication (supply), with complex interaction with more than a billion users and numerous advertisers globally (demand) – it becomes imperative to automate a set of end-to-end tests 24x7 to detect bugs and regression. In th...
Today most companies are adopting or evaluating container technology - Docker in particular - to speed up application deployment, drive down cost, ease management and make application delivery more flexible overall. As with most new architectures, this dream takes significant work to become a reality. Even when you do get your application componentized enough and packaged properly, there are still challenges for DevOps teams to making the shift to continuous delivery and achieving that reducti...
As people view cloud as a preferred option to build IT systems, the size of the cloud-based system is getting bigger and more complex. As the system gets bigger, more people need to collaborate from design to management. As more people collaborate to create a bigger system, the need for a systematic approach to automate the process is required. Just as in software, cloud now needs DevOps. In this session, the audience can see how people can solve this issue with a visual model. Visual models ha...
Microsoft Azure Container Services can be used for container deployment in a variety of ways including support for Orchestrators like Kubernetes, Docker Swarm and Mesos. However, the abstraction for app development that support application self-healing, scaling and so on may not be at the right level. Helm and Draft makes this a lot easier. In this primarily demo-driven session at @DevOpsSummit at 21st Cloud Expo, Raghavan "Rags" Srinivas, a Cloud Solutions Architect/Evangelist at Microsoft, wi...
Nordstrom is transforming the way that they do business and the cloud is the key to enabling speed and hyper personalized customer experiences. In his session at 21st Cloud Expo, Ken Schow, VP of Engineering at Nordstrom, will discuss some of the key learnings and common pitfalls of large enterprises moving to the cloud. This includes strategies around choosing a cloud provider(s), architecture, and lessons learned. In addition, he’ll go over some of the best practices for structured team migr...
Coca-Cola’s Google powered digital signage system lays the groundwork for a more valuable connection between Coke and its customers. Digital signs pair software with high-resolution displays so that a message can be changed instantly based on what the operator wants to communicate or sell. In their Day 3 Keynote at 21st Cloud Expo, Greg Chambers, Global Group Director, Digital Innovation, Coca-Cola, and Vidya Nagarajan, a Senior Product Manager at Google, will discuss how from store operations...
SYS-CON Events announced today that IBM has been named “Diamond Sponsor” of SYS-CON's 21st Cloud Expo, which will take place on October 31 through November 2nd 2017 at the Santa Clara Convention Center in Santa Clara, California.
SYS-CON Events announced today that Ryobi Systems will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Ryobi Systems Co., Ltd., as an information service company, specialized in business support for local governments and medical industry. We are challenging to achive the precision farming with AI. For more information, visit http:...
As you move to the cloud, your network should be efficient, secure, and easy to manage. An enterprise adopting a hybrid or public cloud needs systems and tools that provide: Agility: ability to deliver applications and services faster, even in complex hybrid environments Easier manageability: enable reliable connectivity with complete oversight as the data center network evolves Greater efficiency: eliminate wasted effort while reducing errors and optimize asset utilization Security: imple...
High-velocity engineering teams are applying not only continuous delivery processes, but also lessons in experimentation from established leaders like Amazon, Netflix, and Facebook. These companies have made experimentation a foundation for their release processes, allowing them to try out major feature releases and redesigns within smaller groups before making them broadly available. In his session at 21st Cloud Expo, Brian Lucas, Senior Staff Engineer at Optimizely, will discuss how by using...
The next XaaS is CICDaaS. Why? Because CICD saves developers a huge amount of time. CD is an especially great option for projects that require multiple and frequent contributions to be integrated. But… securing CICD best practices is an emerging, essential, yet little understood practice for DevOps teams and their Cloud Service Providers. The only way to get CICD to work in a highly secure environment takes collaboration, patience and persistence. Building CICD in the cloud requires rigorous ar...
Transforming cloud-based data into a reportable format can be a very expensive, time-intensive and complex operation. As a SaaS platform with more than 30 million global users, Cornerstone OnDemand’s challenge was to create a scalable solution that would improve the time it took customers to access their user data. Our Real-Time Data Warehouse (RTDW) process vastly reduced data time-to-availability from 24 hours to just 10 minutes. In his session at 21st Cloud Expo, Mark Goldin, Chief Technolo...
In this strange new world where more and more power is drawn from business technology, companies are effectively straddling two paths on the road to innovation and transformation into digital enterprises. The first path is the heritage trail – with “legacy” technology forming the background. Here, extant technologies are transformed by core IT teams to provide more API-driven approaches. Legacy systems can restrict companies that are transitioning into digital enterprises. To truly become a lead...
SYS-CON Events announced today that CAST Software will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CAST was founded more than 25 years ago to make the invisible visible. Built around the idea that even the best analytics on the market still leave blind spots for technical teams looking to deliver better software and prevent outages, CAST provides the software intelligence that matter ...
SYS-CON Events announced today that Daiya Industry will exhibit at the Japanese Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Ruby Development Inc. builds new services in short period of time and provides a continuous support of those services based on Ruby on Rails. For more information, please visit https://github.com/RubyDevInc.
When it comes to cloud computing, the ability to turn massive amounts of compute cores on and off on demand sounds attractive to IT staff, who need to manage peaks and valleys in user activity. With cloud bursting, the majority of the data can stay on premises while tapping into compute from public cloud providers, reducing risk and minimizing need to move large files. In his session at 18th Cloud Expo, Scott Jeschonek, Director of Product Management at Avere Systems, discussed the IT and busine...
Is advanced scheduling in Kubernetes achievable? Yes, however, how do you properly accommodate every real-life scenario that a Kubernetes user might encounter? How do you leverage advanced scheduling techniques to shape and describe each scenario in easy-to-use rules and configurations? In his session at @DevOpsSummit at 21st Cloud Expo, Oleg Chunikhin, CTO at Kublr, will answer these questions and demonstrate techniques for implementing advanced scheduling. For example, using spot instances ...
As businesses evolve, they need technology that is simple to help them succeed today and flexible enough to help them build for tomorrow. Chrome is fit for the workplace of the future — providing a secure, consistent user experience across a range of devices that can be used anywhere. In her session at 21st Cloud Expo, Vidya Nagarajan, a Senior Product Manager at Google, will take a look at various options as to how ChromeOS can be leveraged to interact with people on the devices, and formats th...
First generation hyperconverged solutions have taken the data center by storm, rapidly proliferating in pockets everywhere to provide further consolidation of floor space and workloads. These first generation solutions are not without challenges, however. In his session at 21st Cloud Expo, Wes Talbert, a Principal Architect and results-driven enterprise sales leader at NetApp, will discuss how the HCI solution of tomorrow will integrate with the public cloud to deliver a quality hybrid cloud e...
SYS-CON Events announced today that Yuasa System will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Yuasa System is introducing a multi-purpose endurance testing system for flexible displays, OLED devices, flexible substrates, flat cables, and films in smartphones, wearables, automobiles, and healthcare.