Welcome!

@CloudExpo Authors: Zakia Bouachraoui, Elizabeth White, Liz McMillan, Pat Romanski, Roger Strukhoff

Related Topics: @CloudExpo, Adobe Flex, Eclipse, Recurring Revenue

@CloudExpo: Blog Post

Enterprise Cloud Design and Understanding Latency

Latency will affect the quality of your delivery in the cloud...

Tony Bishop Keynote at Cloud Expo

Design of enterprise clouds incorporate multiple dimensions (security, data,service brokering, infrastructure management, etc..) and one of the most critical to understand is the impact of latency. With Network vendors starting to provide 10GigE connections, switches and fabric, and given the exponentially increasing demand for bandwidth, enterprises will buy this equipment.

Design considerations for eterprise clouds must be aware and accomodate for applications that can gobble up ubiquitous and on-demand bandwidth of cloud delivery model. It is becoming clear that those responsible for the applications in datacenters AND responsible for building Cloud like delivery models should also be concerned about the proximity of collaborating applications and the number of hops critical transactions take.

The importance of this can be better visualized in FEET.

10Gig E means that the communication medium will transmit 10 billion bits per second, but what does a billionth of a second mean to a message? It means about 11 3/4 inches, almost a foot. A message response time of 40 milliseconds between two virtual machines, which would be considered important to achieve, translates to about 39 million feet, equaling about 7,451 miles, or about one third around the world. While this seems like plenty of speed to play with, it is important to remember how much wiring goes into a single computer (or network switch) and the time involved in message translation and protocol switching.

If an enterprise has two datacenters for high availability in a city, a typical distance between them might be 5-10 miles. If highly collaborative systems have been communicating between sites to service critical transactions due to some configuration oversights, it becomes quickly apparent that feet begin to matter. To further the complexities, disaster recovery strategies often require a 100-250 mile distance between the two sites; if consolidation strategies force the DR site to become active to save costs, careful design consideration needs to be given to how systems will interact over such distances in a cloud delivery paradigm:

  • While some mandates are irrevocably givens, such as DR site distances, there are circumstances that a datacenter team (including the application staff) can control to reduce excess lag.
  • Assess how many hops a complete end-to-end transaction takes between machines; it may surprise many to know that some inter-site hopping could have crept in. There are now tools that can explore an applications entire suite of connectivity. We have seen this used and when the reports are provided the application team is often most surprised at the results.
  • Know the critical applications that are especially latency sensitive, that also have high throughput, because rethinking their layout in a datacenter could save significant performance re-engineering.
  • For critical applications consider redeploying the servers on the floor so that all tiers of the application are in close proximity. While this is counter to current layout strategies, it is going to become more prevalent as budgets tighten and consolidation ensues.
  • The increasing use of XML related formats to transmit messages presents the problem of message bloat. Despite the use of these self describing messages, translations between XML formats often need to occur between systems. There is an emerging set of network appliances that can translate these messages at wire speed, saving server processing cycles and decreasing latency - while enhancing cloud like delivery experience.

To save precious FEET, an incredible FEAT of rethinking the datacenter in support of enterprise coud delivery models will be required.

Time and space are one fabric; in 1905 Einstein showed the relationship, 103 years later it is more relevant than ever.

More Stories By Tony Bishop

Blueprint4IT is authored by a longtime IT and Datacenter Technologist. Author of Next Generation Datacenters in Financial Services – Driving Extreme Efficiency and Effective Cost Savings. A former technology executive for both Morgan Stanley and Wachovia Securities.

CloudEXPO Stories
The precious oil is extracted from the seeds of prickly pear cactus plant. After taking out the seeds from the fruits, they are adequately dried and then cold pressed to obtain the oil. Indeed, the prickly seed oil is quite expensive. Well, that is understandable when you consider the fact that the seeds are really tiny and each seed contain only about 5% of oil in it at most, plus the seeds are usually handpicked from the fruits. This means it will take tons of these seeds to produce just one bottle of the oil for commercial purpose. But from its medical properties to its culinary importance, skin lightening, moisturizing, and protection abilities, down to its extraordinary hair care properties, prickly seed oil has got lots of excellent rewards for anyone who pays the price.
The platform combines the strengths of Singtel's extensive, intelligent network capabilities with Microsoft's cloud expertise to create a unique solution that sets new standards for IoT applications," said Mr Diomedes Kastanis, Head of IoT at Singtel. "Our solution provides speed, transparency and flexibility, paving the way for a more pervasive use of IoT to accelerate enterprises' digitalisation efforts. AI-powered intelligent connectivity over Microsoft Azure will be the fastest connected path for IoT innovators to scale globally, and the smartest path to cross-device synergy in an instrumented, connected world.
There are many examples of disruption in consumer space – Uber disrupting the cab industry, Airbnb disrupting the hospitality industry and so on; but have you wondered who is disrupting support and operations? AISERA helps make businesses and customers successful by offering consumer-like user experience for support and operations. We have built the world’s first AI-driven IT / HR / Cloud / Customer Support and Operations solution.
ScaleMP is presenting at CloudEXPO 2019, held June 24-26 in Santa Clara, and we’d love to see you there. At the conference, we’ll demonstrate how ScaleMP is solving one of the most vexing challenges for cloud — memory cost and limit of scale — and how our innovative vSMP MemoryONE solution provides affordable larger server memory for the private and public cloud. Please visit us at Booth No. 519 to connect with our experts and learn more about vSMP MemoryONE and how it is already serving some of the world’s largest data centers. Click here to schedule a meeting with our experts and executives.
Darktrace is the world's leading AI company for cyber security. Created by mathematicians from the University of Cambridge, Darktrace's Enterprise Immune System is the first non-consumer application of machine learning to work at scale, across all network types, from physical, virtualized, and cloud, through to IoT and industrial control systems. Installed as a self-configuring cyber defense platform, Darktrace continuously learns what is ‘normal' for all devices and users, updating its understanding as the environment changes.