|By Roger Strukhoff||
|May 18, 2015 08:00 AM EDT||
The PC revolution has redefined the notion of a computer over the past four decades. Now it might be time to redefine the notion of a collection of computers, that is, to redefine the notion of a datacenter.
Datacenters are thought of as big places. Some of the more recent plants used by mega-users like Google, Amazon, Microsoft, and Facebook have acres of land under roof, with many tens of thousands of individual systems and power requirements that would support a small city.
Even your friendly local, on-site enterprise datacenter is likely to be a big room with a big budget commitment and a lot of people hired to manage it
But what if a datacenter could fit in the corner of a room, or under a desk, or in the palm of your hand?
This seems to be the direction we're headed, as data loads simultaneously grow exponentially and become ever more distributed. This is also part of the vision I saw and heard outlined at the recent Open Compute Summit in San Jose.
Transparency as a Service
The summit was sponsored by The Open Compute Project Foundation, with a goal "to design and enable the delivery of the most efficient server, storage and data center hardware designs for scalable computing," according to its mission statement. Members strive to share ideas, specs, and intellectual property in an open environment. The foundation is keyed by Facebook and the company's commitment to transparency in how it builds out the massive datacenter infrastructure it requires.
One significant announcement at the summit was made by Vapor.io and company CEO Cole Crawford. The company aims for nothing less than utter transformation of the datacenter, starting with a programmable, open-source based management solution at the top of the stack.
Crawford and Chief Architect Steven White envision a modern, data-driven datacenter in which servers are "cattle, not pets," following the still-new concept of software-defined servers and centers. "The Open Data Center Runtime Environment is the first accepted contribution to the Open Compute Foundation using the reciprocal license thus ensuring that forks and branches won't exist," according to Vapor.io. "We did this to ensure that when you are interacting with your data center, you're communicating over a community owned, community standard.
The company's ultimate vision is a modern hardware configuration that brings new levels of efficiency and output to datacenters of all sizes.
Mobility & Then the IoT
The fast-growing global dataflow has mobility as today's primary driver. The proliferation of tablets and especially smartphones on a worldwide basis will cause the total amount of data being processed by the Internet to exceed a zettabyte (1 billion terabytes) annually this year or next. That's more than 30 terabytes per second.
Smartphone ownership will reach into the billions soon enough, and even in many developing countries, such as the Philippines, there are now more mobile phones than people.
But we ain't seen nuttin' yet-the Internet of Things (IoT) will be adding billions of new devices to the global Internet soon enough. Though much of the traffic it generates will be hyper-local (via Bluetooth and other short-range technologies), enough of it will be traveling along the Internet to increase global bandwidth to the dozens of zettabytes by the year 2020, according to Gartner and others.
Think of it as cloud computing to the nth degree in all dimensions. Think of the phrase made famous by Sun Microsystems-"the network is the computer"--extending out to "the edge of the network is your computer."
The edge of the network seems to me to be much like the edge of the universe, that is, there is no such thing to the single observer. One person's edge is another's center. Cyberspace expands outward from wherever you are, and you will expect the same performance (some day) for your single device or your enterprise no matter where you are.
Big, bulky, centralized data centers cannot provide this edge service ubiquitously and effectively. There is also the matter of energy consumption. Datacenters were using about 2% of all electricity consumption in the US in 2011-that number has certainly risen since then, although it did not rise as quickly as the EPA had originally estimated for the period 2007-11.
Focus on Power Consumption
But let's not get distracted by this particular metric. The big picture is one that features global power consumption and the aspiration of billions of people in developing nations to have better lives.
As I've written about many times, and about which much of our research at the Tau Institute is focused, developing nations typically consume 3 to 5% of the electricity per-person of the developed world.
We believe that an aggressive national commitment to IT is a primary indicator of sustained economic and societal growth. To achieve significant economic improvement therefore means we must achieve significant new efficiencies in power consumption.
The vision laid out by Vapor.io seems to be a positive step in this direction. Crawford says the technology, which already has its first customer in Indiana in the US, aims for a PUE of 1.1, compared to an industry average of 1.9 (PUE, or power usage effectiveness, is a simple measure of the ratio of total energy required by a datacenter divided by the amount used by the computing resources. The overhead is primarily eaten up by air-conditioning.
Crawford and team go further, asserting that a new metric needs to be put into place. The metric would be called performance per watt per dollar, or PWD.
New efficiencies and new metrics are one big part of the puzzle. Another big part takes us back to the question near the beginning of this article. What if I could hold a datacenter in my hand? When will I be able to do this?
For now, the direction is being set. The world will need more mega-datacenter technology in smaller urban spaces, as mobility and the IoT inexorably drive dataflows upward. It will also need as much cloud-driven technology within buildings and some day, per person, as we can imagine.
The Software World
The third big piece of the puzzle involves the software that's eating the world, in the phrase made notorious by Mark Andreessen in the Wall Street Journal in 2011. The world of cloud computing is a world of virtualization, containers, languages, platforms, architectures, and many things as-a-service.
It is a world that is not familiar to many people in the world of datacenters. A grand conversation is beginning to take place, and will need to intensify dramatically to sync up where the world of data is going and where the world of datacenters should be going.
The financial services market is one of the most data-driven industries in the world, yet it’s bogged down by legacy CPU technologies that simply can’t keep up with the task of querying and visualizing billions of records. In his session at 20th Cloud Expo, Jared Parker, Director of Financial Services at Kinetica, will discuss how the advent of advanced in-database analytics on the GPU makes it possible to run sophisticated data science workloads on the same database that is housing the rich inf...
Mar. 25, 2017 10:45 PM EDT Reads: 3,609
For organizations that have amassed large sums of software complexity, taking a microservices approach is the first step toward DevOps and continuous improvement / development. Integrating system-level analysis with microservices makes it easier to change and add functionality to applications at any time without the increase of risk. Before you start big transformation projects or a cloud migration, make sure these changes won’t take down your entire organization.
Mar. 25, 2017 09:45 PM EDT Reads: 3,547
My team embarked on building a data lake for our sales and marketing data to better understand customer journeys. This required building a hybrid data pipeline to connect our cloud CRM with the new Hadoop Data Lake. One challenge is that IT was not in a position to provide support until we proved value and marketing did not have the experience, so we embarked on the journey ourselves within the product marketing team for our line of business within Progress. In his session at @BigDataExpo, Sum...
Mar. 25, 2017 08:45 PM EDT Reads: 2,746
Apache Hadoop is emerging as a distributed platform for handling large and fast incoming streams of data. Predictive maintenance, supply chain optimization, and Internet-of-Things analysis are examples where Hadoop provides the scalable storage, processing, and analytics platform to gain meaningful insights from granular data that is typically only valuable from a large-scale, aggregate view. One architecture useful for capturing and analyzing streaming data is the Lambda Architecture, represent...
Mar. 25, 2017 08:45 PM EDT Reads: 5,932
SYS-CON Events announced today that Ocean9will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Ocean9 provides cloud services for Backup, Disaster Recovery (DRaaS) and instant Innovation, and redefines enterprise infrastructure with its cloud native subscription offerings for mission critical SAP workloads.
Mar. 25, 2017 05:15 PM EDT Reads: 1,925
Adding public cloud resources to an existing application can be a daunting process. The tools that you currently use to manage the software and hardware outside the cloud aren’t always the best tools to efficiently grow into the cloud. All of the major configuration management tools have cloud orchestration plugins that can be leveraged, but there are also cloud-native tools that can dramatically improve the efficiency of managing your application lifecycle.
Mar. 25, 2017 04:00 PM EDT Reads: 2,829
DevOps is often described as a combination of technology and culture. Without both, DevOps isn't complete. However, applying the culture to outdated technology is a recipe for disaster; as response times grow and connections between teams are delayed by technology, the culture will die. A Nutanix Enterprise Cloud has many benefits that provide the needed base for a true DevOps paradigm. In his Day 3 Keynote at 20th Cloud Expo, Chris Brown, a Solutions Marketing Manager at Nutanix, will explore t...
Mar. 25, 2017 03:00 PM EDT Reads: 2,716
SYS-CON Events announced today that Technologic Systems Inc., an embedded systems solutions company, will exhibit at SYS-CON's @ThingsExpo, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Technologic Systems is an embedded systems company with headquarters in Fountain Hills, Arizona. They have been in business for 32 years, helping more than 8,000 OEM customers and building over a hundred COTS products that have never been discontinued. Technologic Systems’ pr...
Mar. 25, 2017 01:45 PM EDT Reads: 3,284
SYS-CON Events announced today that CA Technologies has been named “Platinum Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY, and the 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. CA Technologies helps customers succeed in a future where every business – from apparel to energy – is being rewritten by software. From ...
Mar. 25, 2017 01:30 PM EDT Reads: 1,706
The taxi industry never saw Uber coming. Startups are a threat to incumbents like never before, and a major enabler for startups is that they are instantly “cloud ready.” If innovation moves at the pace of IT, then your company is in trouble. Why? Because your data center will not keep up with frenetic pace AWS, Microsoft and Google are rolling out new capabilities In his session at 20th Cloud Expo, Don Browning, VP of Cloud Architecture at Turner, will posit that disruption is inevitable for c...
Mar. 25, 2017 01:15 PM EDT Reads: 2,039
SYS-CON Events announced today that Cloudistics, an on-premises cloud computing company, has been named “Bronze Sponsor” of SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Cloudistics delivers a complete public cloud experience with composable on-premises infrastructures to medium and large enterprises. Its software-defined technology natively converges network, storage, compute, virtualization, and management into a ...
Mar. 25, 2017 12:45 PM EDT Reads: 1,874
Deep learning has been very successful in social sciences and specially areas where there is a lot of data. Trading is another field that can be viewed as social science with a lot of data. With the advent of Deep Learning and Big Data technologies for efficient computation, we are finally able to use the same methods in investment management as we would in face recognition or in making chat-bots. In his session at 20th Cloud Expo, Gaurav Chakravorty, co-founder and Head of Strategy Development ...
Mar. 25, 2017 12:45 PM EDT Reads: 3,477
SYS-CON Events announced today that Loom Systems will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. Founded in 2015, Loom Systems delivers an advanced AI solution to predict and prevent problems in the digital business. Loom stands alone in the industry as an AI analysis platform requiring no prior math knowledge from operators, leveraging the existing staff to succeed in the digital era. With offices in S...
Mar. 25, 2017 12:30 PM EDT Reads: 1,171
The explosion of new web/cloud/IoT-based applications and the data they generate are transforming our world right before our eyes. In this rush to adopt these new technologies, organizations are often ignoring fundamental questions concerning who owns the data and failing to ask for permission to conduct invasive surveillance of their customers. Organizations that are not transparent about how their systems gather data telemetry without offering shared data ownership risk product rejection, regu...
Mar. 25, 2017 12:30 PM EDT Reads: 5,058
What if you could build a web application that could support true web-scale traffic without having to ever provision or manage a single server? Sounds magical, and it is! In his session at 20th Cloud Expo, Chris Munns, Senior Developer Advocate for Serverless Applications at Amazon Web Services, will show how to build a serverless website that scales automatically using services like AWS Lambda, Amazon API Gateway, and Amazon S3. We will review several frameworks that can help you build serverle...
Mar. 25, 2017 12:30 PM EDT Reads: 1,805
Interoute has announced the integration of its Global Cloud Infrastructure platform with Rancher Labs’ container management platform, Rancher. This approach enables enterprises to accelerate their digital transformation and infrastructure investments. Matthew Finnie, Interoute CTO commented “Enterprises developing and building apps in the cloud and those on a path to Digital Transformation need Digital ICT Infrastructure that allows them to build, test and deploy faster than ever before. The int...
Mar. 25, 2017 11:15 AM EDT Reads: 834
SYS-CON Events announced today that SoftLayer, an IBM Company, has been named “Gold Sponsor” of SYS-CON's 18th Cloud Expo, which will take place on June 7-9, 2016, at the Javits Center in New York, New York. SoftLayer, an IBM Company, provides cloud infrastructure as a service from a growing number of data centers and network points of presence around the world. SoftLayer’s customers range from Web startups to global enterprises.
Mar. 25, 2017 11:15 AM EDT Reads: 1,537
SYS-CON Events announced today that CrowdReviews.com has been named “Media Sponsor” of SYS-CON's 20th International Cloud Expo, which will take place on June 6–8, 2017, at the Javits Center in New York City, NY. CrowdReviews.com is a transparent online platform for determining which products and services are the best based on the opinion of the crowd. The crowd consists of Internet users that have experienced products and services first-hand and have an interest in letting other potential buyers...
Mar. 25, 2017 11:00 AM EDT Reads: 3,552
SYS-CON Events announced today that T-Mobile will exhibit at SYS-CON's 20th International Cloud Expo®, which will take place on June 6-8, 2017, at the Javits Center in New York City, NY. As America's Un-carrier, T-Mobile US, Inc., is redefining the way consumers and businesses buy wireless services through leading product and service innovation. The Company's advanced nationwide 4G LTE network delivers outstanding wireless experiences to 67.4 million customers who are unwilling to compromise on ...
Mar. 25, 2017 10:45 AM EDT Reads: 2,091
@DevOpsSummit has been named the ‘Top DevOps Influencer' by iTrend. iTrend processes millions of conversations, tweets, interactions, news articles, press releases, blog posts - and extract meaning form them and analyzes mobile and desktop software platforms used to communicate, various metadata (such as geo location), and automation tools. In overall placement, @DevOpsSummit ranked as the number one ‘DevOps Influencer' followed by @CloudExpo at third, and @MicroservicesE at 24th.
Mar. 25, 2017 10:30 AM EDT Reads: 10,277