Welcome!

@CloudExpo Authors: Zakia Bouachraoui, Elizabeth White, Yeshim Deniz, Liz McMillan, Pat Romanski

Related Topics: @CloudExpo, Microservices Expo, Containers Expo Blog

@CloudExpo: Article

Shelton Shugar Says Yahoo! Already a Major Cloud Computing User

Lays Out Details at 4th International Cloud Computing Expo

Yahoo! SVP Shelton Shugar, speaking at the 4th International Cloud Computing Expo, outlined some of the detail involved in serving 600 million users per month while handling hundreds of petabytes of data.

"We are building a private cloud to be used within Yahoo!," he said. Hundreds of applications have already been migrated to the cloud, he said, noting that "we are (now) focusing on the data processing environment and serving environment."

"This is a long-term activity. started a few years ago," Shugar said. "And prior to cloud we might have had to literally forklift machines and move them when we want to move capacity. With cloud serving we are building a flat network and can basically point and click and move capacity from one place to another."

Shugar outlined five areas of emphasis:

Edge services - where the company deploys around the edges of the netwrok to speed content delivery.

Cloud serving - involves hosting applications. automated provisioning, and "we allow through a declarative language to define an app through tiers of an architecture," Shugar said. "Tiers can be as big or small as you need and can adjust over time. We can use the language to define connectivity, and can clone a collection of tiers."

Storage - All of the online servers have RESTful APIs, "so are easy to use," Shugar said. "We can support a variety of consistency models, and there's a lot of similarity between and among our services." He also mentioned the company's "MOBstore" (mass object store) capability, which takes objects ranging in size from a megabyte to a couple of gigabytes, which are assumed to be immutable. He also noted the use of the company's "Sherpa" funcitonality," so I dont' have legions of developers trying their own schemas, etc. They write a few API calls and it's done," he said. "It's a great way to drive innovation."

Batch processing - This is the data warehouse, and where Hadoop comes into play. "We started developing this a few years ago, and ran on about 20 machines," Shugar said. "Today we run on tens of thousands of machines, with 80 petabytes of storage. We have upwards of 1000 people trained on it, and hundreds of applications on it. It let's us pull together thousands of computers and say hey 'you're one file.'"

Shugar also described "a new language called PIG (not an acryonm) that's a higher-level procedural language. The amount of code you write is very small, while adding metadata, workflow, data management, etc."

Data collection - "This is a set of services that allow us to collect content from our web servers, platforms, and search," Shugar said.. "It cleans it up all the data, pulls out out the bot traffic, etc."

Shugar went on to provide some use cases. One example was the home page. As Shugar noted, "when you type in yahoo.com you are going through our cloud. We look at user behavior through Hadoop and determine which are the most interesting articles for folks, a feedback loop to improve the consumer experience by selecting content the consumer is interested in." Through this method, "clickthroughs are up," Shugar said. "The consumers win because they get what they want, we win because we get more advertising."

Cloud Computing Expo 2010 East to Attract More Than 5,000 Delegates from 48 Countries
SYS-CON Events announced today that the 5th International Cloud Computing Conference & Expo will take place April 19-20-21, 2010, at the Jacob Javits Convention Center in New York City.

The International Cloud Computing Conference & Expo series is the world's leading Cloud-focused event and is held three times a year, in New York, Silicon Valley and in Europe. Over 200 corporate sponsors and 10,000 industry professionals have participated in Cloud Computing Expo since its inception, more than all other Cloud-related events put together.

The three-day event will offer a rich array of sessions led by exceptional speakers about the business and technical value of cloud computing with more than 80 sponsors and exhibitors on the 70,000 sq. ft. show floor and over 5,000 estimated delegates from well over 48 different countries.

4th International Cloud Computing Conference & Expo
At the 4th International Cloud Computing Conference & Expo, November 2-4, 2009, being held in the Santa Clara Convention Center, Santa Clara, CA, more than 2,000 delegates will find out how cloud computing is transforming the way that enterprises everywhere build and deploy applications.

Now held three times a year -- in New York, Prague, and Santa Clara -- the Cloud Computing Conference & Expo series is the fastest-growing Enterprise IT event in the past 10 years, devoted to every aspect of delivering massively scalable enterprise IT as a service. The event is co-located with our 7th International Virtualization Conference & Expo.

4th International Cloud Computing Conference & Expo Keynotes
Cloud Computing Expo 2009 West keynotes, November 2-3, 2009, in the Santa Clara Convention Center, Santa Clara, CA, will be delivered by Richard Marcello, Unisys President of Systems & Technology; Shelton Shugar, Yahoo! SVP Cloud Computing; and Richard Sarwal, Oracle VP of Development for Enterprise Manager.

Delegate Registration Options
Cloud Computing Expo (www.CloudComputingExpo.com) delegates can pre-register for the conference online with $800 savings here: https://www3.sys-con.com/cloud1109/registernew.cfm

 

Sponsorship Opportunities
Sponsorship and Exhibit opportunities can be obtained from Carmen Gonzalez by email at events (at) sys-con.com, by phone 201 802 3021.

SYS-CON's International Cloud Computing Conference & Expo, held each year in California, New York and Prague is the leading event covering the fast-emerging Cloud Computing market for Enterprise IT professionals. Co-located with the International Virtualization Conference & Expo, the combined event delivers the #1 i-technology educational and networking opportunity of the year for those seeking to establish a market lead anywhere in the multiple layers of the Cloud Computing ecosystem.

About SYS-CON Media & Events
SYS-CON Media (www.sys-con.com) has since 1994 been connecting technology companies and customers 24x7x365 through a comprehensive content stream at www.SYS-CON.com -- focused on 35 main subject areas, from Cloud Computing to Web Security -- interwoven with market leading full-scale conferences produced by SYS-CON Events. The company's internationally recognized brands include among others Cloud Computing Expo (www.CloudComputingExpo.com), Virtualization Conference & Expo (www.VirtualizationConference.com), Government IT Conference & Expo (www.GovITExpo.com), Cloud Computing Bootcamp (www.CloudComputingBootcamp.com), Cloud Expo Europe (www.CloudExpo-Europe.com) and now UlitzerLive! New Media Conference & Expo (www.UlitzerLive.com).

SOURCE: Ulitzer, Inc.

Contacts:

Delegate & Attendee Inquiries
Corinna Melcon
Corinna (at) sys-con.com
http://corinnamelcon.ulitzer.com
201 802 3019

Conference Faculty Inquiries
Jeremy Geelan
Jeremy (at) sys-con.com
http://jeremygeelan.ulitzer.com
201 802 3026

Sponsorship and Exhibit Opportunities
Carmen Gonzalez
Carmen (at) sys-con.com
http://carmengonzalez.ulitzer.com
201 802 2021

Expo Floor Sales
Megan Mussa
Megan (at) sys-con.com
http://meganmussa.ulitzer.com
201 802 3020

Website and General Inquiries
Krisandra Russo
Krisandra (at) sys-con.com
http://krisandrarusso.ulitzer.com
201 802 3020

More Stories By Roger Strukhoff

Roger Strukhoff (@IoT2040) is Executive Director of the Tau Institute for Global ICT Research, with offices in Illinois and Manila. He is Conference Chair of @CloudExpo & @ThingsExpo, and Editor of SYS-CON Media's CloudComputing BigData & IoT Journals. He holds a BA from Knox College & conducted MBA studies at CSU-East Bay.

CloudEXPO Stories
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like "How is my application doing" but no idea how to get a proper answer.
Having been in the web hosting industry since 2002, dhosting has gained a great deal of experience while working on a wide range of projects. This experience has enabled the company to develop our amazing new product, which they are now excited to present! Among dHosting's greatest achievements, they can include the development of their own hosting panel, the building of their fully redundant server system, and the creation of dhHosting's unique product, Dynamic Edge.
Your job is mostly boring. Many of the IT operations tasks you perform on a day-to-day basis are repetitive and dull. Utilizing automation can improve your work life, automating away the drudgery and embracing the passion for technology that got you started in the first place. In this presentation, I'll talk about what automation is, and how to approach implementing it in the context of IT Operations. Ned will discuss keys to success in the long term and include practical real-world examples. Get started on automating your way to a brighter future!
The challenges of aggregating data from consumer-oriented devices, such as wearable technologies and smart thermostats, are fairly well-understood. However, there are a new set of challenges for IoT devices that generate megabytes or gigabytes of data per second. Certainly, the infrastructure will have to change, as those volumes of data will likely overwhelm the available bandwidth for aggregating the data into a central repository. Ochandarena discusses a whole new way to think about your next-gen applications and how to address the challenges of building applications that harness all data types and sources.
Lori MacVittie is a subject matter expert on emerging technology responsible for outbound evangelism across F5's entire product suite. MacVittie has extensive development and technical architecture experience in both high-tech and enterprise organizations, in addition to network and systems administration expertise. Prior to joining F5, MacVittie was an award-winning technology editor at Network Computing Magazine where she evaluated and tested application-focused technologies including app security and encryption-related solutions. She holds a B.S. in Information and Computing Science from the University of Wisconsin at Green Bay, and an M.S. in Computer Science from Nova Southeastern University, and is an O'Reilly author.