@CloudExpo Authors: Liz McMillan, Elizabeth White, Pat Romanski, Gordon Haff, Yeshim Deniz

Related Topics: @CloudExpo, Microservices Expo, Containers Expo Blog

@CloudExpo: Article

Shelton Shugar Says Yahoo! Already a Major Cloud Computing User

Lays Out Details at 4th International Cloud Computing Expo

Yahoo! SVP Shelton Shugar, speaking at the 4th International Cloud Computing Expo, outlined some of the detail involved in serving 600 million users per month while handling hundreds of petabytes of data.

"We are building a private cloud to be used within Yahoo!," he said. Hundreds of applications have already been migrated to the cloud, he said, noting that "we are (now) focusing on the data processing environment and serving environment."

"This is a long-term activity. started a few years ago," Shugar said. "And prior to cloud we might have had to literally forklift machines and move them when we want to move capacity. With cloud serving we are building a flat network and can basically point and click and move capacity from one place to another."

Shugar outlined five areas of emphasis:

Edge services - where the company deploys around the edges of the netwrok to speed content delivery.

Cloud serving - involves hosting applications. automated provisioning, and "we allow through a declarative language to define an app through tiers of an architecture," Shugar said. "Tiers can be as big or small as you need and can adjust over time. We can use the language to define connectivity, and can clone a collection of tiers."

Storage - All of the online servers have RESTful APIs, "so are easy to use," Shugar said. "We can support a variety of consistency models, and there's a lot of similarity between and among our services." He also mentioned the company's "MOBstore" (mass object store) capability, which takes objects ranging in size from a megabyte to a couple of gigabytes, which are assumed to be immutable. He also noted the use of the company's "Sherpa" funcitonality," so I dont' have legions of developers trying their own schemas, etc. They write a few API calls and it's done," he said. "It's a great way to drive innovation."

Batch processing - This is the data warehouse, and where Hadoop comes into play. "We started developing this a few years ago, and ran on about 20 machines," Shugar said. "Today we run on tens of thousands of machines, with 80 petabytes of storage. We have upwards of 1000 people trained on it, and hundreds of applications on it. It let's us pull together thousands of computers and say hey 'you're one file.'"

Shugar also described "a new language called PIG (not an acryonm) that's a higher-level procedural language. The amount of code you write is very small, while adding metadata, workflow, data management, etc."

Data collection - "This is a set of services that allow us to collect content from our web servers, platforms, and search," Shugar said.. "It cleans it up all the data, pulls out out the bot traffic, etc."

Shugar went on to provide some use cases. One example was the home page. As Shugar noted, "when you type in yahoo.com you are going through our cloud. We look at user behavior through Hadoop and determine which are the most interesting articles for folks, a feedback loop to improve the consumer experience by selecting content the consumer is interested in." Through this method, "clickthroughs are up," Shugar said. "The consumers win because they get what they want, we win because we get more advertising."

Cloud Computing Expo 2010 East to Attract More Than 5,000 Delegates from 48 Countries
SYS-CON Events announced today that the 5th International Cloud Computing Conference & Expo will take place April 19-20-21, 2010, at the Jacob Javits Convention Center in New York City.

The International Cloud Computing Conference & Expo series is the world's leading Cloud-focused event and is held three times a year, in New York, Silicon Valley and in Europe. Over 200 corporate sponsors and 10,000 industry professionals have participated in Cloud Computing Expo since its inception, more than all other Cloud-related events put together.

The three-day event will offer a rich array of sessions led by exceptional speakers about the business and technical value of cloud computing with more than 80 sponsors and exhibitors on the 70,000 sq. ft. show floor and over 5,000 estimated delegates from well over 48 different countries.

4th International Cloud Computing Conference & Expo
At the 4th International Cloud Computing Conference & Expo, November 2-4, 2009, being held in the Santa Clara Convention Center, Santa Clara, CA, more than 2,000 delegates will find out how cloud computing is transforming the way that enterprises everywhere build and deploy applications.

Now held three times a year -- in New York, Prague, and Santa Clara -- the Cloud Computing Conference & Expo series is the fastest-growing Enterprise IT event in the past 10 years, devoted to every aspect of delivering massively scalable enterprise IT as a service. The event is co-located with our 7th International Virtualization Conference & Expo.

4th International Cloud Computing Conference & Expo Keynotes
Cloud Computing Expo 2009 West keynotes, November 2-3, 2009, in the Santa Clara Convention Center, Santa Clara, CA, will be delivered by Richard Marcello, Unisys President of Systems & Technology; Shelton Shugar, Yahoo! SVP Cloud Computing; and Richard Sarwal, Oracle VP of Development for Enterprise Manager.

Delegate Registration Options
Cloud Computing Expo (www.CloudComputingExpo.com) delegates can pre-register for the conference online with $800 savings here: https://www3.sys-con.com/cloud1109/registernew.cfm


Sponsorship Opportunities
Sponsorship and Exhibit opportunities can be obtained from Carmen Gonzalez by email at events (at) sys-con.com, by phone 201 802 3021.

SYS-CON's International Cloud Computing Conference & Expo, held each year in California, New York and Prague is the leading event covering the fast-emerging Cloud Computing market for Enterprise IT professionals. Co-located with the International Virtualization Conference & Expo, the combined event delivers the #1 i-technology educational and networking opportunity of the year for those seeking to establish a market lead anywhere in the multiple layers of the Cloud Computing ecosystem.

About SYS-CON Media & Events
SYS-CON Media (www.sys-con.com) has since 1994 been connecting technology companies and customers 24x7x365 through a comprehensive content stream at www.SYS-CON.com -- focused on 35 main subject areas, from Cloud Computing to Web Security -- interwoven with market leading full-scale conferences produced by SYS-CON Events. The company's internationally recognized brands include among others Cloud Computing Expo (www.CloudComputingExpo.com), Virtualization Conference & Expo (www.VirtualizationConference.com), Government IT Conference & Expo (www.GovITExpo.com), Cloud Computing Bootcamp (www.CloudComputingBootcamp.com), Cloud Expo Europe (www.CloudExpo-Europe.com) and now UlitzerLive! New Media Conference & Expo (www.UlitzerLive.com).

SOURCE: Ulitzer, Inc.


Delegate & Attendee Inquiries
Corinna Melcon
Corinna (at) sys-con.com
201 802 3019

Conference Faculty Inquiries
Jeremy Geelan
Jeremy (at) sys-con.com
201 802 3026

Sponsorship and Exhibit Opportunities
Carmen Gonzalez
Carmen (at) sys-con.com
201 802 2021

Expo Floor Sales
Megan Mussa
Megan (at) sys-con.com
201 802 3020

Website and General Inquiries
Krisandra Russo
Krisandra (at) sys-con.com
201 802 3020

More Stories By Roger Strukhoff

Roger Strukhoff (@IoT2040) is Executive Director of the Tau Institute for Global ICT Research, with offices in Illinois and Manila. He is Conference Chair of @CloudExpo & @ThingsExpo, and Editor of SYS-CON Media's CloudComputing BigData & IoT Journals. He holds a BA from Knox College & conducted MBA studies at CSU-East Bay.

@CloudExpo Stories
Enterprises have taken advantage of IoT to achieve important revenue and cost advantages. What is less apparent is how incumbent enterprises operating at scale have, following success with IoT, built analytic, operations management and software development capabilities - ranging from autonomous vehicles to manageable robotics installations. They have embraced these capabilities as if they were Silicon Valley startups.
DXWorldEXPO LLC announced today that Kevin Jackson joined the faculty of CloudEXPO's "10-Year Anniversary Event" which will take place on November 11-13, 2018 in New York City. Kevin L. Jackson is a globally recognized cloud computing expert and Founder/Author of the award winning "Cloud Musings" blog. Mr. Jackson has also been recognized as a "Top 100 Cybersecurity Influencer and Brand" by Onalytica (2015), a Huffington Post "Top 100 Cloud Computing Experts on Twitter" (2013) and a "Top 50 C...
Digital transformation is about embracing digital technologies into a company's culture to better connect with its customers, automate processes, create better tools, enter new markets, etc. Such a transformation requires continuous orchestration across teams and an environment based on open collaboration and daily experiments. In his session at 21st Cloud Expo, Alex Casalboni, Technical (Cloud) Evangelist at Cloud Academy, explored and discussed the most urgent unsolved challenges to achieve fu...
The standardization of container runtimes and images has sparked the creation of an almost overwhelming number of new open source projects that build on and otherwise work with these specifications. Of course, there's Kubernetes, which orchestrates and manages collections of containers. It was one of the first and best-known examples of projects that make containers truly useful for production use. However, more recently, the container ecosystem has truly exploded. A service mesh like Istio addr...
Predicting the future has never been more challenging - not because of the lack of data but because of the flood of ungoverned and risk laden information. Microsoft states that 2.5 exabytes of data are created every day. Expectations and reliance on data are being pushed to the limits, as demands around hybrid options continue to grow.
Poor data quality and analytics drive down business value. In fact, Gartner estimated that the average financial impact of poor data quality on organizations is $9.7 million per year. But bad data is much more than a cost center. By eroding trust in information, analytics and the business decisions based on these, it is a serious impediment to digital transformation.
Business professionals no longer wonder if they'll migrate to the cloud; it's now a matter of when. The cloud environment has proved to be a major force in transitioning to an agile business model that enables quick decisions and fast implementation that solidify customer relationships. And when the cloud is combined with the power of cognitive computing, it drives innovation and transformation that achieves astounding competitive advantage.
Digital Transformation: Preparing Cloud & IoT Security for the Age of Artificial Intelligence. As automation and artificial intelligence (AI) power solution development and delivery, many businesses need to build backend cloud capabilities. Well-poised organizations, marketing smart devices with AI and BlockChain capabilities prepare to refine compliance and regulatory capabilities in 2018. Volumes of health, financial, technical and privacy data, along with tightening compliance requirements by...
Andrew Keys is Co-Founder of ConsenSys Enterprise. He comes to ConsenSys Enterprise with capital markets, technology and entrepreneurial experience. Previously, he worked for UBS investment bank in equities analysis. Later, he was responsible for the creation and distribution of life settlement products to hedge funds and investment banks. After, he co-founded a revenue cycle management company where he learned about Bitcoin and eventually Ethereal. Andrew's role at ConsenSys Enterprise is a mul...
DXWorldEXPO LLC announced today that "Miami Blockchain Event by FinTechEXPO" has announced that its Call for Papers is now open. The two-day event will present 20 top Blockchain experts. All speaking inquiries which covers the following information can be submitted by email to [email protected] Financial enterprises in New York City, London, Singapore, and other world financial capitals are embracing a new generation of smart, automated FinTech that eliminates many cumbersome, slow, and expe...
Evan Kirstel is an internationally recognized thought leader and social media influencer in IoT (#1 in 2017), Cloud, Data Security (2016), Health Tech (#9 in 2017), Digital Health (#6 in 2016), B2B Marketing (#5 in 2015), AI, Smart Home, Digital (2017), IIoT (#1 in 2017) and Telecom/Wireless/5G. His connections are a "Who's Who" in these technologies, He is in the top 10 most mentioned/re-tweeted by CMOs and CIOs (2016) and have been recently named 5th most influential B2B marketeer in the US. H...
DXWorldEXPO | CloudEXPO are the world's most influential, independent events where Cloud Computing was coined and where technology buyers and vendors meet to experience and discuss the big picture of Digital Transformation and all of the strategies, tactics, and tools they need to realize their goals. Sponsors of DXWorldEXPO | CloudEXPO benefit from unmatched branding, profile building and lead generation opportunities.
The best way to leverage your Cloud Expo presence as a sponsor and exhibitor is to plan your news announcements around our events. The press covering Cloud Expo and @ThingsExpo will have access to these releases and will amplify your news announcements. More than two dozen Cloud companies either set deals at our shows or have announced their mergers and acquisitions at Cloud Expo. Product announcements during our show provide your company with the most reach through our targeted audiences.
DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. Digital Transformation (DX) is a major focus with the introduction of DXWorldEXPO within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive over the long term. A total of 88% of Fortune 500 companies from a generation ago are now out of bus...
With 10 simultaneous tracks, keynotes, general sessions and targeted breakout classes, @CloudEXPO and DXWorldEXPO are two of the most important technology events of the year. Since its launch over eight years ago, @CloudEXPO and DXWorldEXPO have presented a rock star faculty as well as showcased hundreds of sponsors and exhibitors! In this blog post, we provide 7 tips on how, as part of our world-class faculty, you can deliver one of the most popular sessions at our events. But before reading...
Cloud Expo | DXWorld Expo have announced the conference tracks for Cloud Expo 2018. Cloud Expo will be held June 5-7, 2018, at the Javits Center in New York City, and November 6-8, 2018, at the Santa Clara Convention Center, Santa Clara, CA. Digital Transformation (DX) is a major focus with the introduction of DX Expo within the program. Successful transformation requires a laser focus on being data-driven and on using all the tools available that enable transformation if they plan to survive ov...
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
@DevOpsSummit New York 2018, colocated with CloudEXPO | DXWorldEXPO New York 2018 will be held November 11-13, 2018, in New York City. From showcase success stories from early adopters and web-scale businesses, DevOps is expanding to organizations of all sizes, including the world's largest enterprises - and delivering real results.
The dynamic nature of the cloud means that change is a constant when it comes to modern cloud-based infrastructure. Delivering modern applications to end users, therefore, is a constantly shifting challenge. Delivery automation helps IT Ops teams ensure that apps are providing an optimal end user experience over hybrid-cloud and multi-cloud environments, no matter what the current state of the infrastructure is. To employ a delivery automation strategy that reflects your business rules, making r...
Dion Hinchcliffe is an internationally recognized digital expert, bestselling book author, frequent keynote speaker, analyst, futurist, and transformation expert based in Washington, DC. He is currently Chief Strategy Officer at the industry-leading digital strategy and online community solutions firm, 7Summits.