@CloudExpo Authors: Elizabeth White, Liz McMillan, Yeshim Deniz, Zakia Bouachraoui, Pat Romanski

Related Topics: @CloudExpo

@CloudExpo: Blog Post

Amazon EC2 Adopts eBay Like Cloud Auction Model

Responding to user demand, Amazon has expanded its on-demand computing EC2 offerings

Responding to user demand, Amazon has expanded its on-demand computing EC2 offerings. It is auctioning off unused EC2 capacity through Spot Instances which enable you to make a bid for computing time.

Bidders provide info on the instance family, size and region, number of Spot Instances they want and the maximum price they're willing to pay per instance.

You can view the EC2 API and AWS Management Console to see prior Spot Instance prices to give you an idea of how much to bid. The spot price is dynamic and varies depending on supply and demand fluctuations.

Just like in any regular auction, when the user bids above the spot price, then his/her computing will be taken care of at the current price.

They can then run those instances for as long their bid exceeds the current "Spot Price." But if the price increases above the bid, the instance will be stopped to be restarted once the price falls. A Spot Instance can also be user terminated when it's no longer needed. They won't be charged for partial hours of use.

There is a lot to think about when you are trying to determine if these bids are worth your while. Spot Instances could be an obvious way to go for tasks that do not have to adhere to a specific time schedule as you will have no control over when your applications would be interrupted or finished. Ancillary tasks that are not critical to your work flow can be accounted for and you can walk away with a pretty good deal.

Amazon suggests that ideal tasks for spots would be flexible ones not on a time crunch like incidental tasks, data processing, media conversion , Financial modeling and analysis, web crawling , you get the idea…The higher the bid, the more the chance that your request would be attended to. Also there are provisions in place for urgent capacity requirements.

CloudEXPO Stories
Using new techniques of information modeling, indexing, and processing, new cloud-based systems can support cloud-based workloads previously not possible for high-throughput insurance, banking, and case-based applications. In his session at 18th Cloud Expo, John Newton, CTO, Founder and Chairman of Alfresco, described how to scale cloud-based content management repositories to store, manage, and retrieve billions of documents and related information with fast and linear scalability. He addressed the challenges of scaling document repositories to this level; architectural approaches for coordinating data; search and storage technologies, Solr, and Amazon storage and database technologies; the breadth of use cases that modern content systems need to support; how to support user applications that require subsecond response times.
The technologies behind big data and cloud computing are converging quickly, offering businesses new capabilities for fast, easy, wide-ranging access to data. However, to capitalize on the cost-efficiencies and time-to-value opportunities of analytics in the cloud, big data and cloud technologies must be integrated and managed properly. Pythian's Director of Big Data and Data Science, Danil Zburivsky will explore: The main technology components and best practices being deployed to take advantage of data and analytics in the cloud, Architecture, integration, governance and security scenarios and Key challenges and success factors of moving data and analytics to the cloud
For years the world's most security-focused and distributed organizations - banks, military/defense agencies, global enterprises - have sought to adopt cloud technologies that can reduce costs, future-proof against data growth, and improve user productivity. The challenges of cloud transformation for these kinds of secure organizations have centered around data security, migration from legacy systems, and performance. In our presentation, we will discuss the notion that cloud computing, properly managed, is poised to bring about a digital transformation to enterprise IT. We will discuss the trend, the technology and the timeline for adoption.
The deluge of IoT sensor data collected from connected devices and the powerful AI required to make that data actionable are giving rise to a hybrid ecosystem in which cloud, on-prem and edge processes become interweaved. Attendees will learn how emerging composable infrastructure solutions deliver the adaptive architecture needed to manage this new data reality. Machine learning algorithms can better anticipate data storms and automate resources to support surges, including fully scalable GPU-centric compute for the most data-intensive applications. Hyperconverged systems already in place can be revitalized with vendor-agnostic, PCIe-deployed, disaggregated approach to composable, maximizing the value of previous investments.
To Really Work for Enterprises, MultiCloud Adoption Requires Far Better and Inclusive Cloud Monitoring and Cost Management … But How? Overwhelmingly, even as enterprises have adopted cloud computing and are expanding to multi-cloud computing, IT leaders remain concerned about how to monitor, manage and control costs across hybrid and multi-cloud deployments. It’s clear that traditional IT monitoring and management approaches, designed after all for on-premises data centers, are falling short in this new hybrid and dynamic environment.