Welcome!

@CloudExpo Authors: Pat Romanski, Yeshim Deniz, Liz McMillan, Elizabeth White, Zakia Bouachraoui

Related Topics: Containers Expo Blog, @CloudExpo

Containers Expo Blog: Article

Cloud Optimized Storage Solutions (COSS) Explored

Part 2 - How is Content Stored in the Cloud?

Dave Graham's Blog

In part one of this series, we discussed the nature of content within the cloud. After determining the nature of the content being stored, it is important to understand how this unstructured and structured content will be stored. The mechanism for storage has significant impact on a provider’s Service Level Agreement (SLA) to the end user and can also promote the concept of tiered storage within the cloud as well.

To evaluate this storage mechanism, you need to pull apart the storage path to determine what influences it has on the content being stored.  Technologies such as encryption, de-duplication, compression, object-model storage (a la XAM), and even the underlying file system can have a large part in storage and the subsequent retrieval.

COSS Part 2: How is Content being Stored?

 

Filesystems

One of the first paths to evaluate is the role of the underlying file system within the Cloud Optimized Storage System (COSS) environment. Hooks within the cloud storage environment typically dictate the use of open IP protocols such as NFS (Network File System) or CIFS (Common Internet File System) as an underlying method of storage.  These filesystem types are easily portable and have wide-spread adaptability and connectivity to a variety of host types and operating systems. Other types of filesystems that might be present within a COSS environment are what would be considered as “Open File Systems.”  These can be best represented by NTFS, XFS, ZFS, EXT3, ReiserFS, etc. and can also be vendor or client specific and proprietary.  Additional file systems that could be utilized would fall under the label of “Closed File Systems” and would include HP-UX, AIX, mainframe system storage, and the like.

Objects

Another method of content storage is using Object-based storage placement, best represented by XAM. Within the object method of storage, content is identified by meta-data and placed within a general pool of storage, similar to an open volume. This type of storage allows for data placement anywhere within the storage device with dependencies only on a hashing or metadata index to point to the actual physical storage location. The flexibility with this model of storage is that it truly could be “storage anywhere,” a key tenet of cloud computing.  By localizing an index to a physical device with knowledge (or awareness) of a remote system, the meta-data or hash could be in one location (or many based on intrinsic replication) and the object in multiple locations.  This type of model would be particularly effective in “edge” devices which serve simply as access points to geographically localized data.

More Stories By Dave Graham

Dave Graham is a Technical Consultant with EMC Corporation where he focused on designing/architecting private cloud solutions for commercial customers.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


CloudEXPO Stories
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like "How is my application doing" but no idea how to get a proper answer.
DXWordEXPO New York 2018, colocated with CloudEXPO New York 2018 will be held November 11-13, 2018, in New York City and will bring together Cloud Computing, FinTech and Blockchain, Digital Transformation, Big Data, Internet of Things, DevOps, AI, Machine Learning and WebRTC to one location.
Today, we have more data to manage than ever. We also have better algorithms that help us access our data faster. Cloud is the driving force behind many of the data warehouse advancements we have enjoyed in recent years. But what are the best practices for storing data in the cloud for machine learning and data science applications?
@DevOpsSummit at Cloud Expo, taking place November 12-13 in New York City, NY, is co-located with 22nd international CloudEXPO | first international DXWorldEXPO and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to wait for long development cycles that produce software that is obsolete at launch. DevOps may be disruptive, but it is essential.
Bill Schmarzo, author of "Big Data: Understanding How Data Powers Big Business" and "Big Data MBA: Driving Business Strategies with Data Science" is responsible for guiding the technology strategy within Hitachi Vantara for IoT and Analytics. Bill brings a balanced business-technology approach that focuses on business outcomes to drive data, analytics and technology decisions that underpin an organization's digital transformation strategy.