Welcome!

@CloudExpo Authors: Zakia Bouachraoui, Yeshim Deniz, Liz McMillan, Pat Romanski, Elizabeth White

Related Topics: @CloudExpo

@CloudExpo: Blog Feed Post

Deliver Cloud Storage to Your Desktop

Cloud Storage Services were relatively unknown until Amazon mass produced the now well-known S3

Cloud Hosting Journal on Ulitzer

Cloud Storage Services were relatively unknown until Amazon mass produced the now well-known S3 (Simple Storage Service). S3 may not be the first cloud storage service but it is among the first for the public with billions of objects stored. Now we are seeing other cloud storage vendors coming out, such as Nirvanix, Windows Azure, EMC Atmos Online/AT&T, Parascale, Box.net and etc. Google has long been in the cloud services business with the GMail service, the Google Apps Engine, the Picasa photo service and etc, with Google storage backing them up.

Desktop Access to the Cloud
A common theme of cloud storage services is that they all provide some API (Application Programming Interface) over HTTP. If the Cloud Storage were to be as popular today as the FTP for the past decade, it needs to have a desktop client that delivers the remote storage to the user's desktop, preferably as a Virtual Network Drive. After all, nobody wants to code a Ruby & Rail or .NET application just to get some simple transfer done.

New Challenges - So Many Different APIs
It wasn't like FTP when all the FTP Servers in the world talking in the same FTP Protocol. Since the Cloud Storage Services are so new, each vendor pretty much defines its own API. A common protocol might appear in the future such as the Simple Cloud API effort. However, the state of the art is that every vendor is divided so to deliver a quicker to market solution. As a result, every cloud storage service has a different API.

Basically, the Cloud Storage APIs can be categorized into several groups.

(1) REST over HTTP/HTTPS

Amazon S3, Windows Azure, Nirvanix, EMC Atmos Online, Google Data API, Box.Net

  • Pro: Simple, Easy to achieve application compatibility on the server end. Push the complexity to the client end if so desired.
  • Con: Needs developer support to write new applications for these APIs .

(2) WebDav

Parascale, Box.Net and other vendors

  • Pro: Existing Desktop Client Support
  • Con: WevDav protocol is too big and too complicated. The Server side keeps the complexity. New applications written will have to take on the same complexity.

(3) FTP

Some established companies simply repackage existing products with a cloud label, with FTP access.

Cloud Vendors' Approach to the APIs

  • Big companies such as Microsoft pushes for the simple REST API from day 1 with lots of developer supports.
  • Smaller companies may have dual-protocol support in both REST and Webdav.
    • easier adoption with existing WebDav client early on.
    • later migrate to a simpler REST API for internal growth and scalability reasons.
  • The simpler the API, the easier to manage, both for the vendors and for the developers writing apps. Simplicity attracts developers.

Ubiquitous Client

Gladinet's effort is to combine all these different cloud storage services and bind them to the Windows Operating System. The end result is a ubiquitous client that turns the Windows Explorer into a Storage Portal. There is a virtual network drive with a drive letter. All the supported cloud storage services are mountable within this network drive. (You can find more details of the functionality in the reference)

clip_image002

Use Cases

The speed of the internet determines the use case. For example, if everyone were still using Dial-Up network, nobody is talking about cloud storage.

Use Case I - Direct Random Access
Broadband is the norm nowadays, with speed varies around 100KB/S - 800KB/s. A response time of < 5s is required for good usability for direct access. This means direct random access to the cloud files with 500K-4M in size will be very usable. As a simple experiment, a directory listing of the My Documents folder on my PC reveals 237 Files with 46M Bytes total. I have on average 200KB per file for the files that I used the most often.

Use Case II - Online Backup
At current broadband speed (slower than the 802.11B wireless network), a bigger use case is online backup, which is write once and seldom read. At this stage, the cloud storage can't replace either the network attached storage or the local hard drive because of the speed but it is perfect for backing up stuff.

Use Case III - File Server with Cloud Backup
An interesting twist is to combine the Use Case I and Use Case II by moving the access point from user's desktop to a file server. Users can do direct random access on a network server while the network server is backed up by online storage. As a second product coming out of Gladinet, the Cloud Gateway fits this use case.

Future Looking
With fiber becoming the next wave of the broadband, the speed of the internet will catch up with the local wireless network, we will see more use case in the network attached storage becoming cloud aware. We will see more and more people using Cloud Storage in a supportive role to the main local hard drive while the local PC, the local hard drive all increase their speed too.

Conclusion
As of this writing, Seagate i365 just announced the support of Cloud API and Google Docs opens up with 1G of free storage. With the speed of the internet increases, you will see more and more vendors adopting the cloud storage paradigm. You will see more and more developers writing applications towards the cloud services. Eventually, the internet is the computer.

Reference

1. Manage Azure With Ease - An overview of basic functionalities using Azure as an example

2. Gladinet Web Site

Read the original blog entry...

More Stories By Jerry Huang

Jerry Huang, an engineer and entrepreneur, founded Gladinet with his close friends and is pursuing interests in the cloud computing. He has published articles on the company blog as well as following up on the company twitter activities. He graduated from the University of Michigan in 1998 and has lived in West Palm Beach, Florida since.

CloudEXPO Stories
Having been in the web hosting industry since 2002, dhosting has gained a great deal of experience while working on a wide range of projects. This experience has enabled the company to develop our amazing new product, which they are now excited to present! Among dHosting's greatest achievements, they can include the development of their own hosting panel, the building of their fully redundant server system, and the creation of dhHosting's unique product, Dynamic Edge.
Your job is mostly boring. Many of the IT operations tasks you perform on a day-to-day basis are repetitive and dull. Utilizing automation can improve your work life, automating away the drudgery and embracing the passion for technology that got you started in the first place. In this presentation, I'll talk about what automation is, and how to approach implementing it in the context of IT Operations. Ned will discuss keys to success in the long term and include practical real-world examples. Get started on automating your way to a brighter future!
The challenges of aggregating data from consumer-oriented devices, such as wearable technologies and smart thermostats, are fairly well-understood. However, there are a new set of challenges for IoT devices that generate megabytes or gigabytes of data per second. Certainly, the infrastructure will have to change, as those volumes of data will likely overwhelm the available bandwidth for aggregating the data into a central repository. Ochandarena discusses a whole new way to think about your next-gen applications and how to address the challenges of building applications that harness all data types and sources.
DXWorldEXPO LLC announced today that Big Data Federation to Exhibit at the 22nd International CloudEXPO, colocated with DevOpsSUMMIT and DXWorldEXPO, November 12-13, 2018 in New York City. Big Data Federation, Inc. develops and applies artificial intelligence to predict financial and economic events that matter. The company uncovers patterns and precise drivers of performance and outcomes with the aid of machine-learning algorithms, big data, and fundamental analysis. Their products are deployed by some of the world's largest financial institutions. The company develops and applies innovative machine-learning technologies to big data to predict financial, economic, and world events. The team is a group of passionate technologists, mathematicians, data scientists and programmers in Silicon Valley with over 100 patents to their names. Big Data Federation was incorporated in 2015 and is ...
Dynatrace is an application performance management software company with products for the information technology departments and digital business owners of medium and large businesses. Building the Future of Monitoring with Artificial Intelligence. Today we can collect lots and lots of performance data. We build beautiful dashboards and even have fancy query languages to access and transform the data. Still performance data is a secret language only a couple of people understand. The more business becomes digital the more stakeholders are interested in this data including how it relates to business. Some of these people have never used a monitoring tool before. They have a question on their mind like "How is my application doing" but no idea how to get a proper answer.