|By Maureen O'Gara||
|March 22, 2009 06:00 AM EDT||
Carbonite, the online backup vendor, says it lost data belonging to over 7,500 customers in a number of separate incidents in a suit filed in Massachusetts charging Promise Technology Inc with supplying it with $3 million worth of defective storage, according to a story in Saturday’s Boston Globe.
The catastrophe is the latest in a series of cloud failures.
Carbonite charges Promise with fraud, unfair and deceptive business practices, and breach of contract.
Carbonite is also suing system integrator Interactive Digital Systems Inc, who brought the storage in, claiming breach of warranty.
The widgetry was supposed to detect disk failures and transfer the data to a working drive. It allegedly didn’t.
The story says Promise couldn’t fix the errors and “Carbonite’s senior engineers, senior management and senior operations personnel…spent enormous amounts of time dealing with the problems.”
Carbonite claims the data losses caused “serious damage” to its business and reputation for reliability. It’s demanding unspecified damages. Promise told the Globe there was “no merit to the allegations.”
The suit was filed in Suffolk Superior Court.
Carbonite, which sells largely to consumers and small businesses and competes with EMC’s Mozy, tells its customers: “never worry about losing your files again.”
I noticed that you covered Carbonite's lawsuit against Promise Technologies and I would like to make sure that your readers understand two points with regard to the lawsuit:
- 1) The data loss event discussed in the lawsuit happened over a year ago. We do not say this to minimize the matter, but it's important for your readers to know that we stopped buying the servers that caused the problem a long time ago. This is not a current problem.
- 2) The total number of Carbonite customers who were unable to retrieve their data was 54, not 7,500.
Here is what happened: The Promise servers that we were purchasing in 2006 and 2007 use RAID technology to spread data redundantly across 15 disk drives so that if any one disk drive fails, you don't lose any data. The RAID software that makes all this work is embedded as "firmware" in the storage servers. In this case, we believe that the firmware on the servers had bugs that caused the servers to crash. Carbonite automatically restarted all 7,500 backups and more than 99% of these were completely restored without incident. Statistically, about 2 out of every 1,000 consumer hard drives will crash every week, so 54 of these customers had their PCs crash before their re-started backups were complete. Since they weren't completely backed up when their PCs crashed, these customers were unable to restore all of their files from Carbonite. Most of the 54 got some or most of their data back. We took full responsibility for what happened and I did my best to call each of these customers personally to apologize.
As a result of our problems with the Promise servers, a couple of years ago we switched to a popular Dell server that uses RAID6 - an improved RAID that allows for the loss of 3 of the 15 drives simultaneously before you lose any data. This configuration is in theory 36 million times more reliable than a single disk drive - the chances of 3 out of 15 drives failing at the same time are almost nil.
So far, Promise has refused to accept responsibility for their equipment's failures, so now we are suing them to get our money back. The Dell RAID servers have been flawless and we're extremely happy with them.
We'd appreciate anything you can do to make sure that your readers understand the facts. Please feel free to call me if you need further clarification.
David Friend | Chairman & CEO
Carbonite, Inc. | 334 Boylston St., 3rd Floor | Boston, MA | 02116
Office: 617-587-1110 | Fax: 617-587-1101
|brettraynes 05/13/09 04:44:00 AM EDT|
I agree with nschrenk about Carbonite probably relying on a single RAID volume. They don't say, so we cannot be sure.
But, they do blame RAID for the loss and claim that going to RAID6 will solve the problem.
As a minimum data needs to be replicated into separate geographically separate locations - mitigate against RIAD issues or any other single location problems.
S3 does this, but so do other professional services such as the ones we rely on (Connected, LiveVault, Attix5 and Asigra).
Suffice to say that customers should ask the question before using any service and entrusting their critical business data.
Could someone from Carbonite clarify this for us please – if a customer’s data is stored in multiple locations, then this add a ton of confidence – and would help us endorse the service as meeting best practice.
|nschrenk 05/12/09 10:41:00 AM EDT|
I infer from this story that Carbonite stores a single copy of its customers' data on a RAID6 volume in one location. And they used to do the same thing, but with RAID5. If this isn't true, please correct me, but if it is, it sure wouldn't make me feel secure.
Just think of all the types of single-machine failures that could result in data loss! What if the power supply goes bad and fries the electronics in all of the drives in the system simultaneously? What if a small fire roasts all the drives in the system? What if an administrator makes a mistake on one of the systems?
A backup service built on top of a much more robust storage system like Amazon S3 would make me feel a whole lot more secure than what Carbonite appears to offer. Keeping a copy of the data on another machine in the same data center is a minimum requirement, and keeping a copy on a machine in a different data center would be nice.
|brettraynes 05/12/09 09:52:00 AM EDT|
Backup Direct (www.backupdirect.net) has been supplying business-grade online backup services for seven years. We like to think we know what we are doing and have seen enough examples of the good, the bad and the ugly in this industry!
We are in the fortunate position of using other vendors' technologies – not our own – and select suppliers based on a detailed knowledge of our customers' requirements and the vendors’ capabilities.
Now, as Carbonite has/had been going for a few years max and Promise has/had 20-years of experience – I think one can infer (but not prove) that Carbonite should shoulder at least some of the blame for this loss. It looks a little like they are 'workmen blaming their tools'.
We have seen this happen before. It is so easy to put up a web site and some code to backup data – but to make it work in a scaled-up environment is hugely more complex. To argue that RAID6 is 36-million times more reliable to than RAID5 shows naivety in the extreme – and a lack of deep understanding of the real issues – some of which include people, processes, design...There is a very low barrier to entry in the online backup industry – which puts customer data at risk.
Connected's technology from Iron Mountain forms the core of our PC backup service. It has over three million paying users (I stress 3m pay to use it – not free). Companies having chosen it after proper due-diligence include: Intel, Hilton, Amazon, Google, Boeing, PwC, Grant Thornton, Logica...
These companies put effort into selecting vendors. But the standard small business or home user cannot do this. They are left to rely on the marketing 'hype' from certain vendors – which evidently can be weightier than the service infrastructure behind it.
|vchar 04/01/09 02:54:00 PM EDT|
Carbonite customers’ data loss is not Promise’s fault. For some more context on this case, see Promise's response in a letter sent to customers this week at www.promise.com/ support/ Announcements.asp
|onlinebackups 03/24/09 09:29:24 AM EDT|
You failed to mention this data loss happened back in 2007, and only a small handful of customers were actually affected. Once Carbonite realized the disk failure, they flagged those files to be backed up again, and were transferred from the user's PC to Carbonite's backup servers again. Carbonite is still a good backup system, although I still prefer Mozy.
Business as usual for IT is evolving into a “Make or Buy” decision on a service-by-service conversation with input from the LOBs. How does your organization move forward with cloud? In his general session at 16th Cloud Expo, Paul Maravei, Regional Sales Manager, Hybrid Cloud and Managed Services at Cisco, discusses how Cisco and its partners offer a market-leading portfolio and ecosystem of cloud infrastructure and application services that allow you to uniquely and securely combine cloud busi...
Mar. 31, 2015 04:15 PM EDT Reads: 1,561
Businesses are looking to empower employees and departments to do more, go faster, and streamline their processes. For all workers – but mobile workers especially – utilizing the cloud to reconnect documents and improve processes without destructing existing workflows can have a dramatic impact on productivity. In his session at 16th Cloud Expo, Mark Grilli, vice president of Acrobat Solutions marketing at Adobe Systems Incorporated, will outline new ways that the cloud is changing the way peo...
Mar. 31, 2015 04:00 PM EDT Reads: 1,410
Internet of Things (IoT) will be a hybrid ecosystem of diverse devices and sensors collaborating with operational and enterprise systems to create the next big application. In their session at @ThingsExpo, Bramh Gupta, founder and CEO of robomq.io, and Fred Yatzeck, principal architect leading product development at robomq.io, will discuss how choosing the right middleware and integration strategy from the get-go will enable IoT solution developers to adapt and grow with the industry, while at...
Mar. 31, 2015 04:00 PM EDT Reads: 480
One of the hottest areas in cloud right now is DRaaS and related offerings. In his session at 16th Cloud Expo, Dale Levesque, Disaster Recovery Product Manager with Windstream's Cloud and Data Center Marketing team, will discuss the benefits of the cloud model, which far outweigh the traditional approach, and how enterprises need to ensure that their needs are properly being met.
Mar. 31, 2015 03:59 PM EDT Reads: 291
SYS-CON Events announced today that WSM International (WSM), the world’s leading cloud and server migration services provider, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. WSM is a solutions integrator with a core focus on cloud and server migration, transformation and DevOps services.
Mar. 31, 2015 03:00 PM EDT Reads: 1,394
SYS-CON Events announced today that MangoApps will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY., and the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. MangoApps provides private all-in-one social intranets allowing workers to securely collaborate from anywhere in the world and from any device. Social, mobile, and eas...
Mar. 31, 2015 03:00 PM EDT Reads: 3,176
With the arrival of the Big Data revolution, a data professional is expected to master a broad spectrum of complex domains including data processing, mathematics, programming languages, machine learning techniques, and business knowledge. While this mastery is undoubtedly important, this narrow focus on tool usage has divorced many from the imagination required to solve real-world problems. As the demand for analysis increases, the data science community must transform from tool experts to "data...
Mar. 31, 2015 03:00 PM EDT Reads: 558
SYS-CON Events announced today that Solgenia will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY, and the 17th International Cloud Expo®, which will take place on November 3–5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Solgenia is the global market leader in Cloud Collaboration and Cloud Infrastructure software solutions. Designed to “Bridge the Gap” between Personal and Professional S...
Mar. 31, 2015 03:00 PM EDT Reads: 2,993
WSM International has launched a DevOps services division that offers assessment, consulting and implementation to large enterprises and organizations with complex infrastructures. The concept of DevOps is to blend information technology (IT) software development with operations to optimize the computing infrastructure according to the specific needs of the organization. According to a recent press release from Gartner, "By 2016, DevOps will evolve from a niche strategy employed by large cloud ...
Mar. 31, 2015 03:00 PM EDT Reads: 1,411
SYS-CON Events announced today that QTS Realty Trust, one of the nation’s largest and fastest-growing providers of data center facilities and cloud services and a leader in security and compliance, will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. QTS Realty Trust, Inc. (NYSE: QTS) is a leading national provider of data center solutions and fully managed services, and a leader in security and compliance...
Mar. 31, 2015 03:00 PM EDT Reads: 1,358
Sematext is a globally distributed organization that builds innovative Cloud and On Premises solutions for performance monitoring, alerting and anomaly detection (SPM), log management and analytics (Logsene), and search analytics (SSA). We also provide Search and Big Data consulting services and offer 24/7 production support for Solr and Elasticsearch.
Mar. 31, 2015 02:15 PM EDT Reads: 1,581
The speed of software changes in growing and large scale rapid-paced DevOps environments presents a challenge for continuous testing. Many organizations struggle to get this right. Practices that work for small scale continuous testing may not be sufficient as the requirements grow. In his session at DevOps Summit, Marc Hornbeek, Sr. Solutions Architect of DevOps continuous test solutions at Spirent Communications, will explain the best practices of continuous testing at high scale, which is r...
Mar. 31, 2015 02:00 PM EDT Reads: 2,057
SYS-CON Events announced today that Emcien will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Emcien’s vision is to let anyone use data to know the future. Emcien has built an automated, predictive analysis product that improves the lives of real people. Emcien allows people to automate their data analysis so they can build a better future.
Mar. 31, 2015 02:00 PM EDT Reads: 546
Hosted PaaS providers have given independent developers and startups huge advantages in efficiency and reduced time-to-market over their more process-bound counterparts in enterprises. Software frameworks are now available that allow enterprise IT departments to provide these same advantages for developers in their own organization. In his workshop session at DevOps Summit, Troy Topnik, ActiveState’s Technical Product Manager, will show how on-prem or cloud-hosted Private PaaS can enable organ...
Mar. 31, 2015 12:00 PM EDT Reads: 1,382
SYS-CON Events announced today that Litmus Automation will exhibit at SYS-CON's 16th International Cloud Expo®, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Litmus Automation’s vision is to provide a solution for companies that are in a rush to embrace the disruptive Internet of Things technology and leverage it for real business challenges. Litmus Automation simplifies the complexity of connected devices applications with Loop, a secure and scalable clou...
Mar. 31, 2015 12:00 PM EDT Reads: 576
The world's leading Cloud event, Cloud Expo has launched Microservices Journal on the SYS-CON.com portal, featuring over 19,000 original articles, news stories, features, and blog entries. DevOps Journal is focused on this critical enterprise IT topic in the world of cloud computing. Microservices Journal offers top articles, news stories, and blog posts from the world's well-known experts and guarantees better exposure for its authors than any other publication. Follow new article posts on T...
Mar. 31, 2015 12:00 PM EDT Reads: 1,546
Even though it’s now Microservices Journal, long-time fans of SOA World Magazine can take comfort in the fact that the URL – soa.sys-con.com – remains unchanged. And that’s no mistake, as microservices are really nothing more than a new and improved take on the Service-Oriented Architecture (SOA) best practices we struggled to hammer out over the last decade. Skeptics, however, might say that this change is nothing more than an exercise in buzzword-hopping. SOA is passé, and now that people are ...
Mar. 31, 2015 11:00 AM EDT Reads: 1,391
SYS-CON Events announced today the IoT Bootcamp – Jumpstart Your IoT Strategy, being held June 9–10, 2015, in conjunction with 16th Cloud Expo and Internet of @ThingsExpo at the Javits Center in New York City. This is your chance to jumpstart your IoT strategy. Combined with real-world scenarios and use cases, the IoT Bootcamp is not just based on presentations but includes hands-on demos and walkthroughs. We will introduce you to a variety of Do-It-Yourself IoT platforms including Arduino, Ras...
Mar. 31, 2015 11:00 AM EDT Reads: 2,217
SYS-CON Events announced today that the DevOps Institute has been named “Association Sponsor” of SYS-CON's DevOps Summit, which will take place on June 9–11, 2015, at the Javits Center in New York City, NY. The DevOps Institute provides enterprise level training and certification. Working with thought leaders from the DevOps community, the IT Service Management field and the IT training market, the DevOps Institute is setting the standard in quality for DevOps education and training.
Mar. 31, 2015 10:30 AM EDT Reads: 1,301
SYS-CON Events announced today the DevOps Foundation Certification Course, being held June ?, 2015, in conjunction with DevOps Summit and 16th Cloud Expo at the Javits Center in New York City, NY. This sixteen (16) hour course provides an introduction to DevOps – the cultural and professional movement that stresses communication, collaboration, integration and automation in order to improve the flow of work between software developers and IT operations professionals. Improved workflows will res...
Mar. 31, 2015 10:00 AM EDT Reads: 1,752