|By Maureen O'Gara||
|March 22, 2009 06:00 AM EDT||
Carbonite, the online backup vendor, says it lost data belonging to over 7,500 customers in a number of separate incidents in a suit filed in Massachusetts charging Promise Technology Inc with supplying it with $3 million worth of defective storage, according to a story in Saturday’s Boston Globe.
The catastrophe is the latest in a series of cloud failures.
Carbonite charges Promise with fraud, unfair and deceptive business practices, and breach of contract.
Carbonite is also suing system integrator Interactive Digital Systems Inc, who brought the storage in, claiming breach of warranty.
The widgetry was supposed to detect disk failures and transfer the data to a working drive. It allegedly didn’t.
The story says Promise couldn’t fix the errors and “Carbonite’s senior engineers, senior management and senior operations personnel…spent enormous amounts of time dealing with the problems.”
Carbonite claims the data losses caused “serious damage” to its business and reputation for reliability. It’s demanding unspecified damages. Promise told the Globe there was “no merit to the allegations.”
The suit was filed in Suffolk Superior Court.
Carbonite, which sells largely to consumers and small businesses and competes with EMC’s Mozy, tells its customers: “never worry about losing your files again.”
I noticed that you covered Carbonite's lawsuit against Promise Technologies and I would like to make sure that your readers understand two points with regard to the lawsuit:
- 1) The data loss event discussed in the lawsuit happened over a year ago. We do not say this to minimize the matter, but it's important for your readers to know that we stopped buying the servers that caused the problem a long time ago. This is not a current problem.
- 2) The total number of Carbonite customers who were unable to retrieve their data was 54, not 7,500.
Here is what happened: The Promise servers that we were purchasing in 2006 and 2007 use RAID technology to spread data redundantly across 15 disk drives so that if any one disk drive fails, you don't lose any data. The RAID software that makes all this work is embedded as "firmware" in the storage servers. In this case, we believe that the firmware on the servers had bugs that caused the servers to crash. Carbonite automatically restarted all 7,500 backups and more than 99% of these were completely restored without incident. Statistically, about 2 out of every 1,000 consumer hard drives will crash every week, so 54 of these customers had their PCs crash before their re-started backups were complete. Since they weren't completely backed up when their PCs crashed, these customers were unable to restore all of their files from Carbonite. Most of the 54 got some or most of their data back. We took full responsibility for what happened and I did my best to call each of these customers personally to apologize.
As a result of our problems with the Promise servers, a couple of years ago we switched to a popular Dell server that uses RAID6 - an improved RAID that allows for the loss of 3 of the 15 drives simultaneously before you lose any data. This configuration is in theory 36 million times more reliable than a single disk drive - the chances of 3 out of 15 drives failing at the same time are almost nil.
So far, Promise has refused to accept responsibility for their equipment's failures, so now we are suing them to get our money back. The Dell RAID servers have been flawless and we're extremely happy with them.
We'd appreciate anything you can do to make sure that your readers understand the facts. Please feel free to call me if you need further clarification.
David Friend | Chairman & CEO
Carbonite, Inc. | 334 Boylston St., 3rd Floor | Boston, MA | 02116
Office: 617-587-1110 | Fax: 617-587-1101
|brettraynes 05/13/09 04:44:00 AM EDT|
I agree with nschrenk about Carbonite probably relying on a single RAID volume. They don't say, so we cannot be sure.
But, they do blame RAID for the loss and claim that going to RAID6 will solve the problem.
As a minimum data needs to be replicated into separate geographically separate locations - mitigate against RIAD issues or any other single location problems.
S3 does this, but so do other professional services such as the ones we rely on (Connected, LiveVault, Attix5 and Asigra).
Suffice to say that customers should ask the question before using any service and entrusting their critical business data.
Could someone from Carbonite clarify this for us please – if a customer’s data is stored in multiple locations, then this add a ton of confidence – and would help us endorse the service as meeting best practice.
|nschrenk 05/12/09 10:41:00 AM EDT|
I infer from this story that Carbonite stores a single copy of its customers' data on a RAID6 volume in one location. And they used to do the same thing, but with RAID5. If this isn't true, please correct me, but if it is, it sure wouldn't make me feel secure.
Just think of all the types of single-machine failures that could result in data loss! What if the power supply goes bad and fries the electronics in all of the drives in the system simultaneously? What if a small fire roasts all the drives in the system? What if an administrator makes a mistake on one of the systems?
A backup service built on top of a much more robust storage system like Amazon S3 would make me feel a whole lot more secure than what Carbonite appears to offer. Keeping a copy of the data on another machine in the same data center is a minimum requirement, and keeping a copy on a machine in a different data center would be nice.
|brettraynes 05/12/09 09:52:00 AM EDT|
Backup Direct (www.backupdirect.net) has been supplying business-grade online backup services for seven years. We like to think we know what we are doing and have seen enough examples of the good, the bad and the ugly in this industry!
We are in the fortunate position of using other vendors' technologies – not our own – and select suppliers based on a detailed knowledge of our customers' requirements and the vendors’ capabilities.
Now, as Carbonite has/had been going for a few years max and Promise has/had 20-years of experience – I think one can infer (but not prove) that Carbonite should shoulder at least some of the blame for this loss. It looks a little like they are 'workmen blaming their tools'.
We have seen this happen before. It is so easy to put up a web site and some code to backup data – but to make it work in a scaled-up environment is hugely more complex. To argue that RAID6 is 36-million times more reliable to than RAID5 shows naivety in the extreme – and a lack of deep understanding of the real issues – some of which include people, processes, design...There is a very low barrier to entry in the online backup industry – which puts customer data at risk.
Connected's technology from Iron Mountain forms the core of our PC backup service. It has over three million paying users (I stress 3m pay to use it – not free). Companies having chosen it after proper due-diligence include: Intel, Hilton, Amazon, Google, Boeing, PwC, Grant Thornton, Logica...
These companies put effort into selecting vendors. But the standard small business or home user cannot do this. They are left to rely on the marketing 'hype' from certain vendors – which evidently can be weightier than the service infrastructure behind it.
|vchar 04/01/09 02:54:00 PM EDT|
Carbonite customers’ data loss is not Promise’s fault. For some more context on this case, see Promise's response in a letter sent to customers this week at www.promise.com/ support/ Announcements.asp
|onlinebackups 03/24/09 09:29:24 AM EDT|
You failed to mention this data loss happened back in 2007, and only a small handful of customers were actually affected. Once Carbonite realized the disk failure, they flagged those files to be backed up again, and were transferred from the user's PC to Carbonite's backup servers again. Carbonite is still a good backup system, although I still prefer Mozy.
There are many considerations when moving applications from on-premise to cloud. It is critical to understand the benefits and also challenges of this migration. A successful migration will result in lower Total Cost of Ownership, yet offer the same or higher level of robustness. Migration to cloud shifts computing resources from your data center, which can yield significant advantages provided that the cloud vendor an offer enterprise-grade quality for your application.
Oct. 9, 2015 12:30 AM EDT Reads: 242
JFrog has announced a powerful technology for managing software packages from development into production. JFrog Artifactory 4 represents disruptive innovation in its groundbreaking ability to help development and DevOps teams deliver increasingly complex solutions on ever-shorter deadlines across multiple platforms JFrog Artifactory 4 establishes a new category – the Universal Artifact Repository – that reflects JFrog's unique commitment to enable faster software releases through the first pla...
Oct. 9, 2015 12:30 AM EDT Reads: 628
Overgrown applications have given way to modular applications, driven by the need to break larger problems into smaller problems. Similarly large monolithic development processes have been forced to be broken into smaller agile development cycles. Looking at trends in software development, microservices architectures meet the same demands. Additional benefits of microservices architectures are compartmentalization and a limited impact of service failure versus a complete software malfunction....
Oct. 9, 2015 12:00 AM EDT Reads: 189
IT data is typically silo'd by the various tools in place. Unifying all the log, metric and event data in one analytics platform stops finger pointing and provides the end-to-end correlation. Logs, metrics and custom event data can be joined to tell the holistic story of your software and operations. For example, users can correlate code deploys to system performance to application error codes.
Oct. 9, 2015 12:00 AM EDT Reads: 212
Through WebRTC, audio and video communications are being embedded more easily than ever into applications, helping carriers, enterprises and independent software vendors deliver greater functionality to their end users. With today’s business world increasingly focused on outcomes, users’ growing calls for ease of use, and businesses craving smarter, tighter integration, what’s the next step in delivering a richer, more immersive experience? That richer, more fully integrated experience comes ab...
Oct. 9, 2015 12:00 AM EDT Reads: 1,123
The buzz continues for cloud, data analytics and the Internet of Things (IoT) and their collective impact across all industries. But a new conversation is emerging - how do companies use industry disruption and technology enablers to lead in markets undergoing change, uncertainty and ambiguity? Organizations of all sizes need to evolve and transform, often under massive pressure, as industry lines blur and merge and traditional business models are assaulted and turned upside down. In this new da...
Oct. 8, 2015 11:30 PM EDT Reads: 277
The Internet of Things (IoT) is growing rapidly by extending current technologies, products and networks. By 2020, Cisco estimates there will be 50 billion connected devices. Gartner has forecast revenues of over $300 billion, just to IoT suppliers. Now is the time to figure out how you’ll make money – not just create innovative products. With hundreds of new products and companies jumping into the IoT fray every month, there’s no shortage of innovation. Despite this, McKinsey/VisionMobile data...
Oct. 8, 2015 11:30 PM EDT Reads: 198
As-a-service models offer huge opportunities, but also complicate security. It may seem that the easiest way to migrate to a new architectural model is to let others, experts in their field, do the work. This has given rise to many as-a-service models throughout the industry and across the entire technology stack, from software to infrastructure. While this has unlocked huge opportunities to accelerate the deployment of new capabilities or increase economic efficiencies within an organization, i...
Oct. 8, 2015 11:00 PM EDT Reads: 262
The web app is agile. The REST API is agile. The testing and planning are agile. But alas, data infrastructures certainly are not. Once an application matures, changing the shape or indexing scheme of data often forces at best a top down planning exercise and at worst includes schema changes that force downtime. The time has come for a new approach that fundamentally advances the agility of distributed data infrastructures. Come learn about a new solution to the problems faced by software organ...
Oct. 8, 2015 11:00 PM EDT Reads: 863
Between the compelling mockups and specs produced by analysts, and resulting applications built by developers, there exists a gulf where projects fail, costs spiral, and applications disappoint. Methodologies like Agile attempt to address this with intensified communication, with partial success but many limitations. In his session at DevOps Summit, Charles Kendrick, CTO and Chief Architect at Isomorphic Software, will present a revolutionary model enabled by new technologies. Learn how busine...
Oct. 8, 2015 10:45 PM EDT Reads: 276
SYS-CON Events announced today that Dyn, the worldwide leader in Internet Performance, will exhibit at SYS-CON's 17th International Cloud Expo®, which will take place on November 3-5, 2015, at the Santa Clara Convention Center in Santa Clara, CA. Dyn is a cloud-based Internet Performance company. Dyn helps companies monitor, control, and optimize online infrastructure for an exceptional end-user experience. Through a world-class network and unrivaled, objective intelligence into Internet condit...
Oct. 8, 2015 10:00 PM EDT Reads: 588
The last decade was about virtual machines, but the next one is about containers. Containers enable a service to run on any host at any time. Traditional tools are starting to show cracks because they were not designed for this level of application portability. Now is the time to look at new ways to deploy and manage applications at scale. In his session at @DevOpsSummit, Brian “Redbeard” Harrington, a principal architect at CoreOS, will examine how CoreOS helps teams run in production. Attende...
Oct. 8, 2015 09:45 PM EDT Reads: 1,250
Containers are revolutionizing the way we deploy and maintain our infrastructures, but monitoring and troubleshooting in a containerized environment can still be painful and impractical. Understanding even basic resource usage is difficult - let alone tracking network connections or malicious activity. In his session at DevOps Summit, Gianluca Borello, Sr. Software Engineer at Sysdig, will cover the current state of the art for container monitoring and visibility, including pros / cons and li...
Oct. 8, 2015 09:30 PM EDT Reads: 207
There are so many tools and techniques for data analytics that even for a data scientist the choices, possible systems, and even the types of data can be daunting. In his session at @ThingsExpo, Chris Harrold, Global CTO for Big Data Solutions for EMC Corporation, will show how to perform a simple, but meaningful analysis of social sentiment data using freely available tools that take only minutes to download and install. Participants will get the download information, scripts, and complete en...
Oct. 8, 2015 09:15 PM EDT Reads: 282
Containers are changing the security landscape for software development and deployment. As with any security solutions, security approaches that work for developers, operations personnel and security professionals is a requirement. In his session at @DevOpsSummit, Kevin Gilpin, CTO and Co-Founder of Conjur, will discuss various security considerations for container-based infrastructure and related DevOps workflows.
Oct. 8, 2015 09:15 PM EDT Reads: 220
Manufacturing has widely adopted standardized and automated processes to create designs, build them, and maintain them through their life cycle. However, many modern manufacturing systems go beyond mechanized workflows to introduce empowered workers, flexible collaboration, and rapid iteration. Such behaviors also characterize open source software development and are at the heart of DevOps culture, processes, and tooling.
Oct. 8, 2015 09:00 PM EDT Reads: 1,091
Internet of Things (IoT) will be a hybrid ecosystem of diverse devices and sensors collaborating with operational and enterprise systems to create the next big application. In their session at @ThingsExpo, Bramh Gupta, founder and CEO of robomq.io, and Fred Yatzeck, principal architect leading product development at robomq.io, discussed how choosing the right middleware and integration strategy from the get-go will enable IoT solution developers to adapt and grow with the industry, while at th...
Oct. 8, 2015 06:00 PM EDT Reads: 2,163
“All our customers are looking at the cloud ecosystem as an important part of their overall product strategy. Some see it evolve as a multi-cloud / hybrid cloud strategy, while others are embracing all forms of cloud offerings like PaaS, IaaS and SaaS in their solutions,” noted Suhas Joshi, Vice President – Technology, at Harbinger Group, in this exclusive Q&A with Cloud Expo Conference Chair Roger Strukhoff.
Oct. 8, 2015 05:00 PM EDT Reads: 438
Can call centers hang up the phones for good? Intuitive Solutions did. WebRTC enabled this contact center provider to eliminate antiquated telephony and desktop phone infrastructure with a pure web-based solution, allowing them to expand beyond brick-and-mortar confines to a home-based agent model. It also ensured scalability and better service for customers, including MUY! Companies, one of the country's largest franchise restaurant companies with 232 Pizza Hut locations. This is one example of...
Oct. 8, 2015 04:30 PM EDT Reads: 7,471
Secure Cloud through Automated Compliance | @CloudExpo @CloudRaxak #Cloud #BigData #DevOps #Microservices
Cloud computing delivers on-demand resources that provide businesses with flexibility and cost-savings. The challenge in moving workloads to the cloud has been the cost and complexity of ensuring the initial and ongoing security and regulatory (PCI, HIPAA, FFIEC) compliance across private and public clouds. Manual security compliance is slow, prone to human error, and represents over 50% of the cost of managing cloud applications. Determining how to automate cloud security compliance is critical...
Oct. 8, 2015 04:00 PM EDT Reads: 305