Welcome!

@CloudExpo Authors: Elizabeth White, Rene Buest, Liz McMillan, Mehdi Daoudi, Astadia CloudGPS

Related Topics: @CloudExpo, Cloud Security

@CloudExpo: Blog Post

NetApp Backup: NDMP vs. Cloud

The Benefits of Cloud–based NetApp Offsite Backup

Author:  Jeff Whitehead, CTO, Co-founder, Zetta.net

NetApp filers are versatile and high-performance storage appliances. They're so reliable that it's easy to forget things can go wrong - like a fire, theft, or major storm. The potential for an unknown disaster is what makes offsite backup a necessity, even for NetApp filers with internal redundancy.i>

NetApp Backup With NDMP
The traditional methods of backing up a NetApp - an NDMP dump of the WAFL file system - works, but it has a number of shortcomings:

  • You Need a Second NetApp to Recover - since the NDMP dump is a binary image of the WAFL file system, the only device that can parse and utilize this image is another NetApp.
  • Testing Requires Unutilized NetApp Storage - many environments only have a single filer, and even large environments tend to not have a "spare" NetApp just lying around, and this makes it difficult to perform recovery testing.
  • Untested Backups Aren't Valid - It has long been a truism of enterprise data management that "a backup isn't a valid backup, until it has been restored and tested."

This doesn't necessarily mean that every single backup has to be recovered, but quarterly testing is prudent, and anything less than annual recovery can be considered very risky.

Cloud-based NetApp Offsite Backup
Zetta DataProtect for NetApp
overcomes the limitation of a proprietary data dump with open replication technology - Zetta provides a managed and integrated solution that replicates the data in its original format (files and folders, with ACLs* and other metadata preserved) in enterprise-grade storage systems hosted in Zetta's data centers.

How it works:

1. ZettaMirror is installed on a gateway server, Linux, or Windows PC, that has NFS or CIFS access to the NetApp filer**.

2. On a schedule, configured via the SMP ZettaMirror wakes up, makes a control connection to the NetApp Filer, and creates a snapshot.

3. ZettaMirror reads the newly created snapshot, looking for files that have changed since the previous sync.

4. When it detects files that have changed, it further inspects the file and finds just the portions of the file that have changed since the previous sync, and transmits just those changes.

5. When the sync has completed, it signals the cloud data center to create a snapshot, and removes the snapshot created on the local filer.

The end result is a snapshot in Zetta's data centers that's identical in content to the source snapshot. Additionally, since updates are applied at a sub-file level, these snapshots are space efficient (similar to snapshots on a NetApp).

The versions of customer data backed up at Zetta can be accessed online worldwide via a standard web browser, mounted as a web drive, or restored via ZettaMirror to a NetApp filer or - crucially - any other device.

Zetta DataProtect for NetApp provides many of the benefits of SnapMirror for offsite disaster recovery, without the cost of a second filer and second data center.

* The style of ACL depends on the client you use - those using qtree/NTFS ACLs should use a Windows client/CIFS to preserve them. Standard POSIX ACLs/NFS would be best served with a Linux client.

** A high capacity, low latency connection is preferred. A standard 1Gbps ethernet connection within a corporate LAN works for most cases, but 10Gbps or multiple gateway devices would be warranted for very large file systems. Ping times between the ZettaMirror host and the NetApp filer should be < 1-3ms for best performance. This gateway system needs the ability to make outbound HTTPS connections to Zetta's datacenters.

 

Jeff Whitehead is co-founder and CTO of Zetta. Previously, as CIO of Shutterfly, he successfully managed over six petabytes of storage infrastructure.

More Stories By Derek Kol

Derek Kol is a technology specialist focused on SMB and enterprise IT innovations.

@CloudExpo Stories
"We're here to tell the world about our cloud-scale infrastructure that we have at Juniper combined with the world-class security that we put into the cloud," explained Lisa Guess, VP of Systems Engineering at Juniper Networks, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"With Digital Experience Monitoring what used to be a simple visit to a web page has exploded into app on phones, data from social media feeds, competitive benchmarking - these are all components that are only available because of some type of digital asset," explained Leo Vasiliou, Director of Web Performance Engineering at Catchpoint Systems, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
Your homes and cars can be automated and self-serviced. Why can't your storage? From simply asking questions to analyze and troubleshoot your infrastructure, to provisioning storage with snapshots, recovery and replication, your wildest sci-fi dream has come true. In his session at @DevOpsSummit at 20th Cloud Expo, Dan Florea, Director of Product Management at Tintri, provided a ChatOps demo where you can talk to your storage and manage it from anywhere, through Slack and similar services with...
As enterprise cloud becomes the norm, businesses and government programs must address compounded regulatory compliance related to data privacy and information protection. The most recent, Controlled Unclassified Information and the EU’s GDPR have board level implications and companies still struggle with demonstrating due diligence. Developers and DevOps leaders, as part of the pre-planning process and the associated supply chain, could benefit from updating their code libraries and design by in...
"Peak 10 is a hybrid infrastructure provider across the nation. We are in the thick of things when it comes to hybrid IT," explained Michael Fuhrman, Chief Technology Officer at Peak 10, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that Calligo, an innovative cloud service provider offering mid-sized companies the highest levels of data privacy and security, has been named "Bronze Sponsor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Calligo offers unparalleled application performance guarantees, commercial flexibility and a personalised support service from its globally located cloud plat...
"We are an IT services solution provider and we sell software to support those solutions. Our focus and key areas are around security, enterprise monitoring, and continuous delivery optimization," noted John Balsavage, President of A&I Solutions, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We were founded in 2003 and the way we were founded was about good backup and good disaster recovery for our clients, and for the last 20 years we've been pretty consistent with that," noted Marc Malafronte, Territory Manager at StorageCraft, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
There is a huge demand for responsive, real-time mobile and web experiences, but current architectural patterns do not easily accommodate applications that respond to events in real time. Common solutions using message queues or HTTP long-polling quickly lead to resiliency, scalability and development velocity challenges. In his session at 21st Cloud Expo, Ryland Degnan, a Senior Software Engineer on the Netflix Edge Platform team, will discuss how by leveraging a reactive stream-based protocol,...
"We are focused on SAP running in the clouds, to make this super easy because we believe in the tremendous value of those powerful worlds - SAP and the cloud," explained Frank Stienhans, CTO of Ocean9, Inc., in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"DivvyCloud as a company set out to help customers automate solutions to the most common cloud problems," noted Jeremy Snyder, VP of Business Development at DivvyCloud, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
DevOps at Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to w...
"As we've gone out into the public cloud we've seen that over time we may have lost a few things - we've lost control, we've given up cost to a certain extent, and then security, flexibility," explained Steve Conner, VP of Sales at Cloudistics,in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
"The Striim platform is a full end-to-end streaming integration and analytics platform that is middleware that covers a lot of different use cases," explained Steve Wilkes, Founder and CTO at Striim, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
"We want to show that our solution is far less expensive with a much better total cost of ownership so we announced several key features. One is called geo-distributed erasure coding, another is support for KVM and we introduced a new capability called Multi-Part," explained Tim Desai, Senior Product Marketing Manager at Hitachi Data Systems, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Me...
SYS-CON Events announced today that DXWorldExpo has been named “Global Sponsor” of SYS-CON's 21st International Cloud Expo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Digital Transformation is the key issue driving the global enterprise IT business. Digital Transformation is most prominent among Global 2000 enterprises and government institutions.
SYS-CON Events announced today that Datera, that offers a radically new data management architecture, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Datera is transforming the traditional datacenter model through modern cloud simplicity. The technology industry is at another major inflection point. The rise of mobile, the Internet of Things, data storage and Big...
Kubernetes is an open source system for automating deployment, scaling, and management of containerized applications. Kubernetes was originally built by Google, leveraging years of experience with managing container workloads, and is now a Cloud Native Compute Foundation (CNCF) project. Kubernetes has been widely adopted by the community, supported on all major public and private cloud providers, and is gaining rapid adoption in enterprises. However, Kubernetes may seem intimidating and complex ...