Welcome!

@CloudExpo Authors: Pat Romanski, Liz McMillan, Kevin Benedict, Elizabeth White, Peter Davidson

Related Topics: @CloudExpo, Cloud Security

@CloudExpo: Blog Post

NetApp Backup: NDMP vs. Cloud

The Benefits of Cloud–based NetApp Offsite Backup

Author:  Jeff Whitehead, CTO, Co-founder, Zetta.net

NetApp filers are versatile and high-performance storage appliances. They're so reliable that it's easy to forget things can go wrong - like a fire, theft, or major storm. The potential for an unknown disaster is what makes offsite backup a necessity, even for NetApp filers with internal redundancy.i>

NetApp Backup With NDMP
The traditional methods of backing up a NetApp - an NDMP dump of the WAFL file system - works, but it has a number of shortcomings:

  • You Need a Second NetApp to Recover - since the NDMP dump is a binary image of the WAFL file system, the only device that can parse and utilize this image is another NetApp.
  • Testing Requires Unutilized NetApp Storage - many environments only have a single filer, and even large environments tend to not have a "spare" NetApp just lying around, and this makes it difficult to perform recovery testing.
  • Untested Backups Aren't Valid - It has long been a truism of enterprise data management that "a backup isn't a valid backup, until it has been restored and tested."

This doesn't necessarily mean that every single backup has to be recovered, but quarterly testing is prudent, and anything less than annual recovery can be considered very risky.

Cloud-based NetApp Offsite Backup
Zetta DataProtect for NetApp
overcomes the limitation of a proprietary data dump with open replication technology - Zetta provides a managed and integrated solution that replicates the data in its original format (files and folders, with ACLs* and other metadata preserved) in enterprise-grade storage systems hosted in Zetta's data centers.

How it works:

1. ZettaMirror is installed on a gateway server, Linux, or Windows PC, that has NFS or CIFS access to the NetApp filer**.

2. On a schedule, configured via the SMP ZettaMirror wakes up, makes a control connection to the NetApp Filer, and creates a snapshot.

3. ZettaMirror reads the newly created snapshot, looking for files that have changed since the previous sync.

4. When it detects files that have changed, it further inspects the file and finds just the portions of the file that have changed since the previous sync, and transmits just those changes.

5. When the sync has completed, it signals the cloud data center to create a snapshot, and removes the snapshot created on the local filer.

The end result is a snapshot in Zetta's data centers that's identical in content to the source snapshot. Additionally, since updates are applied at a sub-file level, these snapshots are space efficient (similar to snapshots on a NetApp).

The versions of customer data backed up at Zetta can be accessed online worldwide via a standard web browser, mounted as a web drive, or restored via ZettaMirror to a NetApp filer or - crucially - any other device.

Zetta DataProtect for NetApp provides many of the benefits of SnapMirror for offsite disaster recovery, without the cost of a second filer and second data center.

* The style of ACL depends on the client you use - those using qtree/NTFS ACLs should use a Windows client/CIFS to preserve them. Standard POSIX ACLs/NFS would be best served with a Linux client.

** A high capacity, low latency connection is preferred. A standard 1Gbps ethernet connection within a corporate LAN works for most cases, but 10Gbps or multiple gateway devices would be warranted for very large file systems. Ping times between the ZettaMirror host and the NetApp filer should be < 1-3ms for best performance. This gateway system needs the ability to make outbound HTTPS connections to Zetta's datacenters.

 

Jeff Whitehead is co-founder and CTO of Zetta. Previously, as CIO of Shutterfly, he successfully managed over six petabytes of storage infrastructure.

More Stories By Derek Kol

Derek Kol is a technology specialist focused on SMB and enterprise IT innovations.

@CloudExpo Stories
In 2014, Amazon announced a new form of compute called Lambda. We didn't know it at the time, but this represented a fundamental shift in what we expect from cloud computing. Now, all of the major cloud computing vendors want to take part in this disruptive technology. In his session at 20th Cloud Expo, Doug Vanderweide, an instructor at Linux Academy, discussed why major players like AWS, Microsoft Azure, IBM Bluemix, and Google Cloud Platform are all trying to sidestep VMs and containers wit...
With major technology companies and startups seriously embracing Cloud strategies, now is the perfect time to attend 21st Cloud Expo October 31 - November 2, 2017, at the Santa Clara Convention Center, CA, and June 12-14, 2018, at the Javits Center in New York City, NY, and learn what is going on, contribute to the discussions, and ensure that your enterprise is on the right path to Digital Transformation.
DevOps at Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The widespread success of cloud computing is driving the DevOps revolution in enterprise IT. Now as never before, development teams must communicate and collaborate in a dynamic, 24/7/365 environment. There is no time to w...
Internet of @ThingsExpo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, is co-located with 21st Cloud Expo and will feature technical sessions from a rock star conference faculty and the leading industry players in the world. The Internet of Things (IoT) is the most profound change in personal and enterprise IT since the creation of the Worldwide Web more than 20 years ago. All major researchers estimate there will be tens of billions devic...
SYS-CON Events announced today that Cloud Academy named "Bronze Sponsor" of 21st International Cloud Expo which will take place October 31 - November 2, 2017 at the Santa Clara Convention Center in Santa Clara, CA. Cloud Academy is the industry’s most innovative, vendor-neutral cloud technology training platform. Cloud Academy provides continuous learning solutions for individuals and enterprise teams for Amazon Web Services, Microsoft Azure, Google Cloud Platform, and the most popular cloud com...
"Loom is applying artificial intelligence and machine learning into the entire log analysis process, from start to finish and at the end you will get a human touch,” explained Sabo Taylor Diab, Vice President, Marketing at Loom Systems, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
Amazon started as an online bookseller 20 years ago. Since then, it has evolved into a technology juggernaut that has disrupted multiple markets and industries and touches many aspects of our lives. It is a relentless technology and business model innovator driving disruption throughout numerous ecosystems. Amazon’s AWS revenues alone are approaching $16B a year making it one of the largest IT companies in the world. With dominant offerings in Cloud, IoT, eCommerce, Big Data, AI, Digital Assista...
The taxi industry never saw Uber coming. Startups are a threat to incumbents like never before, and a major enabler for startups is that they are instantly “cloud ready.” If innovation moves at the pace of IT, then your company is in trouble. Why? Because your data center will not keep up with frenetic pace AWS, Microsoft and Google are rolling out new capabilities. In his session at 20th Cloud Expo, Don Browning, VP of Cloud Architecture at Turner, posited that disruption is inevitable for comp...
For organizations that have amassed large sums of software complexity, taking a microservices approach is the first step toward DevOps and continuous improvement / development. Integrating system-level analysis with microservices makes it easier to change and add functionality to applications at any time without the increase of risk. Before you start big transformation projects or a cloud migration, make sure these changes won’t take down your entire organization.
When growing capacity and power in the data center, the architectural trade-offs between server scale-up vs. scale-out continue to be debated. Both approaches are valid: scale-out adds multiple, smaller servers running in a distributed computing model, while scale-up adds fewer, more powerful servers that are capable of running larger workloads. It’s worth noting that there are additional, unique advantages that scale-up architectures offer. One big advantage is large memory and compute capacity...
"We are a monitoring company. We work with Salesforce, BBC, and quite a few other big logos. We basically provide monitoring for them, structure for their cloud services and we fit into the DevOps world" explained David Gildeh, Co-founder and CEO of Outlyer, in this SYS-CON.tv interview at DevOps Summit at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
No hype cycles or predictions of zillions of things here. IoT is big. You get it. You know your business and have great ideas for a business transformation strategy. What comes next? Time to make it happen. In his session at @ThingsExpo, Jay Mason, Associate Partner at M&S Consulting, presented a step-by-step plan to develop your technology implementation strategy. He discussed the evaluation of communication standards and IoT messaging protocols, data analytics considerations, edge-to-cloud tec...
"When we talk about cloud without compromise what we're talking about is that when people think about 'I need the flexibility of the cloud' - it's the ability to create applications and run them in a cloud environment that's far more flexible,” explained Matthew Finnie, CTO of Interoute, in this SYS-CON.tv interview at 20th Cloud Expo, held June 6-8, 2017, at the Javits Center in New York City, NY.
SYS-CON Events announced today that MobiDev, a client-oriented software development company, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. MobiDev is a software company that develops and delivers turn-key mobile apps, websites, web services, and complex software systems for startups and enterprises. Since 2009 it has grown from a small group of passionate engineers and business...
What's the role of an IT self-service portal when you get to continuous delivery and Infrastructure as Code? This general session showed how to create the continuous delivery culture and eight accelerators for leading the change. Don Demcsak is a DevOps and Cloud Native Modernization Principal for Dell EMC based out of New Jersey. He is a former, long time, Microsoft Most Valuable Professional, specializing in building and architecting Application Delivery Pipelines for hybrid legacy, and cloud ...
The Internet giants are fully embracing AI. All the services they offer to their customers are aimed at drawing a map of the world with the data they get. The AIs from these companies are used to build disruptive approaches that cannot be used by established enterprises, which are threatened by these disruptions. However, most leaders underestimate the effect this will have on their businesses. In his session at 21st Cloud Expo, Rene Buest, Director Market Research & Technology Evangelism at Ar...
SYS-CON Events announced today that GrapeUp, the leading provider of rapid product development at the speed of business, will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place October 31-November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Grape Up is a software company, specialized in cloud native application development and professional services related to Cloud Foundry PaaS. With five expert teams that operate in various sectors of the market acr...
SYS-CON Events announced today that Ayehu will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on October 31 - November 2, 2017 at the Santa Clara Convention Center in Santa Clara California. Ayehu provides IT Process Automation & Orchestration solutions for IT and Security professionals to identify and resolve critical incidents and enable rapid containment, eradication, and recovery from cyber security breaches. Ayehu provides customers greater control over IT infras...
21st International Cloud Expo, taking place October 31 - November 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA, will feature technical sessions from a rock star conference faculty and the leading industry players in the world. Cloud computing is now being embraced by a majority of enterprises of all sizes. Yesterday's debate about public vs. private has transformed into the reality of hybrid cloud: a recent survey shows that 74% of enterprises have a hybrid cloud strategy. Me...
We build IoT infrastructure products - when you have to integrate different devices, different systems and cloud you have to build an application to do that but we eliminate the need to build an application. Our products can integrate any device, any system, any cloud regardless of protocol," explained Peter Jung, Chief Product Officer at Pulzze Systems, in this SYS-CON.tv interview at @ThingsExpo, held November 1-3, 2016, at the Santa Clara Convention Center in Santa Clara, CA