Click here to close now.


@CloudExpo Authors: Liz McMillan, Anders Wallgren, Dana Gardner, Greg O'Connor, Ed Featherston

Related Topics: Government Cloud, Microservices Expo, Containers Expo Blog, API Journal, Agile Computing, @CloudExpo, Cloud Security

Government Cloud: Blog Feed Post

Cloud Archiving and Compliance

Clients like governments and the finance industry have extensive requirements for archiving and e-discovery

Our Cloud Archiving and Compliance best practices will define a maturity model for this hugely important segment within the industry.

It will also produce a best practices white paper, tailored to meet the needs of the NIST Business Use Case that defines the specific requirements for this functionality,  the FAA E-Discovery scenario (11-page PDF).

It will also describe a response to the general best practices defined in the recent document: Best practices for ITaaS, which also describes eDiscovery requirements. Download the 44-page PDF here.

Cloud Archiving Managed Services
This is such a hugely important area for Cloud Providers to develop new services because of the double impact it represents.

First there is the simple facet of the business opportunity. Clients like governments and the finance industry have extensive requirements for archiving and e-discovery.

Secondly and the accelerating factor is that the biggest hold up to Cloud adoption is the lack of maturity in this area. Typically the fears all centre on issues like data residency, where is the data hosted, and what protections are in place to ensure this data is not tampered with and so on.

These are requirements that archiving solutions deal with straight off the bat.

The Gartner Magic Quadrant places vendors like HP (Autonomy), IBM and Symantec as the leaders in this space, but this is a focus on the overall broad category of enterprise archiving, meaning it includes traditional on-site systems too.

Where the real challenge and opportunity is presented is how these types of capabilities can be absorbed into Cloud hosting environments, challenges that are well described in this white paper from another of the vendors Proofpoint: Cloud Computing and eDiscovery.

They describe critical points like:

Cloud computing makes IT operations fast and nimble, but it doesn’t necessarily make ESI easier to discover or legal holds easier to enforce. On the contrary, cloud computing can make legal holds and ESI searches more complex, time-consuming, and difficult. The vast majority of cloud providers would be unable to satisfy the stringent security, privacy, and data access requirements of corporate counsel and other stakeholders responsible for managing legal risk exposure.

They are exactly right on this, which is a blunt explanation of why Cloud adoption is still very low despite the huge hype. There`s your answer.

Also Proofpoint describe the solution, and the associated opportunity for Cloud Providers:

Enterprise IT departments need guidance for deploying eDiscovery applications and for crafting Service Level Agreements (SLAs) with cloud service providers, so that new cloud computing initiatives don’t undermine the enterprise’s investments in eDiscovery.

If Cloud Providers do this they will not only open up a specific product segment, Cloud Archiving, but they will also alleviate Cloud adoption fears in general and open the floodgates for broader adoption of all Cloud apps.

This is why, in my opinion, Cloud Archiving is the single most important product area for Cloud Providers to invest in.

Cloud Archiving – Service specifications

For a taste of these market opportunities we can review a number of related industry initiatives.

Managing Government Records - President Obama recently declared the ‘Managing Government Records‘ initiative , to better use Cloud technologies to perform Information Management and achieve Open Government. Canada also recently announced a similar initiative, to build a ‘GC Docs’ portal that publishes all of their records.

The NIST Business Use Case details the required service specifications, begun with this high level introduction and overview:

“The Federal Aviation Administration (FAA) is examining how to implement cloud-based e-discovery and Freedom of Information Act (FOIA) processes for email. The system must be able to perform discovery in both its in-house email implementation (Lotus Notes) but also in cloud-based email systems. The system will also be used to manage content for compliance purposes, and will serve as an archive of FAA messaging content.

The long-run goal is to support four primary functions: e-discovery, electronic records management, FOIA, and privacy. These four processes have similar needs and capabilities, including searching business applications, document repositories, email (including calendar, contacts, tasks, etc.) and instant messages, and distributed storage (both internal and external) for electronically stored information (ESI) meeting defined criteria.

The focus of this business use case is the processes and systems required to respond to e-discovery and FOIA requests as they pertain to email message data and other supporting data such as calendar entries, tasks, attachments, etc. that are produced and processed by the FAA’s traditional and cloud email messaging systems.”

Our Cloud Archiving best practices program will detail how Cloud Providers can develop products in this area to meet these requirements and opportunities.

Read the original blog entry...

More Stories By Cloud Best Practices Network

The Cloud Best Practices Network is an expert community of leading Cloud pioneers. Follow our best practice blogs at

@CloudExpo Stories
Cloud computing delivers on-demand resources that provide businesses with flexibility and cost-savings. The challenge in moving workloads to the cloud has been the cost and complexity of ensuring the initial and ongoing security and regulatory (PCI, HIPAA, FFIEC) compliance across private and public clouds. Manual security compliance is slow, prone to human error, and represents over 50% of the cost of managing cloud applications. Determining how to automate cloud security compliance is critical...
As organizations shift towards IT-as-a-service models, the need for managing & protecting data residing across physical, virtual, and now cloud environments grows with it. CommVault can ensure protection & E-Discovery of your data - whether in a private cloud, a Service Provider delivered public cloud, or a hybrid cloud environment – across the heterogeneous enterprise.
Today air travel is a minefield of delays, hassles and customer disappointment. Airlines struggle to revitalize the experience. GE and M2Mi will demonstrate practical examples of how IoT solutions are helping airlines bring back personalization, reduce trip time and improve reliability. In their session at @ThingsExpo, Shyam Varan Nath, Principal Architect with GE, and Dr. Sarah Cooper, M2Mi’s VP Business Development and Engineering, explored the IoT cloud-based platform technologies driving t...
In his General Session at DevOps Summit, Asaf Yigal, Co-Founder & VP of Product at, explored the value of Kibana 4 for log analysis and provided a hands-on tutorial on how to set up Kibana 4 and get the most out of Apache log files. He examined three use cases: IT operations, business intelligence, and security and compliance. Asaf Yigal is co-founder and VP of Product at log analytics software company In the past, he was co-founder of social-trading platform Currensee, which...
The Internet of Things (IoT) is growing rapidly by extending current technologies, products and networks. By 2020, Cisco estimates there will be 50 billion connected devices. Gartner has forecast revenues of over $300 billion, just to IoT suppliers. Now is the time to figure out how you’ll make money – not just create innovative products. With hundreds of new products and companies jumping into the IoT fray every month, there’s no shortage of innovation. Despite this, McKinsey/VisionMobile data...
Just over a week ago I received a long and loud sustained applause for a presentation I delivered at this year’s Cloud Expo in Santa Clara. I was extremely pleased with the turnout and had some very good conversations with many of the attendees. Over the next few days I had many more meaningful conversations and was not only happy with the results but also learned a few new things. Here is everything I learned in those three days distilled into three short points.
Culture is the most important ingredient of DevOps. The challenge for most organizations is defining and communicating a vision of beneficial DevOps culture for their organizations, and then facilitating the changes needed to achieve that. Often this comes down to an ability to provide true leadership. As a CIO, are your direct reports IT managers or are they IT leaders? The hard truth is that many IT managers have risen through the ranks based on their technical skills, not their leadership ab...
DevOps is about increasing efficiency, but nothing is more inefficient than building the same application twice. However, this is a routine occurrence with enterprise applications that need both a rich desktop web interface and strong mobile support. With recent technological advances from Isomorphic Software and others, rich desktop and tuned mobile experiences can now be created with a single codebase – without compromising functionality, performance or usability. In his session at DevOps Su...
As organizations realize the scope of the Internet of Things, gaining key insights from Big Data, through the use of advanced analytics, becomes crucial. However, IoT also creates the need for petabyte scale storage of data from millions of devices. A new type of Storage is required which seamlessly integrates robust data analytics with massive scale. These storage systems will act as “smart systems” provide in-place analytics that speed discovery and enable businesses to quickly derive meaningf...
In his keynote at @ThingsExpo, Chris Matthieu, Director of IoT Engineering at Citrix and co-founder and CTO of Octoblu, focused on building an IoT platform and company. He provided a behind-the-scenes look at Octoblu’s platform, business, and pivots along the way (including the Citrix acquisition of Octoblu).
In his General Session at 17th Cloud Expo, Bruce Swann, Senior Product Marketing Manager for Adobe Campaign, explored the key ingredients of cross-channel marketing in a digital world. Learn how the Adobe Marketing Cloud can help marketers embrace opportunities for personalized, relevant and real-time customer engagement across offline (direct mail, point of sale, call center) and digital (email, website, SMS, mobile apps, social networks, connected objects).
The buzz continues for cloud, data analytics and the Internet of Things (IoT) and their collective impact across all industries. But a new conversation is emerging - how do companies use industry disruption and technology enablers to lead in markets undergoing change, uncertainty and ambiguity? Organizations of all sizes need to evolve and transform, often under massive pressure, as industry lines blur and merge and traditional business models are assaulted and turned upside down. In this new da...
In recent years, at least 40% of companies using cloud applications have experienced data loss. One of the best prevention against cloud data loss is backing up your cloud data. In his General Session at 17th Cloud Expo, Sam McIntyre, Partner Enablement Specialist at eFolder, presented how organizations can use eFolder Cloudfinder to automate backups of cloud application data. He also demonstrated how easy it is to search and restore cloud application data using Cloudfinder.
The Internet of Everything is re-shaping technology trends–moving away from “request/response” architecture to an “always-on” Streaming Web where data is in constant motion and secure, reliable communication is an absolute necessity. As more and more THINGS go online, the challenges that developers will need to address will only increase exponentially. In his session at @ThingsExpo, Todd Greene, Founder & CEO of PubNub, exploreed the current state of IoT connectivity and review key trends and t...
We all know that data growth is exploding and storage budgets are shrinking. Instead of showing you charts on about how much data there is, in his General Session at 17th Cloud Expo, Scott Cleland, Senior Director of Product Marketing at HGST, showed how to capture all of your data in one place. After you have your data under control, you can then analyze it in one place, saving time and resources.
With all the incredible momentum behind the Internet of Things (IoT) industry, it is easy to forget that not a single CEO wakes up and wonders if “my IoT is broken.” What they wonder is if they are making the right decisions to do all they can to increase revenue, decrease costs, and improve customer experience – effectively the same challenges they have always had in growing their business. The exciting thing about the IoT industry is now these decisions can be better, faster, and smarter. Now ...
Discussions of cloud computing have evolved in recent years from a focus on specific types of cloud, to a world of hybrid cloud, and to a world dominated by the APIs that make today's multi-cloud environments and hybrid clouds possible. In this Power Panel at 17th Cloud Expo, moderated by Conference Chair Roger Strukhoff, panelists addressed the importance of customers being able to use the specific technologies they need, through environments and ecosystems that expose their APIs to make true ...
Too often with compelling new technologies market participants become overly enamored with that attractiveness of the technology and neglect underlying business drivers. This tendency, what some call the “newest shiny object syndrome” is understandable given that virtually all of us are heavily engaged in technology. But it is also mistaken. Without concrete business cases driving its deployment, IoT, like many other technologies before it, will fade into obscurity.
Microservices are a very exciting architectural approach that many organizations are looking to as a way to accelerate innovation. Microservices promise to allow teams to move away from monolithic "ball of mud" systems, but the reality is that, in the vast majority of organizations, different projects and technologies will continue to be developed at different speeds. How to handle the dependencies between these disparate systems with different iteration cycles? Consider the "canoncial problem"...
The Internet of Things is clearly many things: data collection and analytics, wearables, Smart Grids and Smart Cities, the Industrial Internet, and more. Cool platforms like Arduino, Raspberry Pi, Intel's Galileo and Edison, and a diverse world of sensors are making the IoT a great toy box for developers in all these areas. In this Power Panel at @ThingsExpo, moderated by Conference Chair Roger Strukhoff, panelists discussed what things are the most important, which will have the most profound...