Welcome!

@CloudExpo Authors: Elizabeth White, Ed Featherston, Liz McMillan, Dean Madison, Pat Romanski

Related Topics: Containers Expo Blog, Agile Computing, @CloudExpo

Containers Expo Blog: Blog Post

Tech Primer: When and What to Move to Flash Storage | @CloudExpo #Cloud #Storage #DataCenter

Flash storage continues to evolve. Early adopters need to keep up on new developments and flash-related schools of thought

Tech Primer: When and What to Move to Flash Storage

Flash storage has become a mainstream technology, with 451 Research expecting the market to reach $9.6 billion by 2020. As the technology becomes less cost-prohibitive, and benefits such as its exponentially greater performance capabilities and simplified process for provisioning and optimizing systems become more sought after, it's clear that the future of storage is flash. But while some organizations may have taken advantage of the burgeoning technology's benefits early on, a significant number of companies have yet to make the transition. Your organization may very well fall into this category.

For you late adopters who have yet to integrate flash storage but are preparing for a move, here are a few key guidelines to follow when considering when and what to move to flash.

When to move (and how to do it)
If your organization hasn't moved to flash yet, you need to at least be considering it. The technology has become so prevalent in the industry that the cost to performance ratio, which used to be a significant hurdle for many businesses, is ideal. That ratio continues to improve each day, meaning the longer you continue to delay a move to flash, the more infrastructure costs you'll see wasted on disk storage.

Of course, like any other technology change or upgrade, there are several challenges that can complicate adoption. To ensure the integration of flash storage is as beneficial and seamless as possible, you must appropriately prepare prior to the purchase. This should revolve around a proof-of-concept exercise that encourages your organization to clearly detail the performance needs of any applications you will move to flash, which will help to provide an understanding of what performance quality will look like down the road.

A proof of concept is especially important if your organization will need to implement an entirely new infrastructure to support the addition of flash storage. If that's the case, the cost will extend beyond simply purchasing a flash device, so it's critical to have an understanding of how your business will benefit from flash to appropriately make the business case and see a worthwhile ROI.

Here are a few key questions you should ask yourself when considering a move to flash:

  • What are the application performance requirements?
  • Am I moving everything to flash, or something specific?
  • Is that application, code and infrastructure optimized for flash?
  • If I'm purchasing a solution from a new vendor, how will that work with what I already have?
  • Do I have the right management and monitoring tools?
  • Do I have or need data reduction technology?

Given that nearly all hardware vendors offer some kind of flash solution, many organizations struggle to decide where to look when purchasing a device - a legacy vendor or a startup? There are certainly pros and cons to each, and this is another facet of a flash migration that will be made smoother by a proof-of-concept exercise.

For example, if you're looking for a cutting-edge solution, startups like Nimble and Pure aren't burdened by legacy infrastructure and have a singular focus that lends itself to product innovation that you may not see from some of the mainstay players. On the other hand, if you need a globalized solution with mature storage monitoring and management capabilities, legacy vendors are often the best choice as they have been driving flash technology forward for several years, whereas startups are still playing catchup on some of what might be considered more traditional features.

What to move (and why)
Once your organization has done its due diligence in terms of understanding performance needs, how they can be met by a flash implementation and which vendor and device to work with, it's time to consider what data should be migrated.

Generally speaking, flash capacity should be allotted to any applications and associated data that have unpredictable, high I/O requirements (perhaps an employee-facing web application that could be accessed by hundreds of people at different times of day). Flash is especially good for things like VDI, which requires high IOPs but little actual storage space - without flash, you would historically buy a storage array with hundreds of hard drives, much of that space ultimately going unused - just to provide the performance needed to handle boot storms. Flash delivers that performance capacity and more, and without causing the business to waste resources by over-purchasing storage resources.

Flash should also be used to support things like virtualized server solutions. While applications are being consolidated to lower costs and maximize the investment your IT department is making in its servers, all of that data still needs to sit on a shared storage device. The performance capabilities of flash will ensure that data won't be subject to bottlenecks or latency. Similarly, business-critical applications and services like SQL Server, SharePoint, Oracle, and, as mentioned, VDI, to name a few, should also sit on a flash storage device to maintain productivity and efficiency.

Best practices
The above guidelines to successfully prepare for and implement a flash solution is a good starting point on your organization's journey to flash. To help ensure your business is able to realize the full benefits of a flash integration in the future, you should look to leverage several key best practices:

  • Understand your performance needs. Surprisingly, all too often, storage administrators and other IT professionals will rush to implement flash devices without considering what level of performance they actually need. The answer should go beyond, "My current storage solution is slow and I need something faster." Think about your block size requirements for each application and associated latency requirements, as well as the performance ranges for each (i.e., do you anticipate daily, weekly or monthly spikes?). This is why a proof of concept exercise is valuable - to show what performance quality will look like over a period of time to help inform configuration and provisioning decisions.
  • Prepare for growth. While the capacity and functionality of flash technology continues to grow, so too will your organization's amount of data to be stored. Data reduction technologies will certainly help, but your organization should plan to prioritize what data gets stored on flash, and what can remain on existing storage solutions. At the end of the day, you need to balance the ROI of a flash investment against everything else in the data center.
  • Know your bottlenecks. With flash storage, which delivers much-enhanced performance, storage will no longer be the first piece of infrastructure to shoulder the bottleneck blame. However, you will now need to find the new cause of a bottleneck and to do so, must have a fundamental understanding of your organization's infrastructure. Is it the network or the server? Is the application optimized? Could it stem from database code? A comprehensive, full application stack monitoring system should be implemented to provide deep visibility into the health of physical infrastructure and across applications and environments (on-premises and in the cloud) that will enable you to more easily find the source of a new bottleneck.

Conclusion
Flash storage continues to evolve. Early adopters need to keep up on new technology developments and flash-related schools of thought. In addition to larger capacity flash drives, there are still newer technologies to consider, such as NVMe and 3D Xpoint, that can potentially be implemented if/when performance or business requirements change. However, for late adopters that are preparing for a move, these guidelines around when, what and how to integrate flash, as well as the accompanying best practices for future management, will ideally position you to quickly ramp up and benefit quickly from a flash storage adoption.

More Stories By James Honey

James Honey is a senior product marketing manager for SolarWinds. He has more than 15 years of experience in the IT industry, focused specifically on storage technologies and virtualization solutions for SMBs to enterprise environments. His current role includes responsibility for all storage monitoring and management-related product marketing initiatives, including SolarWinds Storage Resource Monitor.

Comments (0)

Share your thoughts on this story.

Add your comment
You must be signed in to add a comment. Sign-in | Register

In accordance with our Comment Policy, we encourage comments that are on topic, relevant and to-the-point. We will remove comments that include profanity, personal attacks, racial slurs, threats of violence, or other inappropriate material that violates our Terms and Conditions, and will block users who make repeated violations. We ask all readers to expect diversity of opinion and to treat one another with dignity and respect.


@CloudExpo Stories
Is advanced scheduling in Kubernetes achievable? Yes, however, how do you properly accommodate every real-life scenario that a Kubernetes user might encounter? How do you leverage advanced scheduling techniques to shape and describe each scenario in easy-to-use rules and configurations? In his session at @DevOpsSummit at 21st Cloud Expo, Oleg Chunikhin, CTO at Kublr, will answer these questions and demonstrate techniques for implementing advanced scheduling. For example, using spot instances ...
SYS-CON Events announced today that Cedexis will exhibit at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Cedexis is the leader in data-driven enterprise global traffic management. Whether optimizing traffic through datacenters, clouds, CDNs, or any combination, Cedexis solutions drive quality and cost-effectiveness.
SYS-CON Events announced today that Nihon Micron will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Nihon Micron Co., Ltd. strives for technological innovation to establish high-density, high-precision processing technology for providing printed circuit board and metal mount RFID tags used for communication devices. For more inf...
SYS-CON Events announced today that Suzuki Inc. will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Suzuki Inc. is a semiconductor-related business, including sales of consuming parts, parts repair, and maintenance for semiconductor manufacturing machines, etc. It is also a health care business providing experimental research for...
Many companies start their journey to the cloud in the DevOps environment, where software engineers want self-service access to the custom tools and frameworks they need. Machine learning technology can help IT departments keep up with these demands. In his session at 21st Cloud Expo, Ajay Gulati, Co-Founder, CTO and Board Member at ZeroStack, will discuss the use of machine learning for automating provisioning of DevOps resources, taking the burden off IT teams.
IBM helps FinTechs and financial services companies build and monetize cognitive-enabled financial services apps quickly and at scale. Hosted on IBM Bluemix, IBM’s platform builds in customer insights, regulatory compliance analytics and security to help reduce development time and testing. In his session at 21st Cloud Expo, Lennart Frantzell, a Developer Advocate with IBM, will discuss how these tools simplify the time-consuming tasks of selection, mapping and data integration, allowing devel...
SYS-CON Events announced today that N3N will exhibit at SYS-CON's @ThingsExpo, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. N3N’s solutions increase the effectiveness of operations and control centers, increase the value of IoT investments, and facilitate real-time operational decision making. N3N enables operations teams with a four dimensional digital “big board” that consolidates real-time live video feeds alongside IoT sensor data a...
Today most companies are adopting or evaluating container technology - Docker in particular - to speed up application deployment, drive down cost, ease management and make application delivery more flexible overall. As with most new architectures, this dream takes significant work to become a reality. Even when you do get your application componentized enough and packaged properly, there are still challenges for DevOps teams to making the shift to continuous delivery and achieving that reducti...
Mobile device usage has increased exponentially during the past several years, as consumers rely on handhelds for everything from news and weather to banking and purchases. What can we expect in the next few years? The way in which we interact with our devices will fundamentally change, as businesses leverage Artificial Intelligence. We already see this taking shape as businesses leverage AI for cost savings and customer responsiveness. This trend will continue, as AI is used for more sophistica...
SYS-CON Events announced today that Enroute Lab will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Enroute Lab is an industrial design, research and development company of unmanned robotic vehicle system. For more information, please visit http://elab.co.jp/.
SYS-CON Events announced today that Mobile Create USA will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Mobile Create USA Inc. is an MVNO-based business model that uses portable communication devices and cellular-based infrastructure in the development, sales, operation and mobile communications systems incorporating GPS capabi...
Cloud-based disaster recovery is critical to any production environment and is a high priority for many enterprise organizations today. Nearly 40% of organizations have had to execute their BCDR plan due to a service disruption in the past two years. Zerto on IBM Cloud offer VMware and Microsoft customers simple, automated recovery of on-premise VMware and Microsoft workloads to IBM Cloud data centers.
Why Federal cloud? What is in Federal Clouds and integrations? This session will identify the process and the FedRAMP initiative. But is it sufficient? What is the remedy for keeping abreast of cutting-edge technology? In his session at 21st Cloud Expo, Rasananda Behera will examine the proposed solutions: Private or public or hybrid cloud Responsible governing bodies How can we accomplish?
SYS-CON Events announced today that Massive Networks, that helps your business operate seamlessly with fast, reliable, and secure internet and network solutions, has been named "Exhibitor" of SYS-CON's 21st International Cloud Expo ®, which will take place on Oct 31 - Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. As a premier telecommunications provider, Massive Networks is headquartered out of Louisville, Colorado. With years of experience under their belt, their team of...
SYS-CON Events announced today that mruby Forum will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. mruby is the lightweight implementation of the Ruby language. We introduce mruby and the mruby IoT framework that enhances development productivity. For more information, visit http://forum.mruby.org/.
In his session at @ThingsExpo, Greg Gorman is the Director, IoT Developer Ecosystem, Watson IoT, will provide a short tutorial on Node-RED, a Node.js-based programming tool for wiring together hardware devices, APIs and online services in new and interesting ways. It provides a browser-based editor that makes it easy to wire together flows using a wide range of nodes in the palette that can be deployed to its runtime in a single-click. There is a large library of contributed nodes that help so...
SYS-CON Events announced today that Ryobi Systems will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Ryobi Systems Co., Ltd., as an information service company, specialized in business support for local governments and medical industry. We are challenging to achive the precision farming with AI. For more information, visit http:...
SYS-CON Events announced today that SIGMA Corporation will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. uLaser flow inspection device from the Japanese top share to Global Standard! Then, make the best use of data to flip to next page. For more information, visit http://www.sigma-k.co.jp/en/.
SYS-CON Events announced today that Daiya Industry will exhibit at the Japan External Trade Organization (JETRO) Pavilion at SYS-CON's 21st International Cloud Expo®, which will take place on Oct 31 – Nov 2, 2017, at the Santa Clara Convention Center in Santa Clara, CA. Daiya Industry specializes in orthotic support systems and assistive devices with pneumatic artificial muscles in order to contribute to an extended healthy life expectancy. For more information, please visit https://www.daiyak...
Today traditional IT approaches leverage well-architected compute/networking domains to control what applications can access what data, and how. DevOps includes rapid application development/deployment leveraging concepts like containerization, third-party sourced applications and databases. Such applications need access to production data for its test and iteration cycles. Data Security? That sounds like a roadblock to DevOps vs. protecting the crown jewels to those in IT.