|By Tom Major||
|February 22, 2013 09:00 AM EST||
I have been working for technology companies for 33 years now, so I don't know why I'm always surprised at the technology myths that proliferate. For example, there is a popular notion running around that Solid State Drives (SSDs) will replace Hard Disk Drives (HDDs) as the dominant storage media. So, which will win? Let me give you my answer upfront before I take you through my arguments: both win, and the market size for both continues to grow.
As I offer up this data and this perspective, I'll repeat some advice I received early in my career. A mentor once told me, when searching for the truth in business and technology "look to the economics" (maybe my version of "go to the mattresses" for you "Godfather" fans).
Here is what I read and hear on a regular basis regarding the battle of HDDs and SSDs:
- SSDs run circles around HDDs for performance
- SSDs will soon replace HDDs
- The improving density of SSDs will collapse the current cost premium to HDDs
Sound familiar? Well, as with most claims of this ilk, there are some elements of truth to them but each of these statements goes too far when viewed in light of some data.
Yes, it's true that SSDs are fundamentally faster than HDDs. This is particularly true of random I/O data reading (as with databases). With large block sequential data (i.e., rich media like video), however, this difference tends to be very small.
Here's a claim where the data just doesn't add up. While the attractiveness of the SSD technology would lead one to believe this, the economics really don't hold up. I should probably point more specifically to NAND flash here (the "solid state" in SSDs) because another solid state technology might actually achieve this, but that appears to be years and tens of billions of dollars away.
Let's talk for a minute about the world's demand for storage. Last year approximately 2500 exabytes of data was created and/or replicated. And...this is doubling about every two years. This needs to be serviced largely by HDDs and SSDs. Last year, the NAND flash industry produced somewhere between 30 and 40 exabytes of storage; with somewhere around 3.5 exabytes finding its way into SSDs (the balance in phones, tablets, cameras, etc.). What is that, 1.4% of our total storage need? But production is ramping up... at a capital cost of about $1.5 billion per Exabyte (semiconductor fabs are expensive)! So, from an available supply perspective, SSDs replacing HDDs seems implausible.
Improving Technology Makes SSDs Cheaper
Agree. The NAND flash technology point is at 21nm line widths with plans to move to 19, then 16 nm. Storage density is further improving with the use of multi-level cell (MLC) capabilities vs single-level cell (SLC). This is bringing down the cost of solid state storage in much the same way the areal density increases seen in HDDs brought down the cost of hard drive storage.
Notice how I said "brought" down (i.e., past tense)? Because a real density growth in the hard drive industry has slowed to a crawl, the rapid erosion of cost/Gb has also slowed to a crawl. Now, the HDD industry needs to move to its next technology (HAMR?) to continue to take cost out and HAMR is a number of years away. HAMR will require significant capital investment by the HDD companies. Significant capital investment will be required anyway to keep up with storage demand (even more so with slowing areal density growth). This all spells out a flattening of HDD costs for the foreseeable future. Some would speculate that a renewed interest in improving the utilization of HDD capacity is an artifact of these economics.
Here's what's preventing the complete collapse of the price difference between the two technologies. The NAND flash suppliers have a similar problem as the HDD manufacturers... the implications of shrinking technology geometries. As the line widths shrink, the ability of flash to sustain multiple write-erase cycles declines. To make up for this deficiency, sophisticated error-correction algorithms and "brute force" overprovisioning (to allow some cells to wear out) are being used. This and the above mentioned semiconductor fab costs tend to mitigate the progress SSDs are making in closing the cost gap to HDDs.
Having made my arguments that SSDs won't take over the world, I have to say that IT solutions need this technology. I think you can see that SSDs aren't the answer to all our storage needs, but they allow us to address a crying storage requirement. At a high level, storage is called on to produce two key deliverables:
- Make data available to an application or user in an appropriate timeframe (i.e., performance) and in today's environment this need is growing.
- Store data reliably (i.e., capacity) and in today's environment this need is growing
By and large, to date, systems with hard drives have been architected to deliver both of these capabilities. It's hard to argue that hard drives haven't done a good job of delivering affordable capacity. But to deliver against the performance requirements of IT solutions, hard drives:
- Have been developed with higher speeds, but arguably little progress has been made in the last ten years
- Have been "short stroked" (a technique limiting the stroke of the actuator to improve performance)
- Have been grouped together to allow striping of data across a large number of drives to aggregate their performance.
With each of these approaches the user suffers from higher power requirements, and with the last two approaches their system has been overprovisioned (leaving stranded capacity) to deliver performance. This all adds up to significant system cost that can be avoided with new storage architectures.
Here's where SSDs come in. SSDs are proving to be a technology answer to the new generation of storage needs, both the growing performance and the growing capacity requirements. Here's the simple, logical way to think about SSDs and HDDs and their role in storage solutions. Use the right tool for the job. That is, take advantage of SSDs for performance (particularly small block, random I/O) and HDDs for capacity.
You might challenge me now and ask, "Does adding SSDs (Flash) to IT solutions make economic sense?" SSDs are expensive, but, used appropriately, SSDs can also minimize the number of HDDs required in a given solution. The secret is in optimizing the use of both, that is, avoid overprovisioning of both. Thin provisioning of capacity has become popular as a cost saver. Similarly, thin provisioning of performance is a similar cost saver. (This is a benefit of virtualized caching or tiering capabilities of newer storage solutions.)
I'll close with a few proof points. Look to the latest economically sensible storage solutions that are answering today's performance and capacity calls. The vast majority of affordable "Ultrabooks" incorporate both flash and hard drive technology, as does Apple's latest "Fusion" drive.
SYS-CON Events announced today Sematext Group, Inc., a Brooklyn-based Performance Monitoring and Log Management solution provider, will exhibit at SYS-CON's DevOps Summit 2015 New York, which will take place on June 9-11, 2015, at the Javits Center in New York City, NY. Sematext is a globally distributed organization that builds innovative Cloud and On Premises solutions for performance monitoring, alerting and anomaly detection (SPM), log management and analytics (Logsene), search analytics (S...
Mar. 28, 2015 01:00 PM EDT Reads: 3,326
In the midst of the widespread popularity and adoption of cloud computing, it seems like everything is being offered “as a Service” these days: Infrastructure? Check. Platform? You bet. Software? Absolutely. Toaster? It’s only a matter of time. With service providers positioning vastly differing offerings under a generic “cloud” umbrella, it’s all too easy to get confused about what’s actually being offered. In his session at 16th Cloud Expo, Kevin Hazard, Director of Digital Content for SoftL...
Mar. 28, 2015 01:00 PM EDT Reads: 1,336
The WebRTC Summit 2014 New York, to be held June 9-11, 2015, at the Javits Center in New York, NY, announces that its Call for Papers is open. Topics include all aspects of improving IT delivery by eliminating waste through automated business models leveraging cloud technologies. WebRTC Summit is co-located with 16th International Cloud Expo, @ThingsExpo, Big Data Expo, and DevOps Summit.
Mar. 28, 2015 01:00 PM EDT Reads: 1,419
SYS-CON Events announced today Arista Networks will exhibit at SYS-CON's DevOps Summit 2015 New York, which will take place June 9-11, 2015, at the Javits Center in New York City, NY. Arista Networks was founded to deliver software-driven cloud networking solutions for large data center and computing environments. Arista’s award-winning 10/40/100GbE switches redefine scalability, robustness, and price-performance, with over 3,000 customers and more than three million cloud networking ports depl...
Mar. 28, 2015 12:45 PM EDT Reads: 2,379
Hosted PaaS providers have given independent developers and startups huge advantages in efficiency and reduced time-to-market over their more process-bound counterparts in enterprises. Software frameworks are now available that allow enterprise IT departments to provide these same advantages for developers in their own organization. In his workshop session at DevOps Summit, Troy Topnik, ActiveState’s Technical Product Manager, will show how on-prem or cloud-hosted Private PaaS can enable organ...
Mar. 28, 2015 12:45 PM EDT Reads: 986
@ThingsExpo has been named the Top 5 Most Influential M2M Brand by Onalytica in the ‘Machine to Machine: Top 100 Influencers and Brands.' Onalytica analyzed the online debate on M2M by looking at over 85,000 tweets to provide the most influential individuals and brands that drive the discussion. According to Onalytica the "analysis showed a very engaged community with a lot of interactive tweets. The M2M discussion seems to be more fragmented and driven by some of the major brands present in the...
Mar. 28, 2015 12:45 PM EDT Reads: 4,588
Countless business models have spawned from the IaaS industry. Resell Web hosting, blogs, public cloud, and on and on. With the overwhelming amount of tools available to us, it's sometimes easy to overlook that many of them are just new skins of resources we've had for a long time. In his General Session at 16th Cloud Expo, Phil Jackson, Lead Developer Advocate at SoftLayer, will break down what we've got to work with and discuss the benefits and pitfalls to discover how we can best use them t...
Mar. 28, 2015 12:15 PM EDT Reads: 1,374
The world's leading Cloud event, Cloud Expo has launched Microservices Journal on the SYS-CON.com portal, featuring over 19,000 original articles, news stories, features, and blog entries. DevOps Journal is focused on this critical enterprise IT topic in the world of cloud computing. Microservices Journal offers top articles, news stories, and blog posts from the world's well-known experts and guarantees better exposure for its authors than any other publication. Follow new article posts on T...
Mar. 28, 2015 12:00 PM EDT Reads: 1,356
Getting started is often the hardest part of any project, and converting your data center into a Git Repository is no different. In his session at 16th Cloud Expo, Christopher Gallo, Developer Advocate for SoftLayer, an IBM Company, will discuss some of the more popular configuration management suites, with some practical examples showing off the power of SaltStack. Hopefully, by the end of this presentation, you’ll be ready to stop deploying changes manually and enter the magical world of sof...
Mar. 28, 2015 12:00 PM EDT Reads: 1,321
SYS-CON Media announced that IBM, which offers the world’s deepest portfolio of technologies and expertise that are transforming the future of work, has launched ad campaigns on SYS-CON’s numerous online magazines such as Cloud Computing Journal, Virtualization Journal, SOA World Magazine, and IoT Journal. IBM’s campaigns focus on vendors in the technology marketplace, the future of testing, Big Data and analytics, and mobile platforms.
Mar. 28, 2015 11:15 AM EDT Reads: 1,601
DevOps tasked with driving success in the cloud need a solution to efficiently leverage multiple clouds while avoiding cloud lock-in. Flexiant today announces the commercial availability of Flexiant Concerto. With Flexiant Concerto, DevOps have cloud freedom to automate the build, deployment and operations of applications consistently across multiple clouds. Concerto is available through four disruptive pricing models aimed to deliver multi-cloud at a price point everyone can afford.
Mar. 28, 2015 11:00 AM EDT Reads: 847
SYS-CON Events announced today that SafeLogic has been named “Bag Sponsor” of SYS-CON's 16th International Cloud Expo® New York, which will take place June 9-11, 2015, at the Javits Center in New York City, NY. SafeLogic provides security products for applications in mobile and server/appliance environments. SafeLogic’s flagship product CryptoComply is a FIPS 140-2 validated cryptographic engine designed to secure data on servers, workstations, appliances, mobile devices, and in the Cloud....
Mar. 28, 2015 11:00 AM EDT Reads: 1,355
SYS-CON Events announced today the IoT Bootcamp – Jumpstart Your IoT Strategy, being held June 9–10, 2015, in conjunction with 16th Cloud Expo and Internet of @ThingsExpo at the Javits Center in New York City. This is your chance to jumpstart your IoT strategy. Combined with real-world scenarios and use cases, the IoT Bootcamp is not just based on presentations but includes hands-on demos and walkthroughs. We will introduce you to a variety of Do-It-Yourself IoT platforms including Arduino, Ras...
Mar. 28, 2015 11:00 AM EDT Reads: 2,005
SYS-CON Events announced today that the DevOps Institute has been named “Association Sponsor” of SYS-CON's DevOps Summit, which will take place on June 9–11, 2015, at the Javits Center in New York City, NY. The DevOps Institute provides enterprise level training and certification. Working with thought leaders from the DevOps community, the IT Service Management field and the IT training market, the DevOps Institute is setting the standard in quality for DevOps education and training.
Mar. 28, 2015 10:30 AM EDT Reads: 869
Plutora provides enterprise release management and test environment SaaS solutions to clients in North America, Europe and Asia Pacific. Leading companies across a variety of industries, including financial services, telecommunications, retail, pharmaceutical and media, rely on Plutora's SaaS solutions to orchestrate releases and environments faster and with integrity. Products include Plutora Release Manager, Plutora Test Environment Manager and Plutora Deployment Manager.
Mar. 28, 2015 10:15 AM EDT Reads: 1,526
SYS-CON Events announced today the DevOps Foundation Certification Course, being held June ?, 2015, in conjunction with DevOps Summit and 16th Cloud Expo at the Javits Center in New York City, NY. This sixteen (16) hour course provides an introduction to DevOps – the cultural and professional movement that stresses communication, collaboration, integration and automation in order to improve the flow of work between software developers and IT operations professionals. Improved workflows will res...
Mar. 28, 2015 10:00 AM EDT Reads: 1,516
Mar. 28, 2015 09:45 AM EDT Reads: 1,448
Containers and microservices have become topics of intense interest throughout the cloud developer and enterprise IT communities. Accordingly, attendees at the upcoming 16th Cloud Expo at the Javits Center in New York June 9-11 will find fresh new content in a new track called PaaS | Containers & Microservices Containers are not being considered for the first time by the cloud community, but a current era of re-consideration has pushed them to the top of the cloud agenda. With the launch ...
Mar. 28, 2015 09:15 AM EDT Reads: 2,159
Modern Systems announced completion of a successful project with its new Rapid Program Modernization (eavRPMa"c) software. The eavRPMa"c technology architecturally transforms legacy applications, enabling faster feature development and reducing time-to-market for critical software updates. Working with Modern Systems, the University of California at Santa Barbara (UCSB) leveraged eavRPMa"c to transform its Student Information System from Software AG's Natural syntax to a modern application lev...
Mar. 28, 2015 09:00 AM EDT Reads: 767
SOA Software has changed its name to Akana. With roots in Web Services and SOA Governance, Akana has established itself as a leader in API Management and is expanding into cloud integration as an alternative to the traditional heavyweight enterprise service bus (ESB). The company recently announced that it achieved more than 90% year-over-year growth. As Akana, the company now addresses the evolution and diversification of SOA, unifying security, management, and DevOps across SOA, APIs, microser...
Mar. 28, 2015 08:30 AM EDT Reads: 2,000