NVMe Evolution

Feb 06, 2017

Having worked at Pure for three years now I have been constantly impressed by how innovative our software engineering design is.  Customers tell us all the time that they like the simplicity of operation; the fact that all hardware and software upgrades are designed to be non-disruptive and non-performance impacting; and the feedback that the cloud-based management and monitoring framework helps avoid and often resolve issues before they have an impact to operations.

Because of these innovations, it is easy to overlook the importance of hardware innovation and the flexible, well engineered design of Pure Storage.  One area of this hardware development and “looking around the corner” is the plan Pure has for development of NVMe.

So, what is the evolution of NVMe and why is this so important? Most current storage systems, both all flash arrays and hybrid arrays typically use SAS (serial attached SCSI) links from their controller processors to communicate to flash. While SCSI solved the fundamental issue of having multiple devices to communicate to a single device, it was designed for disk and has in and of itself started to become a bottleneck. And as flash drives get larger and larger every year, there can be a bottleneck for communicating to the flash which means that data cannot enter and exit the flash drive fast enough.

Taking that further, each connection from CPU core to flash is limited by the SAS host bus adapter and synchronized locking. This serial bottleneck creates performance bottlenecks within the back-end of all-flash arrays. The NVMe (over PCIe) protocol brings massive parallelism to an area where previously there was none. With NVMe there is the opportunity to leverage 64,000 queues for communication which gives much more access to each CPU core. This simply means data can get to and from the SSD with much more efficiency.

The adoption of NVMe in storage arrays will have several key benefits that can be expected in data centers. Three key benefits include higher density, improved performance, and greater consolidation. 

Over the course of the last five years, Pure has continued to introduce denser drives. In fact, 1PB of usable data in 2012 used to cover 6 racks; today this same amount of data can fit into 5U. With the advent of NVMe, 2017 and beyond means NVMe will allow for even greater densities.

At Pure, when we meet with customers we tell them that the array gets faster and denser the longer they own the array, and often we have to explain the hardware designed to help them understand this as it’s unfamiliar to many legacy storage customers who are constantly refreshing their arrays. Unlike most arrays which must be fully refreshed every several years, Pure storage arrays are designed from the ground up to support new technologies.

Another aspect that NVMe enables is “performance density”.  As mentioned above, as drive gets bigger, getting data from the drive itself can become more problematic.  A colleague of mine likes to say “moving data from a very large flash drive to that of drinking water from a lake with a straw”, there is a similar effect when one wants to move data from a drive. Take for example that at the outset of All Flash Arrays the average drive size was 256GB each. We are now seeing announcements for 8TB and 15TB drives from some vendors. Moving data into a drive as it increases in size as above is very much like trying to drink a lake through a straw. Maybe not a perfect analogy, but hopefully this illustrates the bottleneck well.

For example, today AFA’s (all flash arrays) often require 20 SSD’s t achieve the maximum performance that the AFA is capable of. With NVME, you’ll be able to get exceptional performance of very large flash modules or SSD’s (16TB, 32TB and beyond) without performance ability.

While exact timing is always a question, as we saw with consumer products such as smart phones drive the market with things such as commercial SSD’s, we see similarly that consumer products may drive the adoption of new connection types such as NVMe.  NVMe is widely present in consumer devices already, such as laptops, desktops and even some large-scale clouds. As we have seen, the Enterprise is usually not too far behind.

One well known industry veteran, Howard Marks makes the case that the tipping point to NVMe is coming very soon, even as soon as 2018.  Other experts suggest very broad adoption in 2019.

Our view at Pure is your array should be designed TODAY for NVMe support and you should not be penalized for buying SAS connectivity today when you will need NVMe tomorrow. The great news about Pure storage arrays, is that you pay no penalty.

Our current view is the process of retrofitting NVMe will be a very challenging one for legacy storage arrays;

  • Each Flash Array is wired for SAS and PCIe/NVMe
  • Each of the slots within the FlashArray is capable of using NVMe and SAS-capable flash modules
  • Pure controllers are non-disruptively upgradable to transition to internal and external NVMe networks
  • Flash Array uses Pure-engineered dual-ported and hot-pluggable NVMe NV-RAM devices, an industry first in 2015

Pure Storage has future-proof plan for our storage, does your vendor? In summary, with the types of innovation happening to day, it is critical that your storage vendor has a clear and non-disruptive path to supporting NVMe.

Please contact Pure or Viadex for further questions. Please join us in the next weeks for a session where we can help you understand the roadmap and the reason why adoption of NVMe will be so important.




Request a callback

Thank you, we will be in touch with you shortly.

Send us a message

Thank you, we will be in touch with you shortly.

Client Testimonials

One of the worlds leading online gaming software providers has been a very happy client since 2002:

  • Why have you chosen to work with Viadex?

    Initially it was simply a matter of supply needs; it was convenient. Over the years the relationship has shifted from one-off purchase and supply, to a mutually beneficial partnership. I continue to invest in the relationship with Viadex because it offers a lot of advantages to me as Head of IT for a global business. These advantages include but are not limited to having an advocate working for us in discussions with vendors, having someone to make contact with vendors and either arrange proof of concept engagements or provide some background and advise relating to the vendor.

  • What are the primary benefits and/or results Viadex brings to your organisation?

    Viadex understands our business, Viadex recognises that we are a global business requiring supply to many locations, invoicing to varied entitles and that we exist in a market where there are real advantages in terms of getting to market quickly and as a result we have high expectations when it comes to logistics turnaround times.

    The Viadex account team takes time to visit our IT team and understand our project roadmap which enables them to align to our needs, as well as to offer potential solutions to address on-going challenges. Viadex recognizes the high level of technical skill in our organisation and helps us connect with the appropriate calibre of representatives from various vendors.

    Viadex assists with managing our support relationships with vendors, and taking the above into account they also help us bypass the lower levels of support and obtain quality support levels.

    Viadex advises us of how best to handle vendors, how to maximise value in our engagements and how to achieve the best return on our investments by considering alternative vendors, taking note of the timing of our purchases and optimally structuring our investment.

  • What is the process of working with Viadex like?

    Viadex has a friendly, open engagement with us. Viadex invests in face time with multiple touch-points to provide a service across the IT spectrum. The relationship is professionally owned by an account executive who is assisted by a technical team and a procurement team. The friendly and generally informal engagements suit my style; however Viadex has a professional and formal image for the times when it is appropriate. Viadex strives to respond to mails with minimal delay and is always available to take a call.

  • Why would you recommend Viadex?

    As Head of IT I appreciate not having to sweat over the details of procurement and vendor management. I am enabled to focus on delivering the business solution knowing that I can rely on Viadex to represent our best interests in commercial discussions. Viadex presents their proposed solution for review after doing the legwork. I enjoy working with the Viadex team, I have learnt a lot from them and I believe they have learnt from us too. It is a true partner relationship.