We give a big shout-out to NetApp on the recent launch of its Enterprise Storage Systems (the E2700 and E5500 products) which bring the benefits of the E-Series technology to the broad storage markets. This is a strong validation of Teradata’s decision over two decades ago to use this basic technology and its successive generations for our data warehouse platforms.
Data warehousing presents unique and challenging demands for high performance on the storage portion of the platform solution. The data analytics and business intelligence workloads of a data warehouse are all about accessing enormous amounts of data as quickly as possible and with minimum delay. The NetApp E-Series storage has long fully supported these performance needs for our integrated data warehouse platforms including the Active Enterprise Data Warehouse and the Data Warehouse Appliance. In fact, as of this posting we have deployed more than 545 PB of data storage in thousands of Teradata's customer sites world-wide. This includes 10.3 PB of solid state drive-based flash storage delivering highest performance.
Teradata systems are massively parallel processing (MPP) systems in a shared-nothing configuration of compute nodes each tied to dedicated storage. Each node can demand well over a hundred drives to meet performance demands, and the systems can scale up to 100s of petabytes. Bottom line is that Teradata systems take full advantage of the E-Series storage solutions for the flexible modularity and extreme scalability they deliver.
Data analytics and business intelligence have now become an integral part of the operation of all successful businesses today. This means that Teradata data warehouse systems are mission-critical for these businesses since they want no more than a few minutes of downtime in a year. To reach these levels of system availability, the storage within the Teradata warehouse depends on the proven reliability and data integrity of the E-Series products to be able to reach four and five “nines” of availability.
The future data warehouse needs are driven by, of course, solutions to enable companies to best take advantage of big data in all its forms. The Teradata Unified Data Architecture (UDA) enables a business to leverage the insights and findings from all this data with data discovery (with Teradata Aster) and data loading/refining and archive (with Hadoop and other data platforms). With all these insights and findings operationalized for the whole business in the Teradata integrated data warehouse, the need for faster, more scalable and more robust storage is even greater than in the past. The innovative product roadmap of the NetApp E-Series products is targeted to support this.
Big data analytics is now table stakes for any business to be successful. Whereas many storage providers seem smitten by the high volumes of data and how to sell lots of “big” storage, the really crucial challenges in big data are the velocity and variety of data required for running the business. Solutions to these challenges, like the Teradata UDA, need storage products such as NetApp E-series, with performance, flexibility, and availability.
Ryan Leonard, Consulting Systems Engineer at NetApp, has written about the introduction of the company’s new all-flash array and performance-optimized enterprise storage systems. You can read what he has to say here.