Storage system benchmarking is part science and part art. The latter is especially true with benchmarks performed by vendors who are seeking to show favorable results for their own solutions. In this article, I review important information to look for and red flags to avoid.
There are three common benchmarks for enterprise storage systems: SPC-1, SPC-2, and SPECsfs. There are also popular application-specific tests that are often used as benchmarks, such as ESRP (for Microsoft® Exchange Server). Let’s take a deeper look into each one.
SPC-1 and SPC-2
First released in 2002 (for SPC-1) and 2006 (for SPC-2) by the Storage Performance Council (SPC), SPC-1 and SPC-2 are used by storage vendors to test the performance of their block-based (for example, Fibre Channel) storage subsystems. Vendors can choose to test and publish their system performance against SPC-1, SPC-2, or both.