In this white paper, we describe a leading IT services provider’s experience in cloud benchmarking. The assessment was conducted, for a Latin America Telecom customer, in collaboration with a leading organization for benchmarking cloud infrastructure. We focus on the cloud benchmarking strategy adopted for the customer’s different cloud configurations. Numerous benchmarking test suites were also executed. The customer’s cloud performance was measured against multiple metrics including analyzing comparatively their cloud performance against other cloud vendors.
There are multiple infrastructure elements that function together to form the IaaS cloud platform. Hence, it is necessary to identify the critical components of the underlying infrastructure and assess their performance against the benchmark. The following five key performance metrics were utilized to assess the performance of customer’s cloud environment, and are part of our partners’ computing benchmark test suite:
- CPU Performance Metric
- Disk IO Performance Metric
- Memory IO Performance Metric
- Encoding and Encryption Performance Metric
- Programming Language Performance Metric
The service provider must take steps to instill confidence in cloud computing, which in turn will pave the way for increasing demand and a wider adoption of cloud services. Benchmarking also enables the cloud services provider to continually reinvigorate its cloud offering by identifying and remediating performance bottlenecks and implementing strict cloud governance standards. In addition, it can help emerging as well as established cloud service providers to assess where they are in comparison to the top vendors and leverage this knowledge to re-strategize their cloud architecture. It is important to understand that benchmarking is one of the ways to continuously improve, strengthen and sustain the established infrastructure cloud platform services.
We conclude with a note on the importance of benchmarking cloud infrastructure and its relevance in enabling wider cloud adoption.