All around the world, Cyara's global Professional Services team has been especially busy in the past few weeks running load tests. Regardless of the customer or the region, some things are common with these tests.
First-time Load Tests
Initially most customers engage with Cyara for a load test because they view the test as the final green light to validate that their code changes are ready for prime time. It's common for customers to expect that their first load test will be error free. What actually happens, however, is that the first load test uncovers an initial “punch list” of defects and performance issues. Our team has yet to run an initial load test that didn't uncover issues.
CXIL and Load Tests
Other customers, who have worked with Cyara over a longer period of time, have developed a more mature customer experience innovation life cycle (CXIL). It's common for these customers to realize that modified code in one part of the application can cause issues in other parts of the application that they didn’t even touch. They know from experience that these defects will be exposed in the production system. These customers see load testing as the only sure way to fine-tune their customer experience.
Annual Load Tests
One customer that we have worked with over a number of years is a leading retailer of computers and mobile devices. This customer runs load tests every year over their entire worldwide infrastructure. This ensures that minor changes that have occurred during the year don't impact their busy season when delivering great customer service is most important to them.
We're still in the process of testing their infrastructure for 2016. We were surprised that the first two sites we tested had very different outcomes. The first site ran through the test flawlessly and showed very good results. The second site was also expected to be flawless since this site runs the same infrastructure as the first site and the concurrent ports were also the same as in the first site. Even so, issues were discovered and resolved. This illustrates the point that whether it's your first test or one of many, load tests commonly uncover unexpected issues. Commenting on the differences in the two sites, the customer said, "That's why we load test! It's the only way to find issues before they impact our customers."
At Cyara, the common experience we want to drive home to our customers is that testing early and across your infrastructure ensures your customers get the experience you've designed. We're getting there, one load test at a time.
Find out more about Cyara Load Testing!