Terminal testing for network operators: the applications and limitations of a network simulator: Page 4 of 7

July 13, 2015 //By Francois Ortolan, Anritsu (EMEA)
Mobile phone subscribers care nothing about the complex mix of factors underlying the performance of their handset in the real world. By and large, if the user experiences a dropped call, or a low data download rate, or poor voice quality, he or she will blame the network operator. The real cause of the poor performance might be the handset, or the backhaul network - factors outside the direct control of the operator. To subscribers, this is irrelevant: they pay for mobile network service, and if they do not get it, the service provider must be at fault.
Regression testing

Perennial problems are caused for network operators by the operating system software upgrades released by handset manufacturers; these sometimes profoundly degrade the user experience. As stated above, the subscriber will tend to blame the operator for any impairment to the performance of their handset, even if the handset manufacturer's software upgrade caused the impairment.

Simulator tests form a crucial part of a safe roll-out programme for such software upgrades. Using a simulator, the operator can run a series of automated tests to measure the performance and stability of the new software build in a wide variety of network conditions and use cases. The results obtained can be compared with the results of previous benchmark tests to show whether performance is impaired by the new software. Such benchmark tests may be followed by small-scale statistical field trials, before finally allowing a full network-wide deployment.

Application testing

Hardware performance underlies the user's experience of a handset. But what the user sees are applications, and their subjective judgements about the quality of a network are normally based on their experience of using their favourite applications (see Figure 3).

Figure 3: the application types most commonly used on smartphones.

Design category: