Andrew Bonwick
Vice President of Product Development at Relm Insurance
Madhav Sheth
CEO of Ai+ Smartphone
Stephen Rose
CEO Render Networks

Bharti Airtel, India’s largest telecommunications services provider, and Viavi Solutions announced they have jointly conducted measurement and analysis of 4G and 3G smartphone performance—representing over 8,000 smartphone models—crowdsourced using big data approach from the live Airtel network, with the help of location intelligence platform.

The analysis was intended to evaluate variation in the key performance indicators (KPIs) impacting user experience in various smartphone models, to develop a process for smartphone qualification using real-world quality of experience samples, and to provide manufacturers with data to improve future products. This initiative would shed light on smartphone quality and its impact on user experience, especially in an open market for devices.
Methodology
A set of KPIs were selected to represent user experience based on smartphone performance. Viavi’s location intelligence platform recorded measurements of these KPIs from smartphones representing 2.2 million unique subscribers in Delhi, the capital city of India. For each KPI, a benchmark was set to indicate the minimum performance expected. For a 4G smartphone to qualify, it should meet the set threshold in 8 out of 12 parameters or KPIs (at least four each for 4G & 3G). A 3G only smartphone would qualify upon meeting set threshold in 4 out of 6 KPIs.
Key findings
Of the 8,000 unique smartphone models that were part of the study, 300 models accounted for 80 percent of the total smartphone population.
Amongst the top 128 smartphone models, around 23 percent of 4G smartphones and 13 percent of 3G only smartphones did not meet the qualification benchmarks.