Case Study: Wireless Earbuds - Performance Testing

By: Nextgen | On: Jul 21, 2020 | In: Case Studies

< All posts

A Smartphone manufacturer plans to remove the physical audio port from their flagship phones. In parallel with this, a new pair of wireless Bluetooth earbuds are being introduced. Since customers will now use wireless connection by default the audio quality and connection stability between the new Bluetooth earbuds and the phone must be tested to ensure the customer will have a good user experience.

Test Setup

The test was set up with the phone connected to the ATAM System Controller over ADB for phone control and using the Client App. The earbuds were paired with the phone with the microphones from ATAM CH2 and CH3 were placed next to the audio output of the left and right earbuds respectively.

audio-quality-element
How the Test Functions

- With this set up the customer was able to confirm that the headsets remained connected to the phone over a long period of time with no dropouts. This was done by streaming BT audio over many hours and confirming that there were no gaps in the audio detected.

- ATAM was also able to confirm that the audio quality was good while using various file types and codecs. This could be set up easily with no changes to the test script or set-up.
 ATAM was able to detect gaps of 10ms and check for distortion of a known tone. If distortion is too great then ATAM would register a test failure.



test-setup

- A further layer of complexity was also added into the test by including a test for Bluetooth Linkloss. Adding a programmable attenuator controlled by ATAM allowed simulation of someone walking out of range on the phone while wearing the headphones then coming back into range. This allowed the point at which the connection dropped to be determined and also for auto reconnection when returning to range.



test-setup-2

The Results

ATAM automated testing program confirmed the performance of the products and that they met the quality and performance standards required. Any issues were found the software could be updated and the test easily repeated to see if there was any improvement in the results. Example of expected audio detected from left and right buds. If any errors, there would be drops or spikes in the straight line showing the audio levels.

analysis
Conclusion

ATAM helped the customer quickly find and verify issues in audio streaming from mobile phone to the Bluetooth ear buds. The easy to use GUI meant that they could easily design and create test Modules quickly. With ATAM automation many tests could be run overnight and weekends to increase the number of tests performed before their tight deadline before release the product to market. The repeatability of ATAM meant that the same test could be performed on new software levels to ensure that any issue found was definitely rectified.

Share this post on:

Share on facebook

Share on linkedin

Share on twitter