THE CHALLENGE
App field testing was needed when Apogee Indigo launched their new Travel App that’s used as a payment method at partnered restaurants. They hired our team of experts to field test the App and the payment terminals used by restaurant staff.
Most developers, including Google, tout the importance of App field testing under real-world conditions to identify performance, usability, and compatibility issues before launching widely. So Apogee Indigo hired IntelliShop to test the bugs right out of their App.
CLIENT OBJECTIVES
With our App Field Testing solution, the client sought to:
- Field test the App and payment terminals using our network of evaluators
- identify bugs in the registration, fund loading, and payment process
- Provide actionable insights to help them identify training needs and correct issues
APPROACH
With our App field testing approach in mind, IntelliShop recommended:
- Our evaluators were given specific task instructions to field test the App and registration process to discover any issues that needed correction. They would also evaluate how well the servers managed the terminals.
THE SOLUTION
Our team outlined the App Field Testing solution that would help familiarize the staff at partnered restaurants with the App and terminal while also identifying bugs in the registration, fund loading, and payment process.
THE RESULTS FROM OUR APP FIELD TESTING SOLUTION
The reporting details helped our client identify additional training needs as well as the sources of the App issues that needed correction. In secondary testing, the results were outstanding.
Bug Discovery
Based on panel feedback, bugs in the registration processes were found. The details provided allowed for the identification of the issue source and the implementation of corrective action, decreasing bugs found from 32% to 13%.
Training Opportunity
Data showed that:
- Only 46% of servers knew how to use the terminal
- After new training was put into place, the number grew to 89% in second-round testing
What Apogee Indigo Has to Say
“IntelliShop’s [App Field Testing] program provided a lot of value. It familiarized our merchant partners with the Apogee Indigo program while providing us with actionable data—from identifying further training needs to bugs in the transaction processing across the terminal and app.”
KEY METRICS
- App bugs found were decreased by 59%
- Terminal usage knowledge was increased by 93%