Mobile app testing services put an outside QA team on your iOS and Android builds, run the app on real devices across operating system versions and network conditions, check it against the app store review rules, and report what breaks before your users find it. Both platforms have to be covered, because in August 2026 iOS held 60.68% of United States mobile traffic and Android held 39.29%, on Statcounter's measurement.
The work divides into three parts that are usually staffed separately. There is functional and regression testing of the app itself, there is device and operating system coverage across the models your users actually carry, and there are the release checks the two app stores impose before a build goes live. This article covers all three, plus the choice between real devices, emulators and a cloud device farm, which is where most of the coverage budget goes.
What do mobile app testing services actually cover?
A mobile engagement is sold as one service and delivered as six workstreams. Knowing which six you are buying stops a proposal being priced against the wrong scope.
Functional and regression testing of the build. Someone installs each candidate build and walks the journeys that earn money: sign up, sign in, search, add to cart, pay. This is application testing applied to an installable artefact, and you cannot patch an installable artefact after release without going back through a store.
Device and operating system coverage. The same build behaves differently on different hardware, and device interoperability testing decides which combinations get run and which get skipped. The coverage matrix is the most negotiable part of a mobile quote, because every row on it costs time.
Automation of the repeatable parts. UI automation on a phone is slower and more fragile than in a browser, so the sensible split is a small automated suite over the paths that must never break plus manual exploratory work elsewhere. Mobile test automation is the specific practice, and automation testing is the wider one covering your web and API suites.
Performance under real conditions. Phones throttle when they get hot, drop to one bar in a lift, and kill background processes when memory gets tight. Performance testing on mobile means measuring startup time, frame rendering, memory growth and battery drain on hardware, and load testing covers the servers behind the app.
The API layer the app talks to. Most mobile defects that look like app bugs are contract bugs between the client and the backend, so API testing runs alongside the device work.
Security and store readiness. Mobile security testing covers the app package, its stored data, its network traffic and its resistance to tampering, and store readiness covers the checklist Apple and Google apply before your release reaches anyone. Accessibility testing sits across all six and is a contract requirement for public-sector and enterprise buyers.
How is mobile app testing different from web testing?
Three differences change how the work is planned, and each has a consequence you can price.
You cannot ship a fix in ten minutes. Fixing a web defect means a deploy. Fixing a mobile defect means a new build, then a store review, then a wait while users update, and some of them never do. That is why mobile test plans push more effort before release than web plans do, and why the exit criteria are stricter.
The store measures your quality and acts on it. Google Play publishes bad behaviour thresholds in Play Console and states the consequence plainly: "If your app exceeds these thresholds, it's likely to be less discoverable on Google Play. In some cases, a warning could be shown on your app's store listing to set user expectations." Overall bad behaviour is "At least 1.09% of daily users experience a user-perceived crash, across all device models" and "At least 0.47% of daily active users experience a user-perceived ANR across all device models", where an ANR is an application-not-responding event.
The per-device thresholds decide how wide your device matrix has to be. Google sets them at "At least 8% of daily users experience a user-perceived crash, for a single device model", and the same 8% for ANRs on a single model. An app with a clean aggregate crash rate can still be in breach on one handset, and you will only know if that handset was in the test plan or in your Play Console data.
Mobile apps have to handle external interruptions. Calls arrive, notifications land, the operating system backgrounds the app to save memory, a user revokes the camera permission from Settings, and the phone updates its OS overnight without asking. None of these have a web equivalent, and all of them belong in the test plan as named cases.
If your product is a responsive site with no installable app, you need web application testing.
Should mobile app testing run on real devices, emulators or a cloud device farm?
You need all three, and what you are deciding is how much of the run sits on each. Apple is direct about what its own Simulator cannot tell you. Its archived Simulator guide says: "Simulator is a useful tool, but it should not be the only way you test an app. Because the simulator is an app running on a Mac, it has access to the computer's resources, including the CPU, memory, and network connection. All of these resources are likely to be faster than those found on a mobile device. As a result, the simulator is not an accurate test of an app's performance, memory usage, and networking speed."
The same page lists the hardware the Simulator does not reproduce: motion support through the accelerometer and gyroscope, audio and video input through the camera and microphone, the proximity sensor, the barometer and the ambient light sensor. That list is pinned by Apple to iOS 8.2 and the document is archived, so read it as the direction of the limitation.
| Option | What it is good for | What it cannot tell you | What it costs |
|---|---|---|---|
| Emulator or simulator on a build machine | Layout, navigation and business logic on every commit, across many screen sizes | Real performance, memory growth and network behaviour, plus the hardware Apple lists as unsimulated | Firebase Test Lab virtual devices are free to 60 minutes a day on Blaze, then $1 per device hour |
| Physical devices your team holds | Hardware in the loop: camera, biometrics, Bluetooth pairing, battery drain, thermal throttling, carrier networks | Anything on a model nobody in the room owns | No per-minute charge, and a purchase, charging, updating and storage cost that rarely appears in a test plan |
| Cloud real device farm | Breadth on demand and parallel runs across many models in one suite | Anything needing a SIM you control, a named carrier, or an accessory the provider does not stock | AWS Device Farm charges $0.17 per device minute after a one-time 1,000 device minute trial, or $250 per device slot per month unmetered |
Most teams settle on the emulator in continuous integration, owned devices for the hardware-dependent cases, and the cloud farm for the pre-release sweep across models nobody owns. Ask a vendor which of your runs sits in which column, because "real device testing" without a stated proportion does not tell you what you are buying.
How many devices and operating system versions does a mobile app testing plan have to cover?
Start from your own analytics, and use the Statcounter figures below to check the wider market for gaps.
| United States mobile market, August 2026 | Share |
|---|---|
| iOS, share of all mobile traffic | 60.68% |
| Android, share of all mobile traffic | 39.29% |
| iOS 26.6, the largest single iOS release | 41.19% |
| iOS 26.6 and iOS 26.5 added together | 76.56% |
| Android 16.0, the largest single Android release | 39.05% |
| The six Android releases Statcounter lists, added together | 86.75% |
| 414x896, the most common mobile screen resolution | 21.26% |
| The six most common resolutions, added together | 52.34% |
The three totals are sums of Statcounter's published rows, and the Android and resolution sums cover only the six rows it lists.
Two things follow from that shape. iOS coverage concentrates and Android coverage does not, because two iOS point releases reach three quarters of iOS traffic while the largest single Android version reaches under 40% of Android traffic. Screen size is then its own axis, since a layout checked only on the most common resolution has been checked against about a fifth of the market.
Statcounter prints a caveat on its own iOS page: "Apple's Safari anti-fingerprinting changes misreported iOS 26.2 as 18.7 and iOS 26.1 as 18.6. Patch applied on 19 Jan 2026 to correct Apple-introduced distortion." The two iOS 18 rows are therefore not a clean read of how many people still run iOS 18.
Vendor share sets the Android hardware question. Statcounter puts Apple at 60.68% of United States mobile traffic, Samsung at 21.97%, Xiaomi at 4.32%, Motorola at 4.1% and Google at 2.65%. Samsung is the one to reason about first, because its devices carry a manufacturer software layer and behave differently from a reference build.
What goes into a mobile app test strategy?
A mobile app test strategy is a short document, and five sections carry the weight.
The device and operating system matrix, with a reason on every row. Each row should name why it is there: highest traffic share in your analytics, a manufacturer software layer, the oldest OS version you support, a screen size that breaks the layout, or a model already flagged in Play Console. Rows without a reason are the first thing cut when the schedule tightens.
The operating system floor. Your minimum supported version on each platform is a commercial decision with a test cost attached, and it should be written down with the traffic it protects.
The automation split. Name which journeys are automated, which are manual, and what the automated suite is allowed to gate.
Entry and exit criteria tied to numbers you can check. Google's published thresholds give you a defensible exit line: a user-perceived crash rate under 1.09% and a user-perceived ANR rate under 0.47% overall, with no single device model above 8% on either. Those are the numbers Google uses to decide your discoverability, so they are hard to argue with internally.
Test data, accounts and environments. Mobile testing needs seeded accounts, payment sandboxes, push notification certificates and demo credentials for the store reviewer, and every one is your side of the line. Production test data must be scrubbed for privacy compliance.
What do iOS and Android app testing services have to do differently?
The two platforms fail in different ways and gate releases under different rules, so the two halves of a quote should not look the same.
iOS app testing covers fewer models and moves faster. Adoption of a new release is quick, the hardware range is small, and Apple sets a build floor. Since 28 April 2026, Apple requires that "Apps uploaded to App Store Connect must be built with Xcode 26 or later using an SDK for iOS 26, iPadOS 26, tvOS 26, visionOS 26, or watchOS 26." Because the SDK moves under you on a schedule, iOS regression risk clusters around OS upgrades.
Android app testing covers more hardware and carries a policy deadline. Google Play states that "Starting August 31, 2026: New apps and app updates must target Android 16 (API level 36) or higher to be submitted to Google Play", with narrower rules for Wear OS, Android Automotive OS, Android TV and Android XR, and that "Existing apps must target Android 15 (API level 35) or higher to remain available to new users on devices running Android OS higher than your app's target API level." Developers who need longer can "request an extension to November 1, 2026".
One Play rule catches small teams. Google requires that "Developers with personal accounts created after November 13, 2023, must run a closed test for their app with a minimum of 12 testers who have been opted in continuously for at least 14 days" before they can apply for production access. That applies to personal developer accounts only, and it puts a two-week floor on a first Android launch that has nothing to do with how fast your QA runs.
Where one codebase ships to both stores, as in cross-platform app development, the differences land inside it. Where each platform has its own codebase, as in native app development, the two test plans should be costed separately.
What do the app stores check before they approve a release?
Apple publishes both its timing and its most common failure. On timing: "On average, 90% of submissions are reviewed in less than 24 hours." On failures: "On average, over 40% of unresolved issues are related to guideline 2.1: App Completeness, which covers crashes, placeholder content, incomplete information, and more."
Most of what fails under that guideline is a defect. Apple's instruction under it reads: "Submit items for review only when they're complete and ready to be published. Make sure to thoroughly test on devices running the latest software and fix all bugs before submitting." Three of the traps Apple names are things a test pass catches. Every link in the app has to work, and a working support link and a privacy policy link are required in every app. Placeholder text and unfinished images have to be gone. Reviewer access has to be handed over, which Apple spells out: "If some features require signing in, provide a valid demo account username and password. If there are special configurations to set, include the specifics. If features require an environment that is hard to replicate or require specific hardware, be prepared to provide a demo video or the hardware."
Two categories carry an extra document. For medical hardware, Apple asks you to "provide a copy of regulatory clearance for the locations where the app is available". For licensed services, which Apple lists as "real money gaming and gambling, lotteries, raffles, and VPN licensing", you provide the authorisation, and it varies by region.
Google Play publishes a warning about review times: "For certain developer accounts, we'll take more time to thoroughly review your app to help better protect users. This may result in review times of up to seven days or longer in exceptional cases." Plan the release calendar against seven days on Android and a same-day turnaround on iOS.
What does device access cost inside a mobile app testing budget?
Device access is the one mobile cost you can price exactly before signing anything.
Firebase Test Lab charges nothing on the Spark plan beyond a daily cap of 10 virtual device tests and 5 physical device tests. On the Blaze plan, virtual device tests are free up to 60 minutes a day and then cost $1 per device hour, and physical device tests are free up to 30 minutes a day and then cost $5 per device hour.
AWS Device Farm comes with a one-time free trial of 1,000 device minutes and then charges $0.17 per device minute, with unmetered device slots at $250 per slot per month. On that published rate, a 40-minute suite across 12 devices is 480 device minutes and costs $81.60 per run.
BrowserStack advertises "30,000+ real iOS and Android devices" across "365+ Device models" on its App Live page. Those are vendor claims on a vendor marketing page, and the same page's browser title says 2000+ devices, so the figure worth using in a coverage conversation is the model count.
Owned hardware has no per-minute charge and a running cost that rarely reaches the test plan: buying the devices, charging them, keeping their operating systems at the versions you intend to test, replacing batteries, and storing them where they can be found. When a vendor quotes a device lab, ask what the refresh cycle is and who pays for it.
An anonymised engagement: a cross-device booking and check in front end
Vervali rebuilt and tested the booking and check-in front end for an airline in India. The work covered a revamped front-end architecture for responsiveness and cross-device behaviour, together with manual testing, automation, cross-browser testing and real-device testing.
On the client's own reported figures:
Page load time and mobile responsiveness improved by 40%
Test coverage across booking and check-in reached 85%
Customer-reported issues fell by 70% within two release cycles
The tooling was JMeter, BrowserStack, Azure DevOps, Playwright and AWS. This was a cross-device web front end with no native app, so no app store submission was involved, and the numbers are evidence of cross-device coverage.
A second engagement was a native mobile build. Vervali built a health monitoring app in the United Kingdom that pairs with multiple Bluetooth Low Energy medical devices and handles continuous glucose, temperature, heart rate, blood pressure and oxygen saturation readings with offline sync. The reported outcomes were 98% user satisfaction and a 90% reduction in manual patient monitoring, and both are product outcomes from a build. An app whose core function relies on a paired physical device cannot be verified on an emulator.
On the security side, Vervali ran an end-to-end assessment for a SaaS gaming platform covering web apps, mobile apps, APIs, source code and backend infrastructure, using MobSF and Frida alongside Burp Suite and OWASP ZAP. The reported outcome was 100% coverage across agreed web, mobile, API, source-code and infrastructure scope, and the wording matters, because agreed scope states what was tested. Buyers who need this layer should ask who personally runs the assessment and what that individual holds, on any vendor, including this one. Further engagements are on the case studies page.
Vervali runs a team of 300+ and holds ISO/IEC 17025:2017, CMMI Maturity Level 3, ISO 9001:2015 and ISO/IEC 27001. ISO/IEC 17025:2017 is the standard for testing and calibration laboratory competence, so an assessor examines the technical competence of the people and equipment producing the result, and it is uncommon among software services firms because most are not structured as laboratories.
What should you ask a mobile app testing vendor on the first call?
Ask these five questions on the first call to compare vendors:
"Which physical devices do you hold, which do you rent, and what happens when my users are on a model you have neither?" The right answer is a list and a fallback, usually a named cloud farm. A count on its own does not tell you whether those are the handsets your customers use.
"What are my current user-perceived crash and ANR rates, and what will they be when you finish?" Both numbers are already in your Play Console, and a firm that has read them before the call has done the homework. Ask for the per-device breakdown too, because the 8% single-model threshold is where a clean aggregate hides a problem.
"Which of my runs are on real hardware and which are on an emulator?" Ask for the split as a proportion of the suite.
"Who owns the store submission, and who fixes a rejection?" A rejection under Apple's guideline 2.1 is usually a defect, which puts it with whoever was testing. Agree in advance whether resubmission work is inside the scope or a change request.
"What do you need from me in week one?" A firm that has done this before will ask for signed builds on both platforms, demo credentials for the store reviewer, a payment sandbox, push notification certificates, and access to your analytics and Play Console.
When is a mobile app testing service the wrong thing to buy?
Four situations come up often enough to name, and in all four an external testing engagement is the wrong purchase.
Your problem is one device model. If Play Console shows a single handset above the 8% threshold and everything else is clean, that is a debugging job on a specific device. Buy or borrow the handset and read the stack traces you already have.
You have no repeatable build. Mobile testing needs installable artefacts on demand, signed for both platforms. If producing a test build is a manual afternoon for one engineer, an external team will spend its first weeks waiting and you will pay for the waiting.
Nobody internally can hold a release. An external firm reports defects and cannot decide which ones block a submission. Without an internal owner who can stop a release, the reports accumulate and the engagement gets judged on an outcome it never controlled.
Your product is a website that people open on a phone. That needs web application testing and responsive coverage, and a device-heavy mobile programme will cost more and find less.
If you are scoping a mobile programme, the mobile application testing service page sets out how the device matrix, the automation split and the store readiness work are quoted, mobile app development covers the build side where the same team writes and tests the app, and the contact page routes to a scoping call.