Framework note
Appium: what the published cases show
Research desk, testautomationvendors.com · published 2026-11-12 · data as of 2026-11-12 · 47 records
- 47
- verified cases
- 10
- vendors
- 13 of 47
- name the client
- 55 of 125
- metrics with a baseline
47 verified cases in this dataset name Appium, published by 10 vendors. Grades: A 1, B 18, C 28. 13 of 47 name the client, and 55 of 125 published metrics state a baseline.
What stands out
- 01Codoid publishes 12 of the 47 Appium cases; the three vendors with the most publish 30, so a reader is looking at a concentrated set of sources.
- 0255 of 125 metrics in these cases state a before value; across all 639 metrics in the dataset the count is 209.
- 031 of 47 reach grade A, which needs a named client and one metric with both a before value and a stated method.
- 04The field left out most often is start year: 36 of 47 cases do not state it.
Counts come from verified records. A baseline is the before value a vendor states for a metric; quoted claims carry their grade and baseline flag.
- baseline:
- The measured value before the work started, against which a later value is compared. source
01Cases, vendors and grades
The count covers every verified case whose text names Appium, including vendors outside the ranked 12.
Vendors with cases: a1qa (6), Abstracta (2), Codoid (12), DeviQA (12), QAwerk (1), Qualitest (4), TestDevLab (2), TestFort (4), Testrig Technologies (3) and Zuci Systems (1).
Table view
| Item | Count |
|---|---|
| Grade A | 1 |
| Grade B | 18 |
| Grade C | 28 |
| Total | 47 |
02Clients and industries
Named clients appear in 13 cases; 34 keep the client anonymous.
Industries stated: Banking (2), Cryptocurrency wallet (2), Childcare management software (1), Cloud customer support software (1), Construction quality management software (1), Consumer lending (1), E-Commerce (1) and E-commerce (food delivery) (1).
Client types stated: enterprise (6), startup (2) and smb (1).
03Metric kinds and baselines
The Appium cases publish 125 metrics. 55 state a baseline and 5 state both a baseline and a method.
- “Cut combined mobile + web regression execution to ~35 minutes (from multi-day cycles)”before multi-day cycles after ~35 minutes Abstracta abstracta-2 grade B, partial baseline yes method no
- “Regression cycle reduced from 4 days to 3 hours.”before 4 days after 3 hours Codoid codoid-1 grade B, partial baseline yes method no
- “700+ autotests were migrated to a new framework”before Outdated autotests for the Chrome extension after 700+ autotests DeviQA deviqa-8 grade B, partial baseline yes method no
- “70+ performance scripts were created using K6 and JMeter”before No performance tests after 70+ performance scripts DeviQA deviqa-8 grade B, partial baseline yes method no
- “Covered ~95% functionality with BE tests”before No back-end autotests after ~95% functionality DeviQA deviqa-8 grade B, partial baseline yes method no
- “15+ jobs were configured to monitor the critical features daily”before Critical features weren’t monitored after 15+ jobs DeviQA deviqa-8 grade B, partial baseline yes method no
| Metric kind | Metrics | With baseline |
|---|---|---|
| other | 30 | 19 |
| execution-time | 27 | 9 |
| suite-size | 24 | 13 |
| coverage | 20 | 12 |
| defects | 10 | 1 |
| cost | 8 | 0 |
| release-frequency | 6 | 1 |
04Languages, CI tools and clouds named alongside
Languages: Java (16), JavaScript (8), TypeScript (8), C# (5), Ruby (3), Kotlin (1) and Python (1).
CI tools: Jenkins (19), GitHub Actions (7), CircleCI (5), Bamboo (2), AWS CodeCommit (1), Azure DevOps (1), Bitrise (1) and GitLab (1).
Device or browser clouds: BrowserStack (16), LambdaTest (4), AWS (2), AWS Device Farm (2), Sauce Labs (2) and BlazeMeter (1).
05Migration flows
No verified case tags a migration into or out of Appium.
06The evidence ladder
Each row counts the Appium cases that make that disclosure; the rows are separate counts, ordered from the most basic disclosure to grade A. Of 47 Appium cases, 1 reach grade A, and the rarest disclosure below it is "reach grade a" (1 cases).
The right-hand column gives the same steps for all 263 verified cases, so a reader can set this subset against the whole dataset.
Table view
| Item | Count |
|---|---|
| Name a listed framework | 47 |
| Name the client | 13 |
| Publish at least one metric | 36 |
| State a baseline for a metric | 13 |
| State baseline and method for one metric | 2 |
| Reach grade A | 1 |
| Total | 112 |
| Step | Appium cases | All verified cases |
|---|---|---|
| Name a listed framework | 47 of 47 | 263 of 263 |
| Name the client | 13 of 47 | 91 of 263 |
| Publish at least one metric | 36 of 47 | 210 of 263 |
| State a baseline for a metric | 13 of 47 | 75 of 263 |
| State baseline and method for one metric | 2 of 47 | 35 of 263 |
| Reach grade A | 1 of 47 | 18 of 263 |
07Frameworks named alongside Appium
40 of 47 cases name at least one other listed framework. The pairing shows which stacks vendors describe together, not which combination works.
Table view
| Item | Count |
|---|---|
| Postman and Newman | 15 |
| Selenium WebDriver | 15 |
| Apache JMeter | 11 |
| Cucumber, SpecFlow, Behave | 11 |
| WebdriverIO | 8 |
| Cypress | 7 |
| Playwright | 7 |
| REST Assured | 4 |
| Total | 78 |
08Where the cases come from
Codoid (12), DeviQA (12) and a1qa (6) publish the most Appium cases. A vendor with many cases here shows breadth of published work; the grade columns show how much of it can be checked.
| Vendor | Cases | Grade A or B | With a baselined metric |
|---|---|---|---|
| Codoid | 12 | 2 | 1 |
| DeviQA | 12 | 12 | 11 |
| a1qa | 6 | 0 | 0 |
| Qualitest | 4 | 0 | 0 |
| TestFort | 4 | 0 | 0 |
| Testrig Technologies | 3 | 0 | 0 |
| Abstracta | 2 | 2 | 1 |
| TestDevLab | 2 | 2 | 0 |
| QAwerk | 1 | 1 | 0 |
| Zuci Systems | 1 | 0 | 0 |
09What vendors leave out
18 of 47 cases do not state a team size and 34 do not state a duration.
8 of 125 metrics are cost figures and 0 mention flakiness, so maintenance cost and flaky test rates are rarely published.
10Questions for a Appium proposal
Ask for suite size and run time before and after the work: 37 of 47 cases give no before value for either.
Ask for the flaky test rate over a stated number of runs: 0 of 125 metrics mention flakiness at all.
Ask who owns maintenance after hand-over and what it costs per month: 8 of 125 metrics are cost figures.
Ask for a reference client you can call: 34 of 47 cases keep the client anonymous.
Questions
How many vendors have published Appium cases?
10 vendors in this dataset, with 47 verified cases between them, as of the dataAsOf date on this page.
How many Appium cases name the client?
13 of 47. A named client is required for grade A.
Do Appium case studies publish baselines?
55 of 125 metrics state a before value.
Does this page rank Appium against other frameworks?
No. The site counts which vendors have evidence on a framework and never compares frameworks.
Records used
This post reads 47 records; the newest verifiedOn date among them sets the data-as-of date.
Show record ids
a1qa-10, a1qa-14, a1qa-24, a1qa-40, a1qa-66, a1qa-73, abstracta-1, abstracta-2, codoid-1, codoid-6, codoid-9, codoid-11, codoid-13, codoid-15, codoid-18, codoid-23, codoid-25, codoid-26, codoid-30, codoid-39, deviqa-8, deviqa-12, deviqa-15, deviqa-18, deviqa-19, deviqa-21, deviqa-25, deviqa-30, deviqa-37, deviqa-38, deviqa-41, deviqa-46, qawerk-2, qualitest-1, qualitest-2, qualitest-3, qualitest-12, testdevlab-1, testdevlab-3, testfort-9, testfort-10, testfort-11, testfort-28, testrig-6, testrig-8, testrig-10, zuci-systems-7
More from the blog
Framework note
Playwright: what the published cases show
48verified cases
48 verified cases from 14 vendors name Playwright: grades, client types, metric kinds, stacks and the fields vendors leave out.
data as of 2026-11-12 · 48 records
Framework note
Cypress: what the published cases show
25verified cases
25 verified cases from 10 vendors name Cypress: grades, client types, metric kinds, stacks and the fields vendors leave out.
data as of 2026-11-12 · 25 records
Framework note
Selenium WebDriver: what the published cases show
88verified cases
88 verified cases from 13 vendors name Selenium WebDriver: grades, client types, metric kinds, stacks and the fields vendors leave out.
data as of 2026-11-12 · 88 records
Related pages
Scores and grades describe published evidence as of the verifiedOn date on each item. They do not measure service quality. Verify with the vendor before contracting.