Framework note
Postman and Newman: what the published cases show
Research desk, testautomationvendors.com · published 2026-11-12 · data as of 2026-11-12 · 98 records
- 98
- verified cases
- 9
- vendors
- 35 of 98
- name the client
- 122 of 298
- metrics with a baseline
98 verified cases in this dataset name Postman and Newman, published by 9 vendors. Grades: A 7, B 40, C 51. 35 of 98 name the client, and 122 of 298 published metrics state a baseline.
What stands out
- 01DeviQA publishes 36 of the 98 Postman and Newman cases; the three vendors with the most publish 79, so a reader is looking at a concentrated set of sources.
- 02122 of 298 metrics in these cases state a before value; across all 639 metrics in the dataset the count is 209.
- 037 of 98 reach grade A, which needs a named client and one metric with both a before value and a stated method.
- 04The field left out most often is start year: 68 of 98 cases do not state it.
Counts come from verified records. A baseline is the before value a vendor states for a metric; quoted claims carry their grade and baseline flag.
- baseline:
- The measured value before the work started, against which a later value is compared. source
01Cases, vendors and grades
The count covers every verified case whose text names Postman and Newman, including vendors outside the ranked 12.
Vendors with cases: a1qa (26), Codoid (8), DeviQA (36), QA Madness (1), QAwerk (3), Qualitest (1), TestFort (17), TestingXperts (3) and Testrig Technologies (3).
Table view
| Item | Count |
|---|---|
| Grade A | 7 |
| Grade B | 40 |
| Grade C | 51 |
| Total | 98 |
02Clients and industries
Named clients appear in 35 cases; 63 keep the client anonymous.
Industries stated: Real estate (2), Accounts payable automation (1), Advertising resource management (1), Advertising technology (1), Airline (1), Art management and sales (1), Automotive business intelligence (1) and Automotive services B2B marketplace (1).
Client types stated: startup (5), enterprise (3), public (1) and smb (1).
03Metric kinds and baselines
The Postman and Newman cases publish 298 metrics. 122 state a baseline and 23 state both a baseline and a method.
- “regression testing time was reduced from 5 days to 1.5 days”before 5 days after 1.5 days a1qa a1qa-4 grade B, partial baseline yes method yes
- “the number of total handled requests increased from 400 to 46,000”before 400 after 46,000 a1qa a1qa-9 grade B, partial baseline yes method yes
- “reducing testing time from several hours to just 3 minutes”before several hours after 3 minutes a1qa a1qa-25 grade B, partial baseline yes method yes
- “reducing it from 36 seconds to 19 seconds”before 36 seconds after 19 seconds a1qa a1qa-25 grade B, partial baseline yes method yes
- “a one-week scope was covered in only 1 hour”before one week after 1 hour a1qa a1qa-30 grade B, partial baseline yes method yes
- “a full exploration of all 6 modules took 2 months instead of a year”before a year after 2 months a1qa a1qa-67 grade B, partial baseline yes method no
| Metric kind | Metrics | With baseline |
|---|---|---|
| other | 82 | 38 |
| suite-size | 61 | 32 |
| execution-time | 60 | 26 |
| coverage | 41 | 23 |
| defects | 34 | 1 |
| release-frequency | 12 | 2 |
| cost | 8 | 0 |
04Languages, CI tools and clouds named alongside
Languages: TypeScript (16), Java (14), Python (10), JavaScript (8), C# (5), Ruby (5), Groovy (2) and Kotlin (1).
CI tools: Jenkins (19), Azure DevOps (8), GitHub Actions (8), CircleCI (7), GitLab (3), Azure Pipelines (2), Bamboo (2) and Bitbucket Pipelines (2).
Device or browser clouds: BrowserStack (21), AWS (5), Azure (3), LambdaTest (2), AWS Device Farm (1) and BlazeMeter (1).
05Migration flows
No verified case tags a migration into or out of Postman and Newman.
06The evidence ladder
Each row counts the Postman and Newman cases that make that disclosure; the rows are separate counts, ordered from the most basic disclosure to grade A. Of 98 Postman and Newman cases, 7 reach grade A, and the rarest disclosure below it is "reach grade a" (7 cases).
The right-hand column gives the same steps for all 263 verified cases, so a reader can set this subset against the whole dataset.
Table view
| Item | Count |
|---|---|
| Name a listed framework | 98 |
| Name the client | 35 |
| Publish at least one metric | 85 |
| State a baseline for a metric | 35 |
| State baseline and method for one metric | 12 |
| Reach grade A | 7 |
| Total | 272 |
| Step | Postman and Newman cases | All verified cases |
|---|---|---|
| Name a listed framework | 98 of 98 | 263 of 263 |
| Name the client | 35 of 98 | 91 of 263 |
| Publish at least one metric | 85 of 98 | 210 of 263 |
| State a baseline for a metric | 35 of 98 | 75 of 263 |
| State baseline and method for one metric | 12 of 98 | 35 of 263 |
| Reach grade A | 7 of 98 | 18 of 263 |
07Frameworks named alongside Postman and Newman
61 of 98 cases name at least one other listed framework. The pairing shows which stacks vendors describe together, not which combination works.
Table view
| Item | Count |
|---|---|
| Apache JMeter | 23 |
| Selenium WebDriver | 18 |
| Appium | 15 |
| Cucumber, SpecFlow, Behave | 15 |
| WebdriverIO | 12 |
| Playwright | 10 |
| Cypress | 9 |
| Grafana k6 | 3 |
| Total | 105 |
08Where the cases come from
DeviQA (36), a1qa (26) and TestFort (17) publish the most Postman and Newman cases. A vendor with many cases here shows breadth of published work; the grade columns show how much of it can be checked.
| Vendor | Cases | Grade A or B | With a baselined metric |
|---|---|---|---|
| DeviQA | 36 | 36 | 28 |
| a1qa | 26 | 6 | 5 |
| TestFort | 17 | 1 | 1 |
| Codoid | 8 | 0 | 0 |
| QAwerk | 3 | 3 | 0 |
| TestingXperts | 3 | 1 | 1 |
| Testrig Technologies | 3 | 0 | 0 |
| QA Madness | 1 | 0 | 0 |
| Qualitest | 1 | 0 | 0 |
09What vendors leave out
18 of 98 cases do not state a team size and 46 do not state a duration.
8 of 298 metrics are cost figures and 0 mention flakiness, so maintenance cost and flaky test rates are rarely published.
10Questions for a Postman and Newman proposal
Ask for suite size and run time before and after the work: 73 of 98 cases give no before value for either.
Ask for the flaky test rate over a stated number of runs: 0 of 298 metrics mention flakiness at all.
Ask who owns maintenance after hand-over and what it costs per month: 8 of 298 metrics are cost figures.
Ask for a reference client you can call: 63 of 98 cases keep the client anonymous.
Questions
How many vendors have published Postman and Newman cases?
9 vendors in this dataset, with 98 verified cases between them, as of the dataAsOf date on this page.
How many Postman and Newman cases name the client?
35 of 98. A named client is required for grade A.
Do Postman and Newman case studies publish baselines?
122 of 298 metrics state a before value.
Does this page rank Postman and Newman against other frameworks?
No. The site counts which vendors have evidence on a framework and never compares frameworks.
Records used
This post reads 98 records; the newest verifiedOn date among them sets the data-as-of date.
Show record ids
a1qa-4, a1qa-6, a1qa-9, a1qa-11, a1qa-12, a1qa-14, a1qa-15, a1qa-16, a1qa-24, a1qa-25, a1qa-30, a1qa-31, a1qa-32, a1qa-33, a1qa-34, a1qa-39, a1qa-41, a1qa-42, a1qa-60, a1qa-62, a1qa-64, a1qa-67, a1qa-70, a1qa-72, a1qa-74, a1qa-77, codoid-7, codoid-8, codoid-28, codoid-29, codoid-30, codoid-31, codoid-36, codoid-37, deviqa-1, deviqa-3, deviqa-5, deviqa-6, deviqa-8, deviqa-10, deviqa-11, deviqa-12, deviqa-13, deviqa-16, deviqa-17, deviqa-18, deviqa-22, deviqa-23, deviqa-24, deviqa-25, deviqa-26, deviqa-28, deviqa-29, deviqa-31, deviqa-32, deviqa-34, deviqa-35, deviqa-36, deviqa-38, deviqa-39, deviqa-40, deviqa-41, deviqa-44, deviqa-45, deviqa-46, deviqa-47, deviqa-48, deviqa-49, deviqa-50, deviqa-52, qa-madness-2, qawerk-2, qawerk-3, qawerk-8, qualitest-6, testfort-6, testfort-9, testfort-10, testfort-13, testfort-14, testfort-15, testfort-16, testfort-17, testfort-18, testfort-19, testfort-20, testfort-22, testfort-23, testfort-25, testfort-27, testfort-28, testfort-29, testingxperts-3, testingxperts-5, testingxperts-6, testrig-1, testrig-6, testrig-9
More from the blog
Framework note
Playwright: what the published cases show
48verified cases
48 verified cases from 14 vendors name Playwright: grades, client types, metric kinds, stacks and the fields vendors leave out.
data as of 2026-11-12 · 48 records
Framework note
Cypress: what the published cases show
25verified cases
25 verified cases from 10 vendors name Cypress: grades, client types, metric kinds, stacks and the fields vendors leave out.
data as of 2026-11-12 · 25 records
Framework note
Selenium WebDriver: what the published cases show
88verified cases
88 verified cases from 13 vendors name Selenium WebDriver: grades, client types, metric kinds, stacks and the fields vendors leave out.
data as of 2026-11-12 · 88 records
Related pages
Scores and grades describe published evidence as of the verifiedOn date on each item. They do not measure service quality. Verify with the vendor before contracting.