Note for buyers
How to request a correction and what gets logged
Research desk, testautomationvendors.com · published 2026-11-12 · data as of 2026-11-11 · 3 records
- 10
- working days to answer
- 126
- case files open to correction
Email the address on any vendor page or case file with a link to the source. A correction that a source supports changes the record, triggers a recompute and appears in the changelog with the ids touched.
Counts come from verified records. A baseline is the before value a vendor states for a metric; quoted claims carry their grade and baseline flag.
- baseline:
- The measured value before the work started, against which a later value is compared. source
What a correction can change
A quote, a before or after value, a flag, a client name or a framework tag, each only with a source link.
Grades and scores change only by recomputation from corrected records.
What it cannot change
Weights, thresholds and the grade rules, which are frozen by hash.
Example records that a correction would touch: deviqa-2, deviqa-3, deviqa-9.
Questions
How fast are corrections answered?
Within 10 working days.
Can a vendor edit its text?
No. Vendors may request corrections and never edit scores or text.
Where are corrections listed?
On the changelog page.
Does a correction need a source?
Yes, a public page that states the corrected value.
Records used
This post reads 3 records; the newest verifiedOn date among them sets the data-as-of date.
More from the blog
Note for buyers
How to read a test automation case study: the fields that are usually missing
222 of 263cases omit start year
Field by field, how often 263 verified automation cases leave out team size, duration, baseline, client name and CI.
data as of 2026-11-12 · 263 records
Note for buyers
Why a percentage without a baseline is a claim, not a result
246percentage claims
246 percentage claims in verified automation cases, and how many state the starting value.
data as of 2026-11-12 · 126 records
Note for buyers
What an automation coverage figure can mean: the denominators seen in published cases
88coverage claims
88 coverage claims sorted by what they measure: test cases, regression effort, features or code.
data as of 2026-11-12 · 76 records
Related pages
Scores and grades describe published evidence as of the verifiedOn date on each item. They do not measure service quality. Verify with the vendor before contracting.