Case file deviqa-44
QA for cybersecurity software platform
grade A, verified baseline Named client and at least one metric with a stated baseline and a stated method or period.
Claim ledger
Each row quotes the vendor. A row is a claim, and it counts toward outcome verifiability only when the source states the baseline and the measurement method.
| Kind | Vendor claim (quoted) | Before | After | Baseline | Method |
|---|---|---|---|---|---|
| execution-time | “DeviQA reduced regression testing from 20 hours to 2 hours” (grade A, baseline yes) | 20 hours | 2 hours | yes | yes |
| coverage | “80% test coverage” (grade A, baseline yes) | 10% test coverage | 80% | yes | yes |
| suite-size | “250+ UI test cases” (grade A, baseline yes) | ~15 UI test cases | 250+ | yes | yes |
| other | “30 different machines for running autotests” (grade A, baseline yes) | 1 machine for running tests | 30 different machines | yes | no |
| other | “10 threads for running tests on each machine” (grade A, baseline yes) | 1 thread for running tests | 10 threads | yes | no |
| other | “30 reports with test results of each machine” (grade A, baseline yes) | 1 report for all tests | 30 reports | yes | no |
| coverage | “6+ platforms were covered by autotests” (grade A, baseline yes) | 1 platform was covered by autotests | 6+ platforms | yes | yes |
- baseline:
- The measured value before the work started, against which a later value is compared. source
Engagement facts
- Client
- Solebit (Mimecast) stated
- Industry
- Cybersecurity (file threat detection) stated
- Client type
- not disclosed
- Frameworks
- Cucumber, SpecFlow, Behave and Postman and Newman stated
- Languages
- Ruby stated
- CI tools
- Jenkins stated
- Device or browser clouds
- not disclosed
- Team size
- 4 stated
- Duration in months
- 60 stated
- Start year
- not disclosed
- Publication date
- not disclosed
What this case does not tell you
- Client type
- Device or browser clouds
- Start year
- Publication date
Source
QA for cybersecurity software platform (deviqa.com)
accessed 2026-11-11, verified 2026-11-11
Related pages
- DeviQA: vendor profile and score
- Cucumber, SpecFlow, Behave: vendors with published cases
- Postman and Newman: vendors with published cases
- QAwerk: Evolv
- a1qa: a1qa enhances software quality of Acronis’ multiuse infrastructure product for cybersecurity
- All case files
- Framework index
- Vendor ranking
- How cases are graded A, B, C or X
- Corrections and regrades log
Scores and grades describe published evidence as of the verifiedOn date on each item. They do not measure service quality. Verify with the vendor before contracting.