Case file deviqa-12
QA for sales enablement software
grade B, partial Named client; no metric states both a baseline and a method.
Historical: older than 60 months, counted at half weight in case volume
Claim ledger
Each row quotes the vendor. A row is a claim, and it counts toward outcome verifiability only when the source states the baseline and the measurement method.
| Kind | Vendor claim (quoted) | Before | After | Baseline | Method |
|---|---|---|---|---|---|
| execution-time | “18 hours to run regression testing” (grade B, baseline yes) | >70 hours to run regression testing | 18 hours | yes | no |
| execution-time | “4 hours to run smoke testing” (grade B, baseline yes) | >20 hours to run smoke testing | 4 hours | yes | no |
| suite-size | “2.4k+ automated tests for a web application” (grade B, baseline yes) | <300 web automated tests | 2.4k+ automated tests | yes | no |
| defects | “Increased the number of defects detected during testing by 2.5×” (grade B, baseline no) | not stated | 2.5x | no | no |
| coverage | “100% coverage of all existing sub-products” (grade B, baseline yes) | Not all product modules were covered with autotests | 100% coverage of all existing sub-products | yes | no |
| suite-size | “2.5k+ automation tests for iOS and Android apps” (grade B, baseline yes) | <100 mobile automation tests | 2.5k+ automation tests | yes | no |
| other | “5 iOS and Android versions and different devices supported” (grade B, baseline yes) | 1 version of iOS and Android was used for autotests | 5 iOS and Android versions | yes | no |
| other | “5 parallel threads for running autotests on all supported browsers and mobile OSs” (grade B, baseline yes) | No parallelization in autotests | 5 parallel threads | yes | no |
- baseline:
- The measured value before the work started, against which a later value is compared. source
Engagement facts
- Client
- Allego stated
- Industry
- Sales enablement software stated
- Client type
- not disclosed
- Frameworks
- Appium, WebdriverIO, Cucumber, SpecFlow, Behave, Apache JMeter and Postman and Newman stated
- Languages
- Ruby, JavaScript, Java stated
- CI tools
- Jenkins stated
- Device or browser clouds
- not disclosed
- Team size
- 7 stated
- Duration in months
- not disclosed
- Start year
- 2013 stated
- Publication date
- not disclosed
What this case does not tell you
- Client type
- Device or browser clouds
- Duration in months
- Publication date
- How or over what period any metric was measured
Source
QA for sales enablement software (deviqa.com)
accessed 2026-11-11, verified 2026-11-11
Related pages
- DeviQA: vendor profile and score
- Appium: vendors with published cases
- WebdriverIO: vendors with published cases
- Cucumber, SpecFlow, Behave: vendors with published cases
- Apache JMeter: vendors with published cases
- Postman and Newman: vendors with published cases
- QAwerk: Evolv
- a1qa: a1qa enhances software quality of Acronis’ multiuse infrastructure product for cybersecurity
- All case files
- Framework index
- Vendor ranking
- How cases are graded A, B, C or X
Scores and grades describe published evidence as of the verifiedOn date on each item. They do not measure service quality. Verify with the vendor before contracting.