IT Operations Automation
ContextQA wanted to reduce release delays, quality issues, and test flakiness by automating manual software-testing work without requiring customers to write code, while also using enterprise-safe AI models that satisfied privacy and ethics concerns.
Reported impact
ContextQA demonstrated that it could migrate large volumes of manual tests into automated flows within minutes, remove flakiness from testing, and better position its platform for enterprise customers that require trustworthy AI controls.
ContextQA used IBM watsonx.ai to add generative-AI automation to its no-code testing platform for web, API, and mobile applications. After meeting IBM at SXSW, the company worked with the Build Partner team for a month to evaluate IBM's AI tooling without adding new infrastructure. ContextQA used watsonx.ai and IBM-supplied NLP models to migrate plain-English manual test cases into automated workflows across disparate organizational data, identify what changed in the software under test, and generate relevant suggestions for the next testing actions. The company specifically valued IBM's more controlled and governable model approach compared with alternatives it had tried, because enterprise buyers were sensitive to privacy, ethics, and bias. The result was a practical testing architecture that automates large batches of manual cases, reduces flakiness, and helps ContextQA improve reporting and product quality for larger enterprise customers.
Plain-English manual test cases and related organizational data are processed by watsonx.ai and IBM NLP models, which generate automated testing steps and change-aware suggestions that feed ContextQA's testing platform.
ContextQA has developed an application that does not require any coding knowledge. Instead, it uses AI and automation to test web applications, APIs and mobile applications.
Using natural language processing (NLP) models that IBM provides, ContextQA was able to come up with a large amount of data and automate the manual steps.
We were able to migrate all those cases and automate them within a few minutes.
With IBM AI technology, the company was able to identify what had changed in the software, provide relevant, accurate suggestions, and perform the correct tasks.
it is crucial for enterprise customers to have secure, non-biased ethical models
Review how this reference was scored and trace each normalized claim back to its documented source.
Scoring methodology
Customer Reference Value measures usefulness as a customer reference. Evidence Confidence measures the quality and traceability of available evidence, not independent verification.
Traceability
Field coverage shows which facts each source supports. Dates are shown only when documented by the source.
Related
IBM Sample Sep 28, 2026 OnticWorks.io OnticWorks.io needed its Elmer agentic platform to reason within the physical and operational context where work happens instead of relying on disconnected dashboards, emails, sensor feeds, and simulations that users… 12-month acceleration IBM Bob · IBM watsonx.ai · Red Hat OpenShift IBM Sample Sep 2, 2026 IBM Systems Assurance Project leads in IBM Systems Assurance were spending hours each week preparing for status meetings and consolidating updates from spreadsheets, slides, boards and tracking tools, yet leaders still lacked timely,… 24/7 near real-time visibility into project status IBM Cloud · IBM watsonx Orchestrate · Slack IBM Sample Jan 15, 2026 IBM IBM needed to reduce the time employees spent on repetitive work across HR, procurement, IT, supply chain, tax, and sales while creating a repeatable enterprise blueprint for scaling AI, automation, and hybrid-cloud… 15K AI agents proposed by employees during the 2025 IBM watsonx Challenge IBM Apptio · IBM Turbonomic · IBM Watson Discovery 