Skip to main content

Sponsored Article: Unlock Test Intelligence with Natural Language—SmartBear QMetry and Amazon Bedrock Integration

article
|
hand holding digital key
Summary

Continuous testing faces massive bottlenecks as AI accelerates development pipelines. Integrating SmartBear QMetry with Amazon Bedrock eliminates manual querying by using natural language commands to instantly generate SQL queries, turning fragmented test data into real-time, actionable release readiness analytics.

Software deployment is moving from weekly to daily cycles as organizations adopt continuous integration and continuous delivery (CI/CD) techniques. With this shift, quality assurance becomes central to maintaining velocity without compromising reliability. These changes introduce new challenges when trying to turn test data into actionable insights, especially as AI-driven development and agentic workflows increase the volume and velocity of both code and tests.

SmartBear QMetry, powered by Amazon Bedrock, transforms how teams plan, manage, and analyze testing. In this article, you’ll learn how SmartBear AI uses Amazon Bedrock to transform natural language questions into SQL queries, delivering instant insights from your test data. You’ll also see how this integration supports SmartBear’s broader direction for application integrity, helping teams maintain measurable confidence, governance, and control as software delivery evolves.

The Challenge: Transforming Test Data into Strategic Insights

Across industries, software quality has become a core business driver that shapes customer experience and brand reputation. Executives and product leaders depend on accurate testing insights to make release decisions, manage risk, and maintain confidence in delivery.

According to SmartBear’s 2026 study, Closing the AI Software Quality Gap, AI-assisted development has already reached a critical point: 93% of respondents have adopted AI coding tools, and 60% expect AI to generate more than 41% of their code within the next 12 months. At the same time, testing is struggling to keep pace. 70% of respondents are concerned that application quality is already suffering as AI accelerates development, while 68% worry that faster AI-driven code creation will create testing and deployment bottlenecks.

That gap shows the growing challenge of turning test data into actionable intelligence that supports confident release decisions. Test results are often stored across multiple systems, making it difficult to understand the overall state of product readiness. Reports take time to generate, and data can lose relevance before it reaches the people who need it most.

When quality data is hard to access, the difficulty in generating insights limits visibility at critical stages of release planning, increasing the uncertainty organizations face, which can delay innovation and increase risk.

The opportunity is clear. Teams need a testing solution that moves beyond collecting data to interpreting it in real time, providing leadership with the clarity and confidence to release software at the pace of the business. QMetry uses Amazon Bedrock to combine the power of AI with modern quality management to make testing a source of strategic advantage. As a centralized testing system of record, QMetry helps teams turn test evidence, execution data, and analytics across manual, automated, and emerging agentic workflows into clear priorities, faster decisions, and more confident release readiness.

Rethinking Test Management with AI

Traditional test management often limits how quickly teams can uncover insights. Fortune 500 firms typically rely on manual reporting, complex query building, and multiple layers of data navigation before meaningful information becomes available. These steps slow down collaboration and create unnecessary dependence on technical resources.

With SmartBear AI powered by Amazon Bedrock, teams can remove those barriers. The platform introduces smart AI search and AI-powered SQL generation. These features mean that users can interact with test data using straightforward, natural language.

Figure 1 SmartBear AI SQL generator

Figure 1: SmartBear AI SQL generator (Click to enlarge)

Instead of learning SQL query syntax or waiting for analytics support, quality assurance (QA) leaders can ask questions like, “Which test areas have the highest defect density?” or “How ready is this release?” and receive aggregate data from all integrated systems within seconds. This transforms how teams explore information, eliminating repetitive tasks and making insights accessible to everyone.

Figure 2 Custom QMetry reports and tables generated from QI

Figure 2: Custom QMetry reports and tables generated from QI (Click to enlarge)

By turning natural language into real-time analytics, QMetry helps teams find information faster, shortens feedback loops, and makes confident release decisions. The result is a more intelligent and responsive approach to quality management that aligns with the pace of modern software delivery. It also moves teams closer to application integrity – continuous, measurable assurance that your software just works as intended, with the governance needed to operate at AI speed and scale.

Accelerating Insights with Amazon Bedrock

Amazon Bedrock is a fully managed service that organizations can use to build and scale generative AI applications using foundation models (FMs) from trusted providers. For QMetry, this AI platform integration makes it possible to deliver new AI capabilities quickly and securely while avoiding the complexity of maintaining model infrastructure.

Model access, governance, and data protection features available in Amazon Bedrock allow QMetry to focus on delivering intelligent quality management insights to your team. The platform uses AI to understand the connections between test cases, requirements, and quality metrics, turning large volumes of information into practical insights that guide better decisions.

Built on the foundation of Amazon Bedrock, QMetry takes advantage of AWS's proven infrastructure for security, reliability, and compliance, and customers reap the benefits from this continued innovation in AI. QMetry has implemented robust security practices aligned with the AWS shared responsibility model. Together, QMetry and Amazon Bedrock create a modern testing environment where data moves securely, insights appear instantly, and organizations can release software with confidence. 

Customer Success with QMetry and Amazon Bedrock 

One of QMetry’s marquee customers is a Fortune 500 financial services firm with a vast portfolio of digital products, each subject to rigorous regulatory and performance standards. The company struggled to unify test data across multiple teams, applications, and development streams. Reports on coverage, defects, and release readiness were compiled manually, with heavy reliance on SQL queries and cross-team coordination. By the time analytics reached leadership, insights were often stale and lacked the context needed for confident decisions.

Upon adopting QMetry’s platform, the customer began integrating test metrics, requirements, and defect tracking under a centralized system. With the addition of SmartBear AI built on Amazon Bedrock, the firm gained a new capability: QA leaders and stakeholders could now use natural language to interrogate their test data. Questions such as “Which modules have the most open critical defects?” or “Do we have tests covering the highest risk features in this release?” return instant, actionable reports.

The transformation yielded immediate measurable benefits:

  1. The time required to generate reports shrank from hours to seconds.
  2. Visibility into coverage and defect trends improved, giving leadership real-time decision support.
  3. The company accelerated its release cadence, with greater confidence in quality outcomes.
  4. Cross-functional teams aligned more easily, using shared insight rather than fragmented metrics.

By turning testing data into accessible intelligence, this enterprise strengthened its ability to deliver mission-critical software while meeting compliance requirements, improving customer trust, and reducing time to market.

Together, QMetry and AWS empower organizations to achieve continuous quality faster and more efficiently. By using Amazon Bedrock, QMetry brings the power of generative AI directly to quality management, giving teams faster access to insights that require time, coordination, and technical expertise. Customers benefit from real-time visibility in testing progress, better alignment between QA and development, and greater confidence in release decisions. With AI simplifying data exploration and reporting, teams can focus on delivering innovation rather than managing complexity.

This combination empowers enterprises to accelerate delivery without sacrificing quality, turning testing into a strategic advantage that supports faster growth, improved customer satisfaction, and stronger business outcomes. As SmartBear continues to evolve QMetry with SmartBear MCP integration and agent-ready workflows, teams will be able to connect AI-assisted testing activity more directly into their existing systems, approvals, and quality processes.

Looking Ahead

AI is transforming how quality assurance contributes to business success. What at one time was a reactive step in the delivery process is now becoming a continuous source of insight that drives better decisions and faster innovation. With capabilities such as smart AI search and AI-powered SQL generation, QMetry gives teams the tools to shift their focus from managing data to improving outcomes.

As organizations continue to modernize their testing ecosystems, AI will play a central role in shaping how quality is measured, managed, and optimized. By using the Amazon Bedrock fully managed generative AI service, QMetry is helping enterprises move toward an era of intelligent, connected quality management where every decision is informed by data and every release builds trust with customers. 

Looking ahead, QMetry will soon introduce new agentic capabilities designed to improve release intelligence and optimize testing workflows, further strengthening its role as a centralized system of record for testing and quality. The Release Readiness Advisor agent will turn the data teams already track into clear, actionable guidance, and the Test Suite Generator agent will help teams automatically identify and prioritize the most relevant tests.

These capabilities will help teams achieve more precise testing, stronger release confidence, and smarter use of existing test assets, while still staying fully in control of final decisions.

The future of testing is proactive, adaptive, and immediate. QMetry and AWS are making that future real.

Experience SmartBear AI on AWS

Empower your teams to deliver quality with confidence through the combined strength of SmartBear AI and Amazon Bedrock. Ready to transform your testing workflow? Discover how AI-powered insights can simplify test management, reduce manual effort, and accelerate release cycles while maintaining enterprise-grade security and reliability.

Visit AWS Marketplace to explore SmartBear solutions including QMetry, test it out through a free trial, request a demo, and begin your journey toward a smarter, more efficient approach to quality management.

Connect with SmartBear

SmartBear – AWS Partner Spotlight

SmartBear is an AWS Advanced Technology Partner with DevOps Competency that provides integrated quality management and testing solutions for modern software development, including QMetry, which uses Amazon Bedrock to transform test data into actionable intelligence through AI-powered natural language queries. QMetry is part of SmartBear’s broader Application Integrity Core™, helping teams centralize testing data, connect insights across existing development ecosystems, and make reliable release decisions as AI changes how software is built, tested, and delivered.

Contact SmartBear | Partner Overview | AWS Marketplace
 

About The Author

Matt Bonner is a Solutions Architect at SmartBear with over 7 years of experience helping customers and partners navigate complex developer ecosystems. He delivers scalable solutions across integrations, migrations, and DevOps initiatives. Recently, Matt has focused on AI agents and Model Context Protocol, to connect intelligent tooling with production workflows. Originally trained as a Mechanical Engineer at UConn, he was drawn to technology for its fast pace and constant innovation.

Community Sponsor

Lets Hang!

User Comments

0 comments

English