Traditional GUI automation is linear; it follows a set of steps. The first time you run it, it can't add any value, as the feature isn't done until the automation runs. Once test automation runs a second time, it effectively becomes change detection. This leads to a large number of "failures" that are not actually failures. Whether they are false positives or false negatives, we need a way to fix the automation tooling.
How can mature companies with complex systems achieve the level of test automation that modern delivery schedules and processes demand? There are four strategies that have helped many organizations finally break through the test automation barrier: Simplify automation across the technology stack, end the test maintenance nightmare, shift to API testing, and choose the right tools for your needs.
While automation can help you save time and money in your testing activities, there are a few hidden costs that many teams overlook. Aspects that don't have a price tag initially—such as what it will take to learn, adopt, and maintain a new automation tool—will end up costing you in the long run. Think through these considerations and answer some questions before jumping into your automation initiative.
When you’re designing a dashboard to track and display metrics, it is important to consider the needs and expectations of the users of the dashboard and the information that is available. There are several aspects to consider when creating a new dashboard in order to make it a useful tool. For a mnemonic device to help you easily remember the qualities that make a good dashboard, just remember the acronym “VITAL.”
For years, developers have struggled with using individual lifecycle management tools, but no longer! Joe Farah walks you through a history and benefits of an integration of ALM tools that every team should seriously consider.
NoSQL is a new approach to data storage that addresses many problems associated with relational databases. Many highly popular websites—including Facebook, Netflix, and Digg—are using NoSQL to crunch large volumes of data. Eugene Dvorkin gives us insight into why NoSQL is important and what CM experts need to know about it.
It seems like every week the press has yet another story about security breaches or stolen data at some of the world’s largest companies or government agencies. Sometimes the responsibility for ensuring thorough security resides with an IT security group, and other times it gets outsourced altogether. The responsibility seldom falls to testing teams. However, this is changing. Having trained and experienced testers hunt for security bugs will make web applications safer from hackers and will further protect consumers, corporate assets, and brands.. Scott Aziz offers some practical techniques that will help you get started.
In the first installment of this article, Dr. James Whittaker discussed turning testing on its head—to revitalize and improve the value of late-stage testing. James also discussed ideas behind empowering your dogfooders, testers, and the crowd to significantly and efficiently improve software quality. In part two, Jason Arbon discusses the research and engineering experimentation behind realizing these ideas into new tools and processes.
Seretta Gamba, test manager at Steria Mummert ISS GmbH, discusses how she has been working on assembling test automation patterns—solutions that experienced practitioners have already found. She talks about her developmental background and why she is so interested in these patterns, which don't include any code or tools because those will eventually change, while the patterns will remain universal.
Melissa Benua, a senior technical lead at mParticle, discusses the wide range of topics she will present at the STARWEST conference, including continuous integration, containers, and process management. She also shares details of the projects her team is working on with deep back-end core features, qualities, and dev tools. Melissa also talks about her involvement with Women Who Test, why she made sure to expose her kids to the events at a young age, and how it reinforces the importance of a work-life balance.
Greg Paskal, test automation lead at Ramsey Solutions, talks about data lakes and how to effectively use data visualization. Done well, data visualization should help practitioners, managers, and stakeholders easily consume, understand, and act on the information the visual displays.
In this interview, Greg Paskal, a technology innovator in quality assurance, discusses a new open source tool from Elastic Stack that creates a “data lake” that can be mined to analyze the data coming from test automation on a more effective level than pass/fail.
The tools and technologies our teams rely on to build solutions are changing faster every day. New frameworks, new tools, transformations to DevOps, and migrations to public cloud are all putting strain on our teams.