Articles

Pyramid in Egypt Inverting the Test Automation Pyramid

A growing company was tasked to develop a test automation program from scratch, change its coding practices, and build a continuous testing toolchain. Martin Ivison details how they did it, including realizing that implementing the traditional test pyramid wasn't going to work—it would have to be turned upside down. They found out that small is beautiful, cheap is good, and cultural change matters.

Martin Ivison's picture Martin Ivison
Integration overview path Who Should Set Up Continuous Integration for Automated Tests?

If you want to trigger long-running, end-to-end automated tests, you must integrate the test execution system with the continuous integration system. But this job falls in a fuzzy area that meets at the nexus of feature development, test automation development, quality assurance, and build and release engineering. Here's how to decide who should be responsible for the setup.

Ajeet Dhaliwal's picture Ajeet Dhaliwal
Test documentation Tests as Documentation

It’s important that test authors keep in mind the inherent authority their tests possess. After all, an application’s tests are sometimes the first lines of code a new developer will read when acclimating to a new codebase. Tests aren't the only kind of documentation you need, but automated tests in a CI environment can provide a lot of useful information.

Nelson Nogales's picture Nelson Nogales
Testing feedback loop 5 Key Factors to Achieve Agile Testing in DevOps

Part of the path to DevOps requires adoption of agile methodologies. What does it mean for testing when you switch from the traditional waterfall model, with a few long release cycles per year, to the agile model, with changes occurring every two weeks? Here are five key factors to achieve the agile software testing necessary in DevOps.

Denise Rigoni's picture Denise Rigoni

Better Software Magazine Articles

Using Agile and DevOps to Achieve Quality by Design Using Agile and DevOps to Achieve Quality by Design

When software nears completion, it is the wrong time to focus on quality. Product delivery improves if you invest in a plan, validate in small increments, and focus on continuous testing.

Michael Sowers's picture Michael Sowers
DevOps and the Culture of Code DevOps and the Culture of Code

Migrating an organization to continuous integration requires adoption new processes, tools, and automation. DevOps relies on dramatic culture change to encourage total transparency and collaboration among all project stakeholders.

Patrick Turner's picture Patrick Turner
What Testers Need to Know about Continuous Testing What Testers Need to Know about Continuous Testing

Thanks to the trend toward DevOps and continuous delivery, traditional testing isn’t enough. Including test automation in your strategy is a good start, but your testing approach needs to change.

Wayne Ariola's picture Wayne Ariola
The Impact of Quality Intelligence on DevOps and the IoT The Impact of Quality Intelligence on DevOps and the IoT

QI is gaining momentum for providing fast and accurate test data to make better decisions. Just running your app through test suites isn’t enough for DevOps and the IoT.

Steven Winter's picture Steven Winter

Interviews

Anj Dubey Embedding Performance Engineering into CI/CD: An Interview with Anj Dubey
Video

In this interview, Anj Dubey, director of performance engineering for McGraw-Hill Education, discusses the need to shift left and embed your performance engineering into your CI/CD pipeline in order to ensure that every line of code is going to meet your performance requirements.

Jennifer Bonine's picture Jennifer Bonine
Melissa Benua How Traditional Testers Can Use Old Skills in New Ways: An Interview with Melissa Benua
Video

In this interview, Melissa Benua, a senior technical lead at mParticle, explains how traditional testers can use their current skill sets to easily transition to new concepts, like DevOps. She also details how continuous testing and continuous integration continue to be major hot topics.

Jennifer Bonine's picture Jennifer Bonine
Jennifer Scandariato How Manual Testers Are Evolving into Automation Engineers: An Interview with Jennifer Scandariato

In this interview, Jennifer Scandariato, the director of test engineering and leader of the Women in Technology initiative at iCIMS, explains the changing role of the manual tester, how they can adapt to a much faster environment, and why security is more important than ever before.

Josiah Renaudin's picture Josiah Renaudin
Jennifer Scandariato Re-engineer Your Development to Stop Creating Defects: An Interview with Jennifer Scandariato
Video

In this interview, Jennifer Scandariato, the director of test engineering and leader of the Women in Technology initiative at iCIMS, explains how you can alter the way you develop your software to avoid creating defects—through culture, continuous integration, and automation.

Jennifer Bonine's picture Jennifer Bonine

Conference Presentations

Fighting Test Flakiness: A Disease that Artificial Intelligence Will Cure
Slideshow

Artificial Intelligence (AI) is making it possible for computers to diagnose some medical diseases more accurately than doctors. Such systems analyze millions of patient records, recognize underlying data patterns, and generalize them for diagnosing previously unseen patients. A key challenge is determining whether a patient's symptoms and history are attributed to a known disease or other factors. Software testers face a similar problem when triaging automation failures. They investigate questions like, Is the failure due to a defect, environmental issue, or nondeterministic test script? Is there current or historical evidence to support one belief over another? Join Tariq King as he describes how test failures and flakiness can be modeled for machine learning (ML) as causal disease-symptom relations.

Tariq King
STARWEST 2018 Agile Performance Testing in the Real World
Slideshow

Performance issues substantially impact quality, cost, and customer confidence. Agile teams are challenged to build in performance processes throughout the lifecycle, but it is critical to incorporate performance into your CI/CD pipeline. Join Amit Patel as he shares his recent project experiences and the steps his team took to change processes, leverage different technologies, and align internal stakeholders. He explains how they use production-monitoring solutions to create a real-world production feedback loop in order to ensure they can analyze data and turn the information into actionable defects. As part of this, his team created process and procedures to execute performance tests on a regular basis and pass/fail builds based on thresholds. Join Amit to learn how to build a successful production feedback loop, align internal stakeholders, and implement holistic performance engineering.

Amit Patel
Engineering for Compatibility
Slideshow

Modern software development has brought us an incredibly powerful tool: continuous integration and deployment. However, taking advantage of this new system isn’t always straightforward. With powerful new tools come powerful new ways of making mistakes that can take your product down in a heartbeat. Melissa Benua has years of experience making CI and CD work for her, with lots of insights—both good and not so good. Come and learn from her as she shares key tips and tricks for coding and testing for both forward and backward compatibility in software releases. Useful for both traditional testers as well as combined engineers, Melissa provides technical and actionable advice to enable your team to make the right trade-offs and the right time investments, allowing your product to release to your customers safely and successfully.

Melissa Benua
Peer to Peer Session: Solving Your Continuous Delivery Problems
Slideshow

Peer-to-peer Discussion: How Do I Make CD Work in My Environment? Building a successful continuous delivery pipeline is very context specific. Large organizations with legacy code, existing physical environments, regulatory constraints, large monolithic applications, or stove piped organizations often struggle to find a continuous delivery approach that will work for them successfully. If this sounds familiar, this session is for you. Join facilitator Lee Eason as conference participant’s work together to identify and solve difficult continuous delivery challenges. Learn how other participants and speakers have dealt with the issues you have within their own companies and how you can apply their lessons learned. Share your successes and help others solve their DevOps problems. Expand upon questions you’ve asked during others sessions so you leave the conference with even more ideas for addressing your CD challenges.

Lee Eason

StickyMinds is a TechWell community.

Through conferences, training, consulting, and online resources, TechWell helps you develop and deliver great software every day.