TrainingConferencesAbout UsContact UsAdvertiseSQE.comRSS Feed

StickyMinds.com: brain food for building better software

Log In
 Clarify Your Search Criteria

Tips on Using Our Search Feature(s)
 
StickyMinds.com Home
ResourcesTopicsCommunityPowerPassBlogs
Home  >  Detail: Will the Real Professional Testers Please Step Forward?



A StickyMinds.com Original
Article Picture
Will the Real Professional Testers Please Step Forward?

By James Whittaker

Send This Content to a FriendGet a Short Link to This ContentPrint This ContentSee User Comments About This Content

Summary: In this week’s column, James Whittaker’s message to testers is loud and clear: Respect your discipline and you will gain the respect that your discipline deserves. Read on for some ways that testers can earn respect, and for some common elements present in organizations that recognize the importance of testing.


TechExcel, Inc.
What is it that makes some companies havens for testing talent while other companies incite anger from their testing ranks? At every testing conference I attend, I hear the same laments:
  • "Developers think they are better than us."
  • "Development is always late in delivering the code and it’s Test that gets blamed when the schedule slips. Everything is always our fault."
  • "Upper management treats us like second-class employees."
  • "How do we get the respect we deserve?"
And so on and so forth.

I’ve listened in on the conversations these folks have with the testing consultants in attendance. In general, the consultants are full of empathy, as well as suggestions about how to improve the situation. Most of the solutions I have overheard fall into two categories:
  1. You need to improve communication between test, development, and upper management. This will allow a dialog that will lead to a better understanding and appreciation of testers.
  2. The problem is that testers are not certified. Certification will legitimize testing as a field and help ensure adequate treatment.
Frankly, and with due respect to the test consulting community, the first solution sounds a lot like Dr. Phil giving marital advice and the second sounds a lot like a labor union.

In my opinion, neither psychotherapy nor unionization will solve this problem. Respect is doled out in the technology sector only when it is deserved. That’s a good thing. Too many times we hear people in other industries complain that it doesn’t matter how talented you are, that merit has nothing to do with respect or advancement. Our goal is to get so good at what we do, that colleagues and management have no alternative but to respect us.

So I have been taking notes during the last year on a mission to understand this problem. I accomplished my mission by studying the organizations in which this problem does not occur, organizations where testers are respected by developers and management and are afforded pay and career paths equal to development.

The common denominators I found are (in no particular order):

Insistence among testers for individual excellence
The companies I studied have a large number of testers who take pride in their testing prowess. They are good, they know they are good, and they take great pride in demonstrating their excellence. I hear them speak about their bugs with as much pride as the developers talk about their code. They name their bugs and, if questioned, will recount their hunt, their technique, their insight, and every bit of minutiae that relates to isolating and reporting the problem they found. Personal pride in a job well done is not the exclusive domain of developers. To these testers I say, "Long live your stories and may your tests never lack targets!"

Primary concern focused on the quality of the product.
Lest you read item number one above and thought those testers arrogant and self absorbed, my subjects in this study had one singular focus: maximum contribution to product success. Whereas the developers can look with understandable pride at what they put in a product, testers can feel equal pride for what they keep out of the product. For this, testers deserve our respect. They deserve our thanks. And forward-looking companies are generally ready to give it. To those companies who refuse to generously dole out this respect, perhaps they would be willing to re-insert those bugs and do without the services performed by their best and brightest testers.

A corporate focus on continuing education for testers
I often get invited to teach one-day testing seminars onsite. These courses are full of testers who are eager to learn. I start each class with one simple theorem: "Anyone who thinks they can learn testing in a single day is a fool who has no business testing software." I invite such people to leave my course and implore them to leave the discipline. By this rather harsh statement, I stand firm: testing is not to be taken lightly.

Testing is a pursuit; testing begins, but it never ends. This is a fact of life: we can never be finished with our testing task. No matter how much code we cover, there is always more that remains uncovered. No matter how many input combinations we apply, there are so many more that we did not apply. No matter how much we think we excel at testing, there are more complexities and subtleties that elude our full understanding.

Testers must demand, and receive, the education they so desperately need. Companies that refuse continuing education benefits—conferences, onsite or remote courses, books, and (if you are lucky enough to find them) graduate college courses—should be banned from the practice of software development. Such companies are a hazard to software users everywhere. Testing is a challenging intellectual discipline. It not only requires training, it demands it. Companies that refuse to cover these expenses for testers are negligent.

The hiring of degreed engineers for test positions
Testing is not a clerical task. It is an engineering discipline and is best carried out by trained engineers. Obviously, one cannot over-generalize here. There are some people who have majored in the arts who make fine testers. And we always need domain experts to test applications that require specialized skill (imagine testing a flight simulator without a pilot or two on your team). But, in general, a computer science degree (or related major) is necessary. There is background knowledge about algorithms, computational complexity, graph theory, and data structures that are requisite skills, building blocks for a deep and well-rounded testing education.

Now, if we could get more universities to actually teach testing, we’d all be even better off. But testers need to understand development, even if they don’t practice it on a regular basis.

My advice can be summarized as follows:
Begin by hiring college graduates who have majored in something technical and related to computer science (electrical engineering, computer engineering, physics, math, and so forth). The education level of your testers should be equivalent to or better than that of your developers.

Insist on continuing education benefits. Start by showing that the bugs that managed to slip into the released product could have been found with more advanced testing techniques and make a strong bid for training concerning those techniques. You must make the argument, convincingly, that more training will equate to better software.

Nurture a testing culture in your company that allows you to learn from the bugs that you find and the bugs that your customers find. Don’t apologize for the bugs that slip through. Make them a learning opportunity. Pick them apart and be sure every tester knows why that bug was overlooked. Bugs are corporate assets because they teach us about what we are doing wrong. Being proactive about correcting these mistakes will go a long way toward showing upper management that Test is a crucial aspect of product development that improves when it is taken seriously. You cannot expect upper management to take you seriously until you take yourselves and your discipline seriously. The more attention you pay to improving the performance of Test, the more respect you will gain.

Finally, I must note that the trend among software companies is moving in the right direction. More and more companies are taking test seriously and recognizing its value. If you work for a company that treats testers as second-class employees, other opportunities are out there.

Your fate is in your own hands. Strive for individual excellence, recognize your importance to a project, celebrate the bugs that won’t ship because of you and your team, and demand the continuing education you deserve. Respect your discipline and you will gain the respect that your discipline deserves.

Long live the professional tester!


About the Author
Dr. James A. Whittaker is a professor of computer science and the director of the Center for Information Assurance at Florida Tech. He is author of How To Break Software (Addison-Wesley) and co-author of an upcoming book, How to Break Software Security. His group focuses on highly efficient test techniques and tools for penetration testing. Contact him at jw@cs.fit.edu.

Back to Top
 

StickyMinds.com Weekly Column From 2/24/03 

Member Comments
Add Your CommentExpand Comments
 
Comment:    
by Gabby Hall 1/26/2005

Is this to help raise test scores? Or what is it about? I am so lost on this article, but i did a report on it anyways, so...tootles! -Gabby...aka...dontmindmeimlost

 
 
Comment:    
by Ashish Mehta 7/22/2004

Nice Article!! The pointer towards the competency of the tester is a good token. Again, if a tester possess development skill, then significant defects can be detected. In addition, the defect analysis/description is also comprehensive to a greater extent.

 
 
Comment:    
by marisa burt 7/21/2004

I knew I had read this before. It is good to be reminded. I am glad it is highlighted again.

 
 
Comment:    
by Anand Undemane 7/21/2004

Great article! By respecting your profession, learning it and applying it, not only will you earn the respect you deserve, but you will also maintain a high level of motivation and will go home happy each day!

 
 
Comment:    
by Barbara Burkholder 7/21/2004

This article is right on the mark! Although I wholeheartedly agree with Dr. Whittaker with respect to hiring testers having formal technical training, I also agree with the multiple comments pointing out the benefits of non-technical testers. I happen to be one of those -- my formal education includes degrees in music education and business. Twenty-one years in the software industry, including multiple opportunities to build test teams, has provided me with an appreciation for people of varying skill-sets. By blending technical and non-technical people into a team, everyone benefits!

 
 
Comment:    
by Sasikanth Sopirala 7/21/2004

Intresting article.Author sounds right. I have seen some companies hiring testers who do not have a technical background. Who dont understand the process of development. Some dont even know what software engineering is? How do we expect to gain respect? Developer think they are always right...But a tester who come from a non-technical background always depends on some technical guy who can share the domain knowledge. So what are we doing here? Are we reacting to the needs of Developer or we responding. In order to feel the importance as tester there is a great need to maintain a team who has its own knowledge.... I am 100% in agreement with...Read On

 
 
Comment:    
by Yugal Joshi 11/12/2003

I appreciate the article but disagree that engineers need to be hired for testing. I think it depends upon what type of testing you are doing. A person doing black box testing most of the time need not be an engineer. At the same time for White box testing or testing which involves knowledge of Code, algorithms, Data Structures we need intellects in our ranks. And also talking so much about giving respect to testers and treat them equally again highlights the sad point that testers are step sons of S/W industry and I do not think any amount of write ups can change this scenario. After all testers can test only what has been developed whether...Read On

 
 
Comment:    
by Dave Geller 3/14/2003

Very interesting article, although, I must disagree with the author's comments in regard to good testers also being good developers. It has been my experience (as a QA Analyst for the last eight or nine years) that a sizeable part of my job revolves around taking the "tech" out of the equation. Since a majority of bugs in an application originate in the specifications themselves, a QA Analyst's job is as much about figuring out what the client wants as it is about testing the code put before them. Often times, the client knows what they want, but they have a difficult time articulating those ideas and they have an especially difficult...Read On

 
 
Comment:    
by Dipali Rege 3/3/2003

An Excellant article. One point to add - whereever there is a focus on automating tests, it is necessary to have a good understanding of development principles. After all one hardly wants the automation suite to be "Buggy". In this respect, I feel testers have to be good developers. They also need to be good analysts, good designers ..... to understand the requirements and the product. Its difficult to move companies traditionally treating testers as second class citizens to accept this, but this has to happen and we need to drive this change. It reminds me of a poster I had on my room door - "No one notices what I do till I do not do it."...Read On

 
 
Comment:    
by Corey Snow 2/28/2003

Interesting article. I agree that certification is unlikely to solve any 'credibility gap' problems in our profession. Anything resembling unionization would indeed be a disaster for both our profession, and the software industry as a whole. Based upon extensive experience in the field, I strongly disagree with your suggestion that technical degrees correlate to any level of 'professionalism' or ability among testers. This is essentially another flavor of the 'certification' that you argue against. As was mentioned, colleges do not offer much in the way of training in software testing or quality concepts. Most of those who pursue CS...Read On

 
 
Comment:    
by Andrew Raybould 2/28/2003

In what was by far the most successful team that I have ever worked on as a developer, the testers were competent, effective, respected, valued and definitely part of the team. In my experience, it's poor developers who don't understand the importance of testing, dislike having the shoddiness of their work exposed (as if it isn't going to happen anyway!) and affect an air of superiority to bolster their self-esteem. Disrespect of testers is one more aspect of the competence crisis in software development.

In that regard, employing more "degreed engineers" in development, as well as testing, would be a step in the right direction!

 
 
Comment:    
by Ipsita Kumar 2/27/2003

This is a great article that really points out how testers are treated in most places. As a QA person, you need to feel and believe that any project is incomplete without extensive testing. You earn the respect and recognition from the other members and top management when the job is well done and thorough.

 
 
Comment:    
by pat anderson 2/27/2003

I agree wholeheartedly about the continued education points Dr. Whittaker makes. But then, I believe continued education is crucial to any profession. I also believe employers show their support and respect for a profession by acknowledging the need of continued education and supporting that education through benefits. I don't necessarily agree with Dr. Whittaker's opinion that testers must come from an engineering background. I believe testing requires disciplined thinking. The best testers have a knack for understanding logical processes and have the ability to go beyond logic by translating processes both at a technical level and a...Read On

 
 
Comment:    
by David Buddenbaum 2/27/2003

I heartily agree with the author. I got into testing over 20 years ago, starting as an SME and, since no one else wanted it, sliding into testing. I thoroughly enjoy my work, something a lot of people find remarkable. I always tell everyone that, as a single child, whenever anything got broken, my parents knew who did it and I was appropriately punished. Now, as an adult, I get paid decent money to intentionally break things. What a life - good money to act like a mean little kid.

 
 
Comment:    
by Gary Nesbitt 2/27/2003

I really appreciate anyone who addresses this issue and I agree with most of the ideas presented. I would like to hitchhike on a comment made by an earlier respondent about certifications, computer degrees and the like. After many years in this field, it appears that the insurance companies who trained some of us years ago had the right idea. They gave us entrance tests to get into their developer training programs. The tests were lengthy and focused on the individual's ability to see structures, relationships, differences in patterns, recognizing processes ... How good you are at this seems to be less a factor of education than it is some...Read On

 
 
Comment:    
by Jaiki S 2/27/2003

Great Article. It is the Truth , just the Truth. It has a great insight towards the working patterns. But it is more to the managements to take decisons. What i(tester) should do to eradicate this work style is not covered in detail. To summarize it is a GOOD ONE

 
 
Comment:    
by iggy pop 2/27/2003

Unfortunately, career opportunity in QA is limited where-as Development has far more career as well as financial possibilities. With that in mind, companies need to value employees who truly enjoy testing. They are rare gems that are often undervalued. One who are knowledgeable and able to balance between technical and personal skills are the rarest breed of them all. If you have a staff like this, pamper them in every way possible that will benefit. Throw them more hardware and tools until they feel swamped. I for one have been very fortunate to work for a team that appreciates me. I hope everyone out there who loves this profession...Read On

 
 
Comment:    
by Achal Bhargava 2/26/2003

That's a wonderful article depicting the core of testing practice. I also agree with the certification point and apposite training for the testers. As far as quality is concerned it is there in every sphere of life. It is actually a habit not a practice. The company which is spending so much on the product development with an expectation of good software along with other quality things, must get an 'almost' bug free software. We should honour their 'feelings' and pay back in return something that is upto their expectation and belief. That's what I think keeps us in business.

 
 
Comment:    
by Sanal Menon 2/26/2003

Very much agreeable. In fact, there are many testers in the industry and many of us do a very good job. But what we lack is the commitment to the field. Most of the testers I have interacted with have said "If I get a change to development, I would rather go for it.". This is the attitude which the testers must come out of. It's as simple as this "If we don't respect our job, the others need not respect our profession". - Sanal

 
 
Comment:    
by Tek Wallah 2/25/2003

My experience mirrors Dr Wittaker’s survey: the best-regarded testers are those who are the best at their jobs and face each day with the joy of a child on an Easter egg hunt. I’d also agree that a degree in the hard sciences or mathematics is an excellent background, because it teaches the scientific method (be factual and methodical and observant). Ultimately, testing will get respect when it become sufficiently effective that upper management see it as an essential part of the process, rather than an optional add-on

 
 
Comment:    
by Jim Hazen 2/25/2003

I can agree with the vast majority of the article. I have been in both situations where the Test group was on par with development and the "Red headed bastard step-child" to development. The former was the more enjoyable and challenging environment to be in. I have to stress that it takes a company (and culture) that is interested in producing a "quality" product where not only testing, but other groups too are part of the overall product development process. These companies are the ones that really excell in both their products and their people. Unfortunately they seem to be few and far between. I do have to voice my opinion on one...Read On

 
 
Comment:    
by edA-qa mort-ora-y 2/25/2003

Quality Control is a vital part to any development process, whether it be manufacturing or software. Any individual on the team that does not recognize this is inexperienced. This indicates that regardless of how well the QC position is filled, the inexperience will remain. Inexperienced individuals need to be educated, and it is unfair to expect QC to educate Engineering about the role they play, certarinly engineering does not educate QC in this sense. This education is a role for management, in particular the Quality /Assurance/ team should be involved in this type of work: making sure all sub-teams in the development group understand...Read On

 
 
Comment:    
by Srinivasan Desikan 2/24/2003

Excellent article. I agree that testers need to build credibility for the developers to listen. Testers can also be the leaders in their own way by keeping a vision for the test team and moving towards it. If product can be considered as a technology domain, testing also can be considered as technology as the methodology & technics used for testing are also equally complex. There are many areas in testing which requires good research (statistical testing, clean room, six sigma ...etc). In some cases the automation tools need better technology than the actual product as they are equally complex. The reason why I am talking about all these, is...Read On

 
Back to Top



 
Ads By Google
What's This?
 
 



Home   |   Resources   |   Topics   |   Community   |   PowerPass



© 2010 StickyMinds.com. All rights reserved.
StickyMinds.com is a division of Software Quality Engineering.
Privacy Policy    Terms & Conditions    Link to StickyMinds.com    Feedback


Rally Software

HP Software




STAREAST 


Better Software Conference