TrainingConferencesAbout UsContact UsAdvertiseSQE.comRSS Feed

StickyMinds.com: brain food for building better software

Log In
 Clarify Your Search Criteria

Tips on Using Our Search Feature(s)
 
StickyMinds.com Home
ResourcesTopicsCommunityPowerPassBlogs
Home  >  Detail: Advice on How to Hire Testers


A StickyMinds.com Original
Article Picture
Advice on How to Hire Testers
A Plea for Hiring Managers

By Johanna Rothman

Send This Content to a FriendGet a Short Link to This ContentPrint This ContentSee User Comments About This Content

Summary: What’s the best way to wade through those thousands of resumes you’ve received for the new testing position? To start, you could ruthlessly weed out those who don’t show experience with your organization’s particular toolset. But in this week’s column, Johanna Rothman warns against this type of approach to hiring. By not looking at the person beyond the tools, you might be letting a star slip through your fingers.


TechExcel, Inc.
Pamela, an out-of-work tester, has a master’s degree in computer science and is most of the way to a doctorate in quality. She has eight years of experience in testing. Pamela has been unemployed for the past six months, and no one will even interview her.

Pamela doesn’t have any perceptible flaws on her resume, except for the time she took off from work to go to school. She has great references. Okay, she’s a geek, but a socially acceptable and technically astute geek.

No one will phone screen or interview Pamela because she doesn’t have all the toolset vendor acronyms on her resume. She has experience with parts of numerous testing tools, but not more than a couple of months’ experience with any piece of one. Pamela’s not comfortable putting the tool names on her resume because she doesn’t have even one year of experience with any of them. Hiring managers and internal recruiters seem to be looking for tool experience rather than a person who can learn about a tool.

What a shortsighted mistake.

Why does this happen? One of the reasons many hiring managers and HR staff rely on tool experience is that they don’t know how to define the requirements for the kind of employee they want to hire.

I recommend against filtering resumes for specific toolset experience. It eliminates some of the most talented people, people who can easily learn a tool—who are already great testers, but not familiar with your toolset.

This mistake is not restricted to test managers or other technical managers. However, as technical people, we are more likely to depend on HR for initial resume screening. And, because most HR staff don’t understand what testers do, or understand the desired experience, they screen resumes based on things they can easily check off as a "yes" or a "no" (e.g., toolset, operating system, compiler experience, etc.).

Instead of letting your HR staff filter out promising resumes, try some or all of these alternatives.

Talk to Your HR Staff
When I have taught HR staff how to read technical resumes, I would write down a grid of the kinds of technical experience I expected to encounter on resumes. I listed the potential operating systems, compilers, and tools experience I wanted. Then, I talked to the HR staff. I explained why I was looking for this experience. I explained the relative importance of each kind of experience. In addition, I explained which personal qualities (such as perseverance, initiative, focus, curiosity, skepticism, problem identification, problem solving, goal orientation, adaptability, etc.) were important, and how those qualities ranked with the technical skills. I discussed what I was willing to trade off, in terms of tool experience vs. other experience. For example, I’m much more interested in knowing that a tester knows how to describe a defect so that a developer will fix it, rather than in which tool she has written scripts. In my experience as a hiring manager, once someone has learned a tool or two, learning another tool is trivial. I’m more interested in a candidate’s personal qualities, so I have a group that works well together.

Screen Resumes Yourself
Even when I’ve had the discussion with HR, sometimes they can’t help us. Some resume-screening tools categorize resumes by acronym, not by what the candidate has done. Or sometimes my HR person is a junior employee, someone who hasn’t worked long enough to understand what I’m saying. Or sometimes the HR staff is too busy to screen resumes in a timely fashion.

If that happens to you, then you can screen resumes yourself. Whenever I hire for an open position, I always screen the resumes myself. I create three piles: Yes, No, Maybe. I screen relatively loosely based on skill, and much more tightly based on how the person has worked, keeping in mind those personal qualities I want. I don’t mind phone-screening lots of people, because I can learn more from a brief phone conversation than I can from a resume. I phone screen the "Yes" resumes, respond via HR for the "No" resumes, and after I’m done with the "Yes" resumes, I decide whether to pursue the "Maybes."

Clarify Required Experience
One of the reasons many hiring managers and HR staff rely on tool experience is that they don’t know how to define the requirements for the kind of employee they want to hire. If you’re in this boat, don’t feel bad; you have plenty of company! After all, there’s a huge difference between someone who’s a whiz at testing GUIs and someone who tests embedded systems.

Many hiring managers have never analyzed their open positions, to define the requirements. However, you can define the skills and personal qualities you want in a candidate relatively easily. Here’s a quick technique for analyzing the job:

  1. Define the roles this person plays, and at what level you think the interactions lie.
  2. Define the activities and deliverables of the job.
  3. Take a look at your current staff, and identify the personal qualities that make a person successful in your group. If you’d like some ideas for this, review the list of talents in First, Break All the Rules, by Buckingham and Coffman.
  4. Define anything that would prevent you from hiring a candidate. I’m not talking about your preferences, I mean anything that would make the candidate not fit into your organization at all. Examples are people who can’t work overtime at release time; people who aren’t available to travel and the job requires travel; classes of people your company doesn’t hire, such as felons; or whatever is specific to your job.

You’ll notice that education and toolsets are only a small part of this analysis. If you absolutely require some specific minimum of education (because your clients demand it) or tool experience, then add that. However, I’ve never found specific tool experience worth hiring for.

So, here’s my plea: Make sure you’re looking at the whole person, not just a tool. Pamela, and all the other Pamelas out there are ready, willing, and able to work. Let’s give them a chance to prove themselves in an interview.

Show this column to your company’s hiring manager(s), people in HR who scan the resumes, and everyone else involved in hiring. Help your hiring managers and recruiters look past the tools to the person.

Acknowledgement
I thank the following people for their helpful reviews of this article: Esther Derby, Elisabeth Hendrickson, and Dwayne Phillips.



About the Author
Johanna Rothman observes and consults on managing high-technology product development, looking for the leverage points that will make her clients more successful. Johanna was the Conference Chair for the Software Management (SM) Conference in February, where she conducted a management-improv tutorial and participated in a panel discussion of mentoring and manager making. She recently co-moderated a RoundTable discussion “Making the Transition to Management” with Esther Derby. You can reach Johanna at jr@jrothman.com or by visiting www.jrothman.com. For more information about analyzing job candidates, you can refer to Johanna’s upcoming book Hiring Technical People.

Back to Top
 

StickyMinds.com Weekly Column From 4/22/02 

Member Comments
Add Your CommentExpand Comments
 
Comment:    
by ArvindPal Singh 6/19/2002

Thanks for an interesting reading giving insight into things to be looked for. Certainly, characteristics of a tester, with an ability to couple it with a rationale, are extremely important. Tool learning may not take much time, if one is already conversant with one tool, more importantly the philosophy behind the testing. Thanks again for the wonderful reading.

 
 
Comment:    
by David Roessler 5/14/2002

Great Article! I am only sorry I didn't find it earlier. I guess my experience is somewhat different in that, as a hiring manager, it was completely on me to screen candidates (small company). Though I liked a candidate well versed in test tools, that was secondary; primary was the approach taken to describe and solve problems, and breadth of experience not necessarily related to the technology at hand.

 
 
Comment:    
by anil Tumati 4/27/2002

This is the best article that I have seen on the hiring testers. I do agree with all the aspects that you have said in this article. I have been interviewing for QC Leads and QC Engineers, from the last couple of months, I have selected a couple of them. But till today I was not convinced with any of the candidate for the basic reason that why the candidate is not able to differentiate between “Quality” and “Testing”? Pamela, can u tell me why?

Author's Response:
4/30/2002    
Anil, I'm not Pamela, so I can't answer for her, but I can explain why I wrote the article the way I did. Many people in software equate "QA" with "Testing". I wanted to make sure people understood I was talking about testers, even if Pamela's degree is in quality. The Masters and PhD programs are about quality, not just testing. Sometimes, I ask people about the difference between QA and testing, but I usually ask that at the manager or director level, not at the individual contributor level.

 
 
Comment:    
by Behzad Dastur 4/26/2002

A good article. I think part of the problem also lies in the fact that software testing in itself is a very new field. And unlike other software engineering fields a very different skill set as well as mind set is required. Many people today are not really aware of software testing methodologies or some do not even consider software testing as a seperate discipline , even at university level very few universities actually teach software testing as a seperate major. I believe for a software testing position a person with the right attitude is a much better choice than the one with the right tool sets.. thanks.

Author's Response:
4/30/2002    
Behzad, I agree that the study of testing is newer compared to the study of development. However, many of us with gray hair remember being taught how to unit test in school :-) One of the big differences is that we treat testers differently from developers in the workplace, sometimes appropriately, sometimes not. I agree with you that a person with an appropriate attitude is better for the job than someone with a specific tool experience.

 
 
Comment:    
by Jim Grey 4/26/2002

When I was a hiring manager, I screened my own resumes in much the manner you suggest, and I found some real gems that way. Sure, they had to learn our tools, but that takes no time compared to the time it takes to build the traits and temprament the job needs. I recently found myself unemployed. I had a pretty solid accomplishments-based resume that gave good insight into my abilities; it was getting almost no airplay. It was frustrating to me that direct-placement and consulting-firm recruiters kept wanting me to rewrite my resume to deemphasize accomplishments and emphasize tools and hard skills. I did it, but the leads I got from...Read On

Author's Response:
4/27/2002    
Jim, I'm pleased that you and I have had similar hiring experiences (those gems you referred to). Congratulations on finding a recruiter who can think, and on your new job. That's a recruiter to keep in your network.

 
 
Comment:    
by Venkat Potluri 4/25/2002

Wonderful article. I am also facing the same situation as Pamela, having experience with multiple automated tools for software testing. But, you know the result,People are thinking that as a cooked up resume and feeling that no one get a chance to work on multiple tools.Its really crazy thing, even I got good references , recruiters not believing those and looking for a person who has more experince in one single tool. How it is possible? Even if we want to explain them they dont have time to listen, keeping busy in sorting hundreds of resumes... Previously, same recruiters hired the people who doesnot know about the tool and used to say...Read On

Author's Response:
4/26/2002    
Venkat, thank you for writing, and good luck with your job search.

 
 
Comment:    
by Sarah Ralph 4/25/2002

This article reminded me of the time when my Test Manager was sifting resumes for a Test Analyst position, and asked my opinion on a couple of resumes. One of them was chock-full of TLAs (Three letter acronyms!), if you could think of a testing tool this guy had used it. Ditto programming languages and networking experience. This all seemed fine and dandy, but under 'Hobbies and Interests' he had put 'building computers, learning new programming languages', and other really techy stuff which didn't have a clue about. In short, he gave no indication of the kind of person behind the impressive list of 'qualifications', or of whether he would...Read On

Author's Response:
4/25/2002    
Sarah, I loved your story. If candidates don't clue you in to how they work, how the heck can you decide whether to interview? It's easier to decide not to (and probably more appropriate). Amazing.

 
 
Comment:    
by Sanal Menon 4/25/2002

I agree with you in all respects. I too have the same thoughts about the present recruiting process for testers and I hope to change this strategy while my organization recruits more testers. But in my understanding, the higher management in any organization is more bothered about the amount of money that they have to spend on a candidate after recruiting (Training on testing tools etc). Keeping this in mind, how can we convince a management for this?

Author's Response:
4/25/2002    
Sanal, I like to talk about the cost of training someone who can do the testing to use our environment vs. someone who already knows the tools, but can't work in our environment. The cost of training someone is the total cost of learning to use the tools (list all the tools, estimate the time to explain the easily explainable, add in the training cost), plus the cost of product training (the product under test). I find that the cost of product training usually dwarfs the other costs.

 
 
Comment:    
by john tyson 4/24/2002

Thank you, thank you, thank you! What makes this even more frustrating is for those of us that are hired thru agencies. Most agents don't/won't/can't spend the time to educate the hiring managers at the companies they're placing people. So you have clueless hiring managers giving "hiring specs" to clueless (or powerless) agents.

Author's Response:
4/25/2002    
John, is this like the blind leading the clueless :-)

 
 
Comment:    
by Tek Wallah 4/24/2002

I share Ms Rothman's irritation at HR's playing alphabet soup with resumes. Too many HR people have the exquisite ability to throw out the only resumes I have any interest in. On the other hand, I suspect Pamela's problems may have more to do with what *is* on her resume, rather than what's missing. Why would anyone with 'a near Ph.D.' want to do testing in a typical shop? As soon as this recession is over she'd be looking for another job, or treading on her bosses heels. There's nothing dishonest in putting keywords on your resume, as long as you're honest about not having much depth of knowledge. There's also nothing dishonest about not...Read On

Author's Response:
4/25/2002    
Tek, Pamela's proud of her accomplishments, and while I may share your skepticism about the wisdom of putting a PhD on a resume, she wants it there. I've never been in the position of not wanting to include some education or experience on a resume, for fear that I would look too qualified, but I certainly think candidates should consider that option. However, I don't think her education is preventing her from getting interviews.

 
 
Comment:    
by Doug Jacobs 4/23/2002

Great article. My only real issue is that this really applies when the economy is doing well and the job market is thinner. With today's market (while improving) one thing has to be seriously considered; there are *SO* many very qualified (if not overqualified) people out there who have the specific tool experience and want a job. Why would I want to spend precious (again, specifically in our time of economic recession) resources of time and money to teach a new employee. Which brings up contractors - I hire contractors because of what they can bring to the table and add value with immediatly, I don't pay them to learn. The only thing I...Read On

Author's Response:
4/24/2002    
Doug, do you mean that only when the economy is good, and it's a candidate's market will hiring managers do this? In my experience, you're right, but I'm meeting many managers who've done a bad job hiring (hiring for technical skill/tool only, without regard for the rest of the person), who now have to fire people. I agree with you about contractors - I don't pay them to learn either.

 
 
Comment:    
by Mary Alix 4/23/2002

If only I were the sole person involved in the hiring process! Unfortunately, by the time everyone involved has their say about who is a "good" candidate for a testing position, the hiring criteria has gotten out of hand. In addition to those skills (independence, problem-solving, analysis, communication) that are outlined in the article and important to a testing supervisor, development is looking for someone who "knows" code, business managers are looking for someone who "knows" the business, and general managers are looking for someone "inexpensive". In addition, there is the perception of testing (by outsiders as well as some...Read On

Author's Response:
4/23/2002    
Mary, When you create hiring criteria, do you try to separate the "essential" criteria from the "desirable" criteria? I find that separating essential from desirable helps with scope-creep, applied to hiring requirements. I'll certainly consider your comment about discussing techniques for managing the other people who have input into the hiring process. Good idea!

 
 
Comment:    
by Umesh Shah 4/23/2002

It is a nightmare to go through the hiring process, If you do not put these tools name, even if you have used for few months you are out of prilimnary selection,some recruiter use tool to weed through your resume, if chosen words does not appear few times you are out, the best way is to speak to person and let him explain his background and projects, if you are smart you know who is right candidate for you,Belive me I had gone through both side of fence, this looks good solution for recruiting testers.

Author's Response:
4/23/2002    
Umesh, discovering who the hiring manager is, and making a personal connection is a *great* way to get an interview, without having to deal with tool experience. That's why I recommend people who are looking for work start to network with local professional societies. It's amazing how easy it is to find a job if everyone knows you're looking, and they know something about you.

 
 
Comment:    
by Steve McClung 4/23/2002

I have recently witnessed internal requests, submitted by our testing organization, requiring very specific skill sets. This type of hiring is on a project by project basis. I realize you are speaking about an organization hiring testers predominantly from outside, but the internal request is a prolific form of hiring for testing positions. A small minority of testers are coming from outside our organization. The specific tool experience is required, because the start date of the project is typically close, there are budget constraints and current budget contstraints require people already trained in the tools unless, of course, they...Read On

Author's Response:
4/23/2002    
Steve, you're right. Although my example was hiring from the outside, this attitude is just as pervasive when hiring from the inside. Unfortunately, the PMs who think they have these tight constraints don't recognize that tool training is incredibly cheap, compared to the cost of hiring someone who can't do the work but knows the tool. (And, the PMs probably haven't tested their cost constraints, they're just assuming they have these constraints.)

 
 
Comment:    
by John Wilson 4/23/2002

An excellent article. I learnt the skill of hiring the best people from a director who hired a PA with no secretarial experience at all. His reason, “Anyone can be taught secretarial stuff but you can’t teach the personal qualities that make a good PA” I think this illustrates the point that in any activity you do, you are responsible for the outcome. No one else is to blame, but yourself, for missing an opportunity. You will probably have to achieve results through the efforts of other people and before you can brief them on what you want, you have to know what you want first. Question the ‘sausage machine’ system that others may use...Read On

Author's Response:
4/23/2002    
John, I agree with you. Even people who feel as if they are at the bottom of the hierarchy, still work through other people to get their work done. As soon as this economic downturn is over, the competitors who are hungrier and more willing to figure out the kinds of people they need *will* be looking at people who are more than the sum of their tools.

 
 
Comment:    
by Bret Pettichord 4/22/2002

Well put. When i screen candidates, the biggest thing i look for is flexibility. I ask them behavioral questions about how they handled situations where the spec was missing or their defect reports were rejected. I want to hear that they'll fight to do their best in an undefined situation.

Author's Response:
4/23/2002    
Bret, flexibility and adaptability are important, especially if people are working in an iterative fashion, or in an agile environment. Behavioral questions are key, because the information you receive from behavioral questions tells you how the person has worked in the past, and gives you the best insight into how the person will work in the future.

 
 
Comment:    
by Robert E. Lee 4/22/2002

Great and timely, JR! There are a lot of people out of work since 9/11 that have background but not tool brand experience. Certainly the applicability extends to most all technical hiring, not just to testers.

Author's Response:
4/23/2002    
Bob, yup, this is applicable to every job.

 
 
Comment:    
by Gerold Keefer 4/22/2002

well done, nothing to correct. i want to underline the usefullness and efficiency of phone interviews. if you want to get to know people you have to interact with them. i agree that a lot of talents get lost during the tool-naming-blues. most often it is quite interesting to drill deeper on people with all the tools available - in their papers.

Author's Response:
4/22/2002    
Gerold, I've discovered fascinating information about candidates in phone screens while I was taking notes. Some candidates can't stop talking while you're writing, and what they say is amazing :-) -- Johanna

 
 
Comment:    
by Suresh Reddy 4/22/2002

How True!!! I have had the same experience here. Some of the managers/hr do not look beyond the tool experience. Most of these hiring managers needs to be re-educated on this.

Author's Response:
4/22/2002    
Suresh, maybe if you print this page without the comments?? -- Johanna

 
 
Comment:    
by yogita sahoo 4/22/2002

With my limited knowledge, I can put the blame on the Rapid Hiring Process, which we follow at very short notice and end up finalizing on candidates with specific tool knowledge. Mostly companies keep their tester count very tight. Hence hiring requirements arise only when a project has desperate need of testing and QA lead can’t accommodate existing testers who are already occupied. Obviously the choice will rest on those resumes, which have already worked in similar testing environment/tools. And there we make the mistake of rejecting brilliant people only because the project deadlines can’t afford to accommodate their learning period. An...Read On

Author's Response:
4/22/2002    
Yogita, the Rapid Hiring Process doesn't have to preclude reviewing resumes based on things other than tools. I agree with you that making tool knowledge the major requirement ignores wonderful possible people. However, in my version of rapid hiring, the manager has to do more work. -- Johanna

 
Back to Top



 
Ads By Google
What's This?
 
 



Home   |   Resources   |   Topics   |   Community   |   PowerPass



© 2010 StickyMinds.com. All rights reserved.
StickyMinds.com is a division of Software Quality Engineering.
Privacy Policy    Terms & Conditions    Link to StickyMinds.com    Feedback


Cloud Connection

Rally Software




STAREAST 


Better Software Conference