TrainingConferencesAbout UsContact UsAdvertiseSQE.comRSS Feed

StickyMinds.com: brain food for building better software

Log In
 Clarify Your Search Criteria

Tips on Using Our Search Feature(s)
 
StickyMinds.com Home
ResourcesTopicsCommunityPowerPassBlogs
Home  >  Detail: Test Managers—Start Managing!



A StickyMinds.com Original
Article Picture
Test Managers—Start Managing!

By Dion Johnson

Send This Content to a FriendGet a Short Link to This ContentPrint This ContentSee User Comments About This Content

Summary: Some things in life, like death and taxes, are a given. Software development teams face their own givens: Project schedules will always change and certain teams will suffer because of these changes. If that's to be expected, then why haven't most managers done anything to save their teams from undue stress and abuse? In this week's column, Dion Johnson explains that we've got to take care of our teams, or else we'll never see the end of team abuse.


Seapine
Some things are guaranteed in life. For example, we can almost certainly guarantee that none of us will live to be 200 years old. It's possible, but highly improbable. Another guarantee that can be made is that testing is going to be squeezed when it comes to the schedule. While it's possible that you'll be given sufficient time for testing and an appropriate ranking in the project's list of priorities, it is highly improbable.

Given this nearly indisputable fact, I must pose one question to some of you test managers out there: Why are you still being blindsided with these issues as if you don't know they're coming? Why are you allowing your team to be prodded into obscene amounts of overtime while other project members get to enjoy their weekends? Why are you allowing your team to be forced to provide last-minute justifications for unexecuted tests and unexercised functionality that are a direct result of schedule constraints? Why are you allowing your team to be the primary target in the finger-pointing game that will inevitably be played?

OK, that was more than one question, but I must say that I am absolutely baffled by the shear lack of preparation of some test managers. Mitigating these types of concerns is a fundamental job of test managers. So, if you're not doing this, then what are you doing?

Despite popular opinion, simply attending meetings and transferring pressure does not constitute test management. I'm sure all of you know what I'm talking about, because we've all undoubtedly seen those managers that have become experts at looking busy and authoritative. They are always going to and coming from meetings, and when they receive pressure from the project managers, they simply transfer that pressure to the subordinate test engineers. When they get yelled at by their bosses, they transfer that aggression by yelling at their subordinate test engineers. This approach to management is not helping anyone, because nothing is really changing.

I'm under no illusion that there is some sort of magic solution that will make inefficient projects suddenly begin to operate more smoothly or that will completely shift the typical burdens off of the test team. What I am suggesting is that it is possible to manage expectations, slowly alter the predisposition to improperly squeeze the test team's schedule, and boost team morale. Some ways a test manager may accomplish these effects include:
  • Employing risk-based testing
  • Establish trust with subordinates
  • Learning what money can't buy
Risk-based Testing
 
Priority 1= 96% - 100% of cases tested

Priority 2 = 81% - 95% of cases tested

Priority 3 = 51% - 80% of cases tested

Priority 4 = 21% - 50% of cases tested

Priority 5 = 0% - 20% of cases tested
Table 1: Test Completenees Goal
 
Risk-based testing is an approach to testing that assigns priorities to features and functions to be tested based on the risks associated with a failure in that feature or functionality. A test completeness goal will be assigned to each priority level.

As illustrated in table 1, the higher the priority (Priority 1 is the highest priority), the larger the number of tests that must be executed. This helps to determine how best to limit test execution based on schedule constraints and also makes it easier to communicate this information to project managers earlier in the project lifecycle. Therefore, when the schedule begins to get slashed, which it undoubtedly will, there will be no question about what tests will and won't be executed and the potential risks involved.

With this information made available to project managers well in advance, a more thoughtful, deliberate decision can be made about how far to actually expand development at the expense of testing. However, this only works when you limit the number of tests/features/functions that can be assigned to each category. If everything is a Priority 1, you've defeated the purpose of prioritization. In addition, the number of tests and the average execution time per test must be calculated in order to effectively set testing goals.


Establish Trust with Subordinates
If you take care of your team, then they will take care of you, so stop passing the buck. Quit throwing your team under the bus. I can think of a million other clichés, but the primary message that I'm trying to get across is: Grow a backbone, and take care of your people! You are supposed to shield them from the politics on the project so that they may focus on actually getting work done. If your team members don't feel that they can trust you to stand up for their interests, then much of their time and effort will go into providing political cover for themselves, which will reduce the amount of time and effort they spend working.

In order to effectively stand up for your team, you must establish trust. You must be able to trust them, and they must be able to trust you. Having trust in your subordinates does not necessarily mean you have to assume they are getting tasks done, but it doesn't mean micromanaging either. Neither works well for the trust relationship. Instead, establish and enforce the use of standard templates and procedures, and set up a centralized location for regularly storing metrics that you, as a manager, can use to generate progress/trend graphs. Trend graphs are an excellent means of tracking progress without constantly standing over your subordinates' shoulders or requiring an overabundance of productivity-killing status reports. Test management tools are extremely effective for this job. If you have access to one, use it. Too often, test managers allow test management tools to be used just for storing tests and not for their full range of reporting and analysis capabilities.

Once you begin to trust in your subordinates, work on building their trust in you. One way to do this is to show them that they have your confidence. For example, if a testing disagreement between a resource on another team and one of your subordinates is brought to your attention, begin by giving your subordinate the benefit of the doubt publicly. Then, seek to clarify matters with them privately. Don't publicly assume that your team is incorrect. Also, limit the amount of overtime you will allow to be requested of your team. With the test completeness goals identified early in the project, you now have a basis for saying no to requests for overtime. And when you are able to get resources to volunteer for overtime (which is much easier to do when they feel you have their best interests at heart), make it clear to the project team that you and your team will only work the overtime when the appropriate support (development, networking, DBA, etc.) is also available. There is no bigger waste of time than coming in to do testing without support, because the minute something goes wrong with the system, testing is dead in the water. When you continually allow your subordinates' time to be wasted, they begin to get the feeling that you and the team don't value their time, and you begin to lose trust and productivity.

Learning What Money Can't Buy
Often managers feel that they can make up for poor management and planning by throwing money at the problems on the project. For example, when projects face an approaching deadline that is in danger of slipping, there's often an inclination to attempt to assign more resources or try to automate quickly. However, the fact of the matter is that extra resources, test automation, and other attempts at getting quick results generally require more time in the short term. So, making such attempts at a moment when time is of the essence can be extremely counterproductive. Test managers must be able to effectively communicate this to project management to avoid making a bad situation worse.

As someone who has managed test teams and worked for both effective and ineffective test managers, I've seen the positive impact of successful mitigation of the known testing concerns discussed in this article, as well as the negative implications of failing to mitigate them. I therefore implore all test managers to do your job and find a way to effectively address these predictable circumstances, either by using the recommendations laid out above or by identifying your own.


About the Author
As a senior test consultant and managing partner for both DiJohn IC, Inc., and Achieve QA, Inc., Dion Johnson provides IT consulting services that focus on the overall system development lifecycle, with particular focus on the quality assurance, quality control, and requirements analysis elements. He has presented at numerous SQE conferences and contributed to StickyMinds.com and Better Software magazine. Email Dion at dionjohnson@dijohn-ic.com or dionjohnson@achieveqa.com.

Back to Top
 

StickyMinds.com Weekly Column From 7/28/2008 

Member Comments
Add Your CommentExpand Comments
 
Comment:    
by Rajagopal Srinivasan 3/20/2009

Very good Article on how a Manager should be and shouldn't be. I think this would be suitable for all manager's and not only Test Managers.

Author's Response:
3/20/2009    
Glad you liked the column. I have another column coming out in stickyminds in April. In addition, I have an article coming out in the Automated Testing Institute's magazine also coming out in mid April. Stay tuned to www.automatedtestinginstitute.com for more information on that.

 
 
Comment:    
by Karen McCutchan 8/15/2008

Excellent article. I've worked under one or two Test Managers who seemed to be doing the right thing and I think this success (or the failure of others) can also be attributed to whether their Managers, Directors, etc. buy in to the importance of a test team. My current company no longer values testing and is laying us off. Maybe that's a good thing for me, because I'm really tired of being considered 'low class' and getting paid a lot less than developers. Our developers don't even test their own code any more.

Author's Response:
8/18/2008    
Sometimes movement is good. I certainly hope that your next position turns out to be a more fruitful one. Thanks for the comment.

 
 
Comment:    
by Adisheshaiah G 8/5/2008

Very good article, describing the problems many QA Teams face. The Test Managers should guide the Testing team towards Risk Based Testing during Resource Constraints, and they should act as a cover for them rather than the one's Transferring pressure to Team. All your your points are valid lifetime. Thanks for the article.

Author's Response:
8/18/2008    
Thanks for the feedback.

 
 
Comment:    
by Dmitri Korolkov 8/2/2008

While reading "Learning What Money Can't Buy" I remembered one interesting special case - the Brooks's law. What discussed in this article is more general - and I'm glad to realize it.
Also, I think, ideas of "Establish Trust with Subordinates" look like some "professional honesty" for manager.

Author's Response:
8/2/2008    
Excellent reference, Dmitri! Brooks's Law says that "adding manpower to a late software project makes it later". This was said in a book written way back in 1975, yet so many people still haven't gotten it. Amazing.

Thanks again.

 
 
Comment:    
by Sarah Brown 8/1/2008

If only the key points in this article was adhered to by Test Managers.......

Test Managers should all know about risk based testing approaches, although it seems that this is not often implemented. In the presence of upper management pressure lots of Test Managers give in to their demands foresaking all that they have learned from school or past experiences and the end result is: A delivered product full of defects because of insufficient testing.

Test Managers need to refocus and like the author said...."Start Managing"!

In the meantime I'll just sit and wonder....If only...Read On

Author's Response:
8/1/2008    
I totally agree with your assessment, Sarah. It's been said that the definition of insanity is doing the same thing over and over again, yet expecting a different result, so I guess there are a lot of insane people in IT! It's hard to figure out why some people don't learn from past experiences, and make the appropriate adjustments, but that is all too often the reality with which we are presented. So I’ll join you in the fond thoughts of, “If only…” ;-)

Thanks for the feedback!



 
 
Comment:    
by John Overbaugh 7/29/2008

Excellent points in this article--we TMs do need to be more proactive, and to watch out for our teams. They're all we have!

One thing I've discovered is that upper management is generally responsive to facts and data. One tool I've used is a simple project scorecard--I list tasks we've completed, current tasks, issues, risks, defects, and I provide a summary of days we SHOULD HAVE been able to test vs ACTUAL days we have been able to test. It's an eye-opener to management.

The other thing I need to do more of is post-project root cause analysis/six-sigma stuff. If I can show management that, over and over, dev estimates...Read On

Author's Response:
7/29/2008    
"They're all we have". Well said! It sounds like you have some pretty good tools/techniques for addressing some common issues that are faced in many testing projects. You're one of the good managers, I see ;-)

Thanks for sharing some of your approaches. I'm sure many of the readers will find them useful.

 
 
Comment:    
by Fiona Charles 7/29/2008

Bravo, Dion -- especially reminding test managers they need to "grow a backbone"!

There's absolutely no need for a test manager who is prepared and on top of the issues to be trampled on, and it's completely unacceptable to allow your team to be. I've written about some things test managers can do to protect themselves and their teams (in Overtime Under Control, Planning The Endgame, and Surveying The Terrain). I plan to continue doing this -- as I hope you will!

Author's Response:
7/29/2008    
Thanks for the feedback, Fiona!

You have definitely had some good content on this type of topic. I especially like your column entitled "Planning The Endgame", and would encourage people to go back and read it (which they can do by using the search textbox on the home page to find it on the stickyminds site). It identifies a good example of a realistic approach to take when calculating the number of tests that can be executed in a given period of time. This example could prove helpful to test managers as they seek to identify the test completeness goals I've discussed above.

Thanks again for the feedback, and I look forward to reading your next column!

 
 
Comment:    
by Bob Edwards 7/29/2008

There are a number of underlying reasons for this generalized reality of working in the software quality assurance world. I think the majority can be rolled up into one major factor in most of our worlds - as members of software test, or software quality, unless you are in a business where product quality is paramont (Spacecraft, commercial aircraft, nuclear power plans, medical devices, etc.), the "test team" is made up of what the company views as the least important, and least valuable people on the team.

In our industry, being a member of test is often a stepping stone into development. Given that the disciplines are quite...Read On

Author's Response:
7/29/2008    
Thanks for your effort in adding such comprehensive feedback to the discussion. You’re right, in the fact that many managers were technical resources that for one reason or another were ‘promoted’. Often these technical resources want to broaden their resumes, and as a reward for being great, dependable technical resources, they are given the opportunity to do so via a management role. I don’t think this is a bad thing, but it needs to be understood that technical adeptness doesn’t translate into managerial adeptness. If the promotion is given as a reward, and not based on some proven ability to manage people and/or projects, the new managers need to be supplied with appropriate training to ensure they are prepared for their new positions.



Thanks, again!



 
 
Comment:    
by swapnil kadu 7/29/2008

I totally agree with Mr. Johnson.
Everyone knows what is right but no one wants to attempt it. I doubt how many people will actually change things after reading this.
The biggest quality a manager should possess is to change for the good of project, leaving aside his/her ego.
I always wonder, if we every time miss the deadline or have to squeeze to fit in, why don't we improvise on our estimations instead?

Author's Response:
7/29/2008    
You never know. Maybe someone will read this and be convicted to do a better job at managing. If not, at least I got I chance to vent some grievances on behalf of the testing community. ;-)

Thanks again for the feedback.

 
 
Comment:    
by Manmeet Layal 7/29/2008

I really liked the content of this article.. very apt to most projects and the points mentioned for mitigation are also doable. If only Test Managers or other Managers would also take note :-)
From my experience till now I feel most times the managers get into this vicious cycle of "meet-the-deadline" be it milestones in a big project or the project itself that they will sometimes forget the people side of it. They see only the task and not the doer. I guess this is the "trust" already talked about in the article.

Author's Response:
7/29/2008    
You’re right. Managers do often forget the people and focus only on meeting the schedule. The irony, however, is that the more they do this, the more the schedule tends to slip.

 
 
Comment:    
by Sanat Sharma 7/28/2008

All the points mentioned by Johnson are authentic but not new. Risk Based testing is one of the best techniques that all the Test Managers should use when the deadlines knock the door. Most of the time, I have seen that the higher management’s only concern is to keep the product out of the door as soon as possible. Trust is one more factor. Trust is invisible but the symptoms of its absence are not. Test managers should take care of this. The last point “Learning What money can’t buy” is something which I must call a bad project management practice.

-- Sanat Sharma
http://www.xtremeedge.blogspot.com

Author's Response:
7/28/2008    
Thanks for your feedback, and for reiterating my points. Let me begin by saying that what may be common knowledge to some, may be new information to others. Having said that, I will also say that I agree with your statement regarding the newness of these concepts. The purpose of this column is to provide renewed focused on what's missing, as opposed to what’s new, and to apply some gentle pressure to all test managers to be a part of the solution, not part of the problem. I’ve been on projects where some great managers have recognized these points, and whenever I’m in a management/lead role, I’ve tried my best to address these points. Consistently, however, I’ve found that in some organizations management often neglects these items that I've pointed out, and the team, project, and organization have suffered greatly for it. These items must be readdressed with renewed vigor if our projects are ever going to reach their full potentials.

Thanks again!


 
Back to Top



 
Ads By Google
What's This?
 
 



Home   |   Resources   |   Topics   |   Community   |   PowerPass



© 2010 StickyMinds.com. All rights reserved.
StickyMinds.com is a division of Software Quality Engineering.
Privacy Policy    Terms & Conditions    Link to StickyMinds.com    Feedback


Infosys

Rally Software




Agile Development Practices 

STARWEST