I'm looking for a good Test Case Management tool that is in JIRA or integrates with JIRA

Daniel Chelliah's picture

Any recommendations?

I've trialled:

  1. Xray
  2. Kanoah
  3. QTest Manager -  this is very similar to HP ALM
  4. JIRA - create a new issue type in it
  5. Hip Test
  6. qTest Scenario
  7. Qmetric
  8. Test Collab
  9. Test Rail
  10. Test Link

My organisation currently uses HP ALM.

10 Answers

Michael Tomara's picture

You did not try Atlassian's Zephyr? It can be found in Atlassian Marketplace. You can create test cases there, view them as Jira stories and link them to Jira defects. Full version is not free though.

Daniel Chelliah's picture

One of our testers used Zephyr before and didn't rate it. So we didn't consider it. The interface is a bit clunky.

Mark Bentsen's picture

After several tials, we went with XRay and have had good success. We did decide to follow a process where all of the test assets were put in their own Jira project.

Cormac Flood's picture

We use Zephyr and it's fine most of the time.

 

It is not possible to search for test cases by test cycle+another filter... but you can group tests by label and try and find them that way. Not great, but there you go. The people who created Zephyr don't seem to be completely motivated to fix some annoying quirks like that, but otherwise it's good, and we really value its integration into Jira.

 

You can also upload test cases from a spreadsheet, and some of our testers like to write test cases in spreadsheets as that's what they are comfortable with. As their QA manager I can't see the value in that, but some people have their way of working and if it works for them, then fine.

 

All in all I would give it a 6.5 out of 10.

Cormac Flood's picture

Thanks for pointing me in the direction of qTest Manager. Unfortunately they are not transparent about their pricing at all... you have agree to be contacted by someone in Sales. Not a great way to start a long relationship with a company so we will continue with Zephyr or look elsewhere.

All the best.

 

Michael Holmes's picture

There's a JIRA plug-in called Zephyr for JIRA - http://getzephyr.com/products/zephyr-for-jira.

It extends the JIRA issue type and includes a Test type, allows for editing of test cases as required, creation of test sets/suites, integrates with Projects/Releases in JIRA. Seamlessly links between tests and bugs.  We prefer to use 'Capture for JIRA' to do the screen shots and make use of it's templating ability for defect reports and then add the JIRA ids to the tests.  It allows traceability between JIRA Stories/Improvement requests/bugs and tests.  Allows for creation of ad-hoc test sessions (exploratory testing). Has some canned reports, allows some integration with JIRA dashboards. Records execution history.  Like HP ALM there are some quirks with regards to naming structures.  It has a few problems around the way it assigns tests to a test set when using filters to import test cases (usually somewhat out of order).  

Devira Kuswhara's picture

Hi,

I think Test Rail is quite good to work with JIRA. It has a specific field in the test case section that refers to a JIRA ticket number. So you will have a good idea in mind when you look at the test cases about which issue were they all about. Or if you open a ticket from JIRA, you can see the list of test cases regarding the issue as it is displayed at the screen.

Daniel Chelliah's picture

Thanks everyone for your input.

We ended up going with Adaptavist Test Management https://marketplace.atlassian.com/plugins/com.kanoah.test-manager/cloud/....

Here's a copy of the review I wrote for the tool

I was tasked with finding a replacement for HP ALM. This was due to HP ALM being very expensive and dated. The replacement had to be a good manual testing tool with the capability to support test automation.

  My organisation is a finance firm based in Sydney, Australia. We primarily follow Agile Scrum and use JIRA for our IT projects. I reviewed over 20+ tools that were either JIRA plugins or standalone applications (like HP ALM). These tools included Xray, TestRail, Zephyr and QTest. We already had JIRA running so the preference was for a JIRA add on rather than standalone tool. Test Management for JIRA was the most suitable tool for us because: 1. For manual execution it has an excellent layout and is easy to use. Ironically many of the testing tools in the market have a very poor layout and are hard to use. 2. It is tightly integrated into JIRA which makes raising defects super easy and fast. 3. It has excellent support from the creator Adaptavist. For example, we identified an IE issue and raised it with Adaptavist. The issue was promptly addressed in an update. 4. It has an API for automation 5. It is very well priced After the pilot of Test Management, the feedback was very positive and now it’s being used in our organisation as a replacement to HP ALM. We're very happy with Test Management and I'm glad to see they have a road map of enhancements they are working to. Please get in touch if you have any questions. More than happy to help.

StickyMinds is a TechWell community.

Through conferences, training, consulting, and online resources, TechWell helps you develop and deliver great software every day.