The First International Software Testing Contest

The First IEEE International Software Testing Contest (ISTC) will be held in conjunction with QRS 2017 (the 17th International Conference on Software Quality, Reliability and Security) on July 26 at the Czech Technical University in Prague.

We cordially invite you to participate the contest and win a CASH prize!

Please click here to download the pdf version of the contest flyer.


All interested contestants must send an email to Dr. Ruizhi Gao before July 25. The subject of the email should be “IEEE 2017 ISTC -- Contestant”.

The content should include the first name, last name, and affiliation. There is no registration fee.

Format & Evaluation

All applications have to be submitted before the end of July 25 (CDT). All contestants must bring their own laptops. The contest has two parts:

  • The first part is an 2-hour tutorial (10:00am - 12:05pm). During this tutorial, we will help contestants properly configure their laptops, and explain how to use platform. Each contestant is required to have basic knowledge about Java programming and JUnit.

  • The second part is the contest (14:00pm to 17:40pm) where contestants are required to design test cases based on the given specifications to test three Java programs. The quality of these test cases is determined based on the code coverage (statement and branch) and mutation score achieved.

The ranking of all the contestants is based on the quality of test cases they generate, which is measured in terms of a combination of the statement and branch coverage, and the mutation score achieved. If test cases from multiple contestants achieve the same coverage, contestants with fewer test cases have a higher ranking than those with more test cases.

Platform & Configuration

Every contestant must bring his/her own laptop and have the following software installed:

  • Java JDK 1.7 (cannot be other JDK versions)
  • Eclipse Luna (cannot be other Eclipse versions)
  • A working web browser (Chrome, IE, Firefox, etc.)

If you have trouble installing the above software, we will help you set up the environment during the tutorial session before the official contest.


The first place receives a cash prize of $1,200 USD, followed by the 2nd and the 3rd places for $800 USD and $500 USD, respectively. The 4th to the 10th place each receives $300 USD.

Contest Venue

The First International Software Testing Contest will be held at the Czech Technical University in Prague, Faculty of Information Technology.

Important Dates

    July 25, 2017
  Application deadline
    July 26, 2017
  Tutorial & Contest
    July 27, 2017

General Inquiry

For any inquiry related to this contest, please contact Professor W. Eric Wong, Professor Zhenyu Chen, or Dr. Ruizhi Gao.