Reviewer Tool

How to Review a Job?

• The Reviewer tool opens the job done by a maker along with a prompt on the header. You can choose to either Edit or Reject the job based on the number of corrections required.

• View by Group feature helps you adequately understand the quality of the job so you can judge the number of corrections required.

1. Edit Job

This option should be picked if the job requires some corrections.

• The Reviewer tool converts into a Maker Tool when you select the Edit option.

• To help makers improve their performance in the future, you can check the analytics of mistakes made by the makers based on the changes made by the editor in the Annotator performance section.

2. Reject Job

You can pick this option if the job requires a large number of corrections.

• After you select the reject option, a list of all possible errors is displayed in the form of a checklist for the reviewer to keep error records.

• Additional feedback can also be added under the checklist for the makers so that they can avoid further mistakes.

• This job is sent back for re-work on submission.

Here's a complete walkthrough of how to use the QC Tool for 2D Image Labeling