Access Manual Annotation and Audit

To access manual annotation and audit, select the sixth icon on the left side bar (the "reviews" tab).

Create Tasks

From this page, you have the ability to create new annotation tasks and auditing tasks. To start creating a task, click the create button shown below. After clicking the button, a form for creating the new task will appear.

Create Manual Label Task

1. Select type "Label".
2. (optional) enter a summary. This will act as the name of the task.
3. (optional) enter a description of the task.
4. Add users that will be allowed to work on the task.
5. Select a source dataset. The images to label will be drawn from this dataset.
6. Select a destination annotation set or create a new one. All the labels added during the manual annotation task will be added to this set. Enter a new name in the input to create a new annotation set. Otherwise press the dropdown arrow to select from a list of existing annotation sets.

Press the "create task" button to finish creating the manual annotation task.

Create Manual Audit Task

1. Select type "Audit".
2. (optional) enter a summary. This will act as the name of the task.
3. (optional) enter a description of the task.
4. Add users that will be allowed to work on the task.
5. Select a source dataset. The images to label will be drawn from this dataset.
6. Select an annotation set. This is the set of annotations on the dataset that will be audited.
7. Select a destination annotation set or create a new one. The final audited/modified annotations created from the manual audit task will be added to this set. Enter a new name in the input to create a new annotation set. Otherwise press the dropdown arrow to select from a list of existing annotation sets.

Press the "create task" button to finish creating the manual audit task.

Task Job Board

The above image is an example of the task job board. Each task is first added as a card in the "Open" column. When at least one image has been labeled/audited, the card will automatically move to the right into the "In Progress" column. One all images have been labeled/audited the card will again automatically move to the right into the "Completed" column.

Manual Annotation Tool

There are 4 sections of controls in the Manual Annotation Tool.

1. Labels List

This section contains the list of labels added to the dataset. To add a labeled annotation to the image, you must first select a label from the label list. The cursor will change to the drawing tool when a label is selected.

Note: To change the label of the bounding box, simply click on the desired label in the labels list, next click on the bounding box in the image to change the label. 

2. Annotation List

This section contains the list of annotations that have been drawn on the image. You can click on one of the list items to select it on the image or press the delete button to remove it from the image.

Note: Alternatively, you can drag your mouse to highlight the bounding boxes in the image to select them. The DELETE key is a keyboard shortcut to also delete these annotations. 

3. Toolbar

There are several options on the tool bar.

• Switch to pointer tool - The pointer tool is the default functionality of the cursor. In pointer mode you can click on annotations drawn on the canvas to select them. You can also drag the cursor to select multiple annotations.
• Zoom to Fit - This option will zoom the image within the canvas and reposition the image to fully fit the screen. Alternatively, pressing the SPACEBAR on the keyboard will perform the same action.
• Zoom to Extents - When an annotation is selected, this option will be available. This option will zoom the image within the canvas and reposition the image so that the selected annotation fully fits the screen. Alternatively, using the mouse scroll will result in the same response of zooming in/out.
• Undo - Reverts the last change to the annotations.
• Revert All Changes - Reverts all changes to the annotations.
• Enable Auto Segment Tool - When using the auto segment tool, heavy processing needs to be done when the image loads before segments can be drawn. When this option is disabled, the heavy processing will not be performed.
• Show Image Info - Displays information about the image.
• Submit - Press submit to finalize the created annotations and move on to the next image.

4. Task History