Innotescus provides many different ways to view a task. Whether it's simply a task's details like the consensus size or whether users can add new classes to the task, or the annotation distributions of a completed task, Innotescus provides full visibility into every task a user creates.
To view a task's annotations, navigate to the dataset of interest via the project's or task's datasets tab and click on any piece of data. The image viewer will present the task's annotations for that piece of data. View annotation and image metadata, as well as a complete history of annotations on that image using the different panels on the right side of the image viewer.
Use the available controls to zoom, pan, edit in the canvas, or download the annotations. View the history of image annotations using the history icon on the right hand panel.
Viewing Annotation Analytics
To view annotation metrics, select one or more tasks you’d like to analyze and click on an available icon; note that, aside from class distribution, task analytics are displayed for a single class at a time, which can be selected in the dropdown above the legend. Toggle between views and add or remove tasks from the analysis by selecting and deselecting tasks and hitting the refresh icon. Use the available icons to print, download, or view the graphics in fullscreen mode.
Just like dataset analytics, users are able to view the color distributions of each annotated class within a task. Using a histogram, scatter plot, or candlestick plot, users can see the color distributions, calculated using the individual color channels of the annotated areas of each image.
View class distributions as a pie chart or histogram on the class tab of the task analytics.
Spatial distributions can be presented as a heat map of each class, showing the aggregate positions and orientations of each annotation belonging to that class, or as a histogram of annotation sizes as a raw value (number of pixels), or as a percentage of the image it's in.
The activity chart shows project supervisors a history of all members' contributions to the selected task(s) measured by time spent annotating or the number of submissions per day. Click the download link to save a screenshot of the member activity or the underlying values as a .csv. Each line of the exported .csv file has the values shown below:
task name, date, annotator, num submissions, annotation time (seconds)
Dive allows users to customize their view of a task using any available metric or any custom metadata that has been entered for the selected class. To view image metadata using dive, use the dataset analytics within the task's 'datasets' tab. Use the bin or scatter selections and conditionally color each datapoint to view your data along up to five dimensions at once!
Viewing Task Details
To view a task's details page, click on the name of that task. The task details page allows supervisors to view and edit classes, instructions, and the datasets that task has been assigned to. The task details page also includes a high level overview of the task's datasets and annotations on the right panel.