Work with Active Learning Disabled Review Passes

Set Up Active Learning Disabled Review Passes

Notes:

  • In addition, we recommend that you see Manage Review Passes for a general understanding of the Review Pass process.

  • Active Learning disabled review passes still run Active Learning “in the background”, but it is transparent to reviewers. At some point in the review, the setting could be Active Learning enabled to start prioritizing predicted positive documents within the review pass, and that would change the document order for reviewers.

  • If you prefer to turn off the Active Learning functionality running “in the background” on Active Learning disabled review passes, the functionality can be turned off across the environment through SQL. For more information, please contact IPRO Support.

Set Up the Review Pass

  1. Make sure that you have performed the steps in “Create an Active Learning Disabled Review Pass” in Create Review Passes and Batches

  2. Open the respective case. In the left pane, click the Review Pass Management button . Click the Active Learning disabled review pass you created in Create Review Passes and Batches.

    The Review Pass Details screen appears.


  3. In the top right corner of the Review Pass Details screen, click the edit icon . The Edit Review Pass Settings screen appears. This screen contains the settings that display in the Settings tab of the Review Pass Details screen.

  4. Update Review Pass Name, General settings, and Permissions settings.

  5. The following table describes the options you can edit on the Edit Review Pass Settings screen.

    SETTINGS

    DESCRIPTION

    General

    Active Learning

    Switch on - enabled

    Switch off - disabled

    Coding Form Coding form being used for the review pass

    Primary Review Purpose

    Allows converting to active learning review on the tag chosen.

    Recall

    The estimate of the percentage of positive documents in the entire case. The desired recall for the review pass can be configured from 70% to 90% in increments of 10%.

    Saved Search

    Saved search of records to be included in the review pass

    Batch Size

    The number of documents a reviewer will receive at a time

    Batch Prefix

    The prefix added before each

    Batch By

    Method for grouping documents within batches

    Batch Priority

    The priority set for each batch

    Family Field

    Ensures all documents with the same value in this field are kept together in batches

    Layout Style

    Determines whether the reviewer can see only the Document Viewer (Form View) or both the Document Viewer and the Grid (Grid View).

    Batching Order

    Sort documents by the content of up to three fields

    Permissions

    Group(s)

    Contains Groups assigned to the normal batches in the review pass

    Review QC Groups(s)

    Controls the QC batch permissions. Contains Groups assigned to the QC batches within the review pass.

    Note: Not selecting either of these group types allows access to both types of groups.

    If a Review QC Group is selected, users who are part of that group will always receive a QC Batch for the Review pass if one is available. If a QC Batch is not available and the user is part of the regular review group, they will receive a normal batch.

  6. Click . In the left pane, the disabled review pass listing displays with a icon in its top-right corner.

Settings Tab

On the Review Pass Details screen, you can view the values that you set by clicking the Settings tab. See the previous table for a description of these settings.

Note: If you want to change this review pass to Active Learning enabled, click . Then go to Work with Active Learning Enabled Review Passes.

Reports Tab

On the Reports tab is the Relevancy Scores bar graph, which shows the distribution of documents based on relevancy prediction. See the following example:

Hovering over a bar shows the Relevancy Index for that score:

When the Relevancy Range is set wide, say -30 to 30, then the Relevancy Index Range Details shows that the documents that fall into the range of being predicted as positive are the same or close to the entire set of review documents. The Relevancy Range can be adjusted as you desire. If you narrow the Relevancy Range, for example, to between 60 and 80, fewer documents will display within the Relevancy Range Details.

Clicking a link will trigger a Visual Search for that particular document set.

Overview Tab

The Overview tab can contain the following sections:

Sections

DESCRIPTION

Batch Information

Batch details for the review pass

Review Metrics

Breakdown of selected tags in checked-in documents.

Precision is the percent likelihood that you will hit a positive document as you continue reviewing. For example, if you review 100 documents and 90 of them are positive, then the Precision value is 90%.

Review Progress

Manually reviewed checked-in documents by date

Documents Manually Reviewed Listing of manually reviewed documents

In-app Information bubbles are available next to the Review Metrics for additional information.

Note that the Insights card now contains Prevalence and Responsive Documents values:

 

Related pages:

Create Review Passes and Batches

Manage Review Passes

Work with Active Learning Enabled Review Passes

Unlocking the Benefits of Active Learning.pdf