Validate a document package

This article explains how to access and validate the AI-generated analysis for each document in the Document Analyzer.

You'll learn how to review the details of individual documents, and approve or correct the AI's classification, extracted data, and rule evaluation, ensuring the analysis meets your standards before submission.


Validate the AI analysis of each document

Validation requires a co-pilot user to approve or correct different aspects of the AI analysis. There are three aspects of the AI analysis that require validation for each document:

  • Classification - Type of document, for example: pay slip, utility bill, or bank statement. Every analysis package has defined documents types on which the AI model was trained.  

  • Extracted data - Individual data points extracted and identified by the AI model. Each data point is assigned to a Lightico Attribute.

  • Rules - Business rules defined in the analysis package. Extracted data is marked as pass or fail based on whether it meets the requirements.

To validate the AI analysis of a document:

  1. Select a document in the document table.


    The document page opens.

  2. Validate each of the following aspects of the analysis:

Document Classification

At the top of the right pane is the classification given to this document by the AI model and a confidence score.

  • If the classification is correct, click the thumbs up.

  • If there are multiple pages of this document, do this for all the pages.

Change the document classification

If the AI classification is incorrect, you can manually assign a different classification. Some available classifications may not have been trained on the AI model, but using them improves accuracy and can help to train the model for future use.

Note

Each analysis rule is associated with a specific document classification. Changing the classification will remove all extracted data and rules currently shown for this document.

To change the document classification:

  1. Click the thumbs down.
    The Select classification dialog opens.

  2. Select a new classification and click Save.

    Tip

    Classifications that have been trained on the AI model show an icon, as illustrated below.

  3. If the document does not fit into any of the classifications, click Mark as unclassified.
    The document is moved to the Unclassified documents list.

To restore the original classification assigned by the AI model, click the thumbs up.

Validating unclassified documents

The package may contain documents that the AI model could not associate with any of the known document types in this package. The

To validate an unclassified document:

  1. Click the document to open it.

  2. Click the thumbs down and select a document type
    -OR-
    submit the document as unclassified.

Extracted data

The reviewer is required to approve or reject each piece of extracted data in a document before submitting the document for review.

To validate extracted data:

  1. Select a piece of data.
    The data is highlighted in the document view.

  2. Review each piece of data and either:

    Click the thumbs down to reject and correct the extracted information (see below)
    -OR_

    click the thumbs up to approve the information.  

Correcting extracted information

If you see that a piece of data was extracted incorrectly, you can reject it and change it to the correct information.

Note

When you correct extracted data, rules are recalculated. A Pass status for a rule may change to Fail and vice versa.

To correct extracted information:

  1. Click the thumbs down icon.

  2. Enter the correct version of the data in the box and click Done.

    The information is recorded in this document as you corrected it and it is marked as Edited.

Rules

Use the Rules tab to verify whether the extracted data met the defined analysis requirements. You may want to review the reason for a failure or confirm that a pass status is accurate.

Even if a document fails one or more rules, it can still be validated and submitted. The final analysis report will indicate that the document did not comply with specific rules.

Viewing rule results

  • Click the Rules tab in the right pane.

  • If the document status is Fail, the pane will display the reason for the failure.

Overriding a rule decision

In some cases, a rule may be met, but Document Analyzer fails to recognize it correctly. To ensure accuracy, you can override the decision when necessary. For example, the AI might not identify a close name match, such as Bill vs. William or Bob vs. Robert, or it may fail to recognize an abbreviation, like Mn St instead of Main Street.

To override a rule decision:

  1. In the Rules panel, next to the Fail status, click the options menu and select Switch to Pass

  2. Confirm the change.


    The status is changed to Pass with an indication next to it that the status was manually edited.

    To change the status to Fail:

        Click the options menu and select Switch to Fail.