Validate a document package

This article explains how to access and validate the AI-generated analysis for each document in the Document Analyzer.

You'll learn how to review the details of individual documents, and approve or correct the AI's classification, extracted data, and rule evaluation, ensuring the analysis meets your standards before submission.

Validate the AI analysis of each document class

Validation requires a co-pilot user to approve or correct different aspects of the AI analysis. There are three aspects of the AI analysis that require validation for each document class:

• Classification - Type of document, for example: pay slip, utility bill, or bank statement. Every analysis package has defined documents types on which the AI model was trained.  

• Extracted data - Individual data points extracted and identified by the AI model. Each data point is assigned to a Lightico Attribute.

• Rules - Business rules defined in the analysis package. Extracted data is marked as pass or fail based on whether it meets the requirements.

To validate the AI analysis of a document class:

1. On the document package overview page, click a document class.
    
   
   The selected classification opens.

2. Validate each of the following aspects of the analysis:

   • Classification

   • Extracted data

   • Rules

Classification

The AI model analyzes each page of an uploaded PDF file and decides to what class each page belongs. It then groups all pages of the same class and presents them as one document class in the Document Analyzer UI.

Validating the classification

To review and validate a document classification:

1. On the document package overview page, click a classification.
   

   
   The classification opens.

2. Complete the classification validation by doing the following in the right pane:

   • If the classification is correct for this page, click the thumbs up.

   • To change the classification for this page, see below.

   • If there are multiple pages of this document,  make sure to either approve or change the classification for all pages.

   • To approve the classification for all pages, click Confirm all pages.
     

Change the page classification

If the AI classification is incorrect, you can manually assign a different classification. Some available classifications may not have been trained on the AI model, but using them improves accuracy and can help to train the model for future use.

Note

If you reclassify a page that included extracted data, you will need to resubmit the package for AI analysis. See below.

To change the page classification:

1. Click the thumbs down.
   

   The Select classification dialog opens.

2. Select a new classification and click Save.

   Tip

   Classifications that have been trained on the AI model show an icon, as illustrated below.

   

• If the page does not fit into any of the classifications, click Mark as unclassified.

  The page is moved to the Unclassified documents list.
  

• To restore the original classification assigned by the AI model, click the thumbs up.

Validating unclassified documents

The package may contain documents that the AI model could not associate with any of the known document types in this package.

To validate an unclassified document:

1. Click the document to open it.
   

2. Click the thumbs down and select a document type
   -OR-
   submit the package with the unclassified status.

Reanalyzing the package

When you reclassify a page from which data was extracted, all extracted data and rule decisions are removed from all pages in the original class. This is because extraction and rules are based on the class of the pages. In this case you need to resubmit the package for AI analysis.

On the package overview page, a status of Analysis required shows for classes that need reanalysis.

To reanalyze the package:

1. Click Reanalyze in the top right corner of the package overview page.
   

2. Confirm the action.
   

   
   The package is sent for AI analysis.

Extracted data

The reviewer is required to approve or reject each piece of extracted data before submitting the document for review.

To validate extracted data:

1. Select a piece of data.
   The data is highlighted in the document view.
   

2. Review each piece of data and either:

   Click the thumbs down to reject and correct the extracted information (see below)
   -OR_

   click the thumbs up to approve the information.  
   

Correcting extracted information

If you see that a piece of data was extracted incorrectly, you can reject it and change it to the correct information.

Note

When you correct extracted data, rules are recalculated. A Pass status for a rule may change to Fail and vice versa.

To correct extracted information:

1. Click the thumbs down icon.
   
    

2. Enter the correct version of the data in the box and click Done.
   
      

   The information is recorded in this document as you corrected it and it is marked as Edited.
   

Rules

Use the Rules tab to verify whether the extracted data met the defined analysis requirements. You may want to review the reason for a failure or confirm that a pass status is accurate.

Even if a document fails one or more rules, it can still be validated and submitted. The final analysis report will indicate that the document did not comply with specific rules.

Viewing rule results

• Click the Rules tab in the right pane.

• If the document status is Fail, the pane will display the reason for the failure.

Overriding a rule decision

In some cases, a rule may be met, but Document Analyzer fails to recognize it correctly. To ensure accuracy, you can override the decision when necessary. For example, the AI might not identify a close name match, such as Bill vs. William or Bob vs. Robert, or it may fail to recognize an abbreviation, like Mn St instead of Main Street.

To override a rule decision:

1. In the Rules panel, next to the Fail status, click the options menu and select Switch to Pass.
   
   

2. Confirm the change.
   

   
   The status is changed to Pass with an indication next to it that the status was manually edited.
   
   

   To change the status to Fail:    

       Click the options menu and select Switch to Fail.
      

Q & A