- Accumulate documents processed by Manual Review Operators and use them to train a skill.
- Switch between different Classification and Document skills rather than between skill versions.
Select a document accumulation strategy for Online learning
Pick a strategy based on your objectives and development stage. A strategy combines the following two settings:
The following table lists the settings for each development phase.
Early skill development
Grow the document set by collecting every document the skill processes, not just ones with uncertain fields or rule errors. Multiple users can review in parallel to add many labeled documents quickly. You may still need to adjust the skill before training, so keep automatic training disabled.Automatic fine-tuning of a skill with normal performance
Collect documents that had issues and were corrected during manual review, and let automatic training run. New models are tested before they replace the old model and are discarded if they underperform. As a result, automatic training won’t reduce skill accuracy.Late development
For a well-adjusted skill with an extensive document set, collect only documents that had issues. The skill already performs well, so avoid retraining it automatically. Review the collected documents manually instead.Set up document accumulation
1
Set the Online learning mode
Open the Classification or Document skill in Vantage. In the skill settings, make sure that the Online learning mode matches the selected strategy.The Online learning mode is available only in the skill settings in Vantage.
2
Publish the skill
Publishing makes the changes available to other users.
3
Create and set up the Process skill
Create a Process skill that contains:
- A Classify or Extract activity that references the skill you want to train. To accumulate the skill’s documents, select the Collect documents and learn check box under Online Learning in the activity’s Actions pane.
- A Manual Review activity whose Review Documents mode matches the selected strategy.
4
Configure input and output (optional)
Configure an additional input source, a destination for the result files, or both. For more information, see Input activity and Output activity.
5
Publish the Process skill
The Process skill receives a version number and becomes available for testing and production. The referenced Classification or Document skill processes documents, and they are accumulated according to the configured strategy.Users access the Process skill via API or connectors, or through a shared folder or email if you configured one in the previous step.
Edit a skill after documents have been accumulated
1
Open the skill you collected documents for
Vantage creates a new draft version. The Process skill continues to reference the published version, so editing the draft does not affect users.
From this point on, all collected documents are added to the document set of the published version. They are not added to the draft you just created.
2
Adjust and train the skill
Review the collected documents, make any necessary adjustments, and then train the skill.
3
Publish the new skill version
Vantage creates a new published version with an incremented number. The Process skill still references the previous version of the Classification or Document skill, because Vantage does not update the reference automatically.
4
Update the Process skill reference
- In the Skill Catalog, click the up arrow next to the Process skill version number.
- In the dialog box that opens, select the latest version of the referenced skill.
- Click Save.
5
Publish the Process skill
The reference is updated, and users of the Process skill now get the new version of the referenced skill.
Roll back or switch strategies
Delete the latest Process skill version
If you aren’t satisfied with the new version’s performance, delete the latest Process skill version.1
Open the Skill Versions dialog box
In the Skill Catalog, click the Process skill version number.
2
Delete the latest version
Click the Delete icon next to the latest version. Vantage switches users to the previous Process skill version, which references the previous version of your Classification or Document skill.
Keep the Process skill changes but reference an older skill version
If the latest Process skill version has changes you want to keep, create a new Process skill version that references an older Classification or Document skill version.1
Open the Process skill settings
Open the Process skill, and then click the Skill settings icon to the right of the skill name. The Process Skill Settings dialog box opens.
2
Select a referenced skill version
In the Referenced Skills section, select any available version of the skill from its Version list, and then click Save.The selected version must use the same Technology Core version as the Process skill. The Version list shows the Technology Core version next to each skill version.
3
Publish the Process skill
Vantage switches users to the new Process skill version. It references the version you selected, which is not necessarily the previous one.