Edit

Retrain IE Cognitive Bot ML model

Triggers for AutoML to start ML model training

• A manual task is completed.
• The Min docs limit is reached. The limit depends on the ML Model selected and is about 20 documents, i.e., if Workers submit 20 tasks in WorkSpace, the model training will start.
• The Min delta limit is reached (the number of new documents to retrain the model). Once Delta is reached (a training set is updated with the required number of documents), retraining starts automatically.
• Force training (the Evaluate Automation action with ignoring of limitations).

Run manual task

When you have set up a manual task and automation options, run this task to launch the model training process.

1. On the Run tab, press Run This Task.
2. In a popup, press View Results.

Now, you have two options:

• If you have selected an existing training set on the previous step, stop the task by selecting Actions > Stop Task.

• Otherwise, if you have a new training set, submit all Documents as a Worker in the WorkSpace application.

As a result, the task is completed, and the ML model training starts.

Create training set

After Workers process tasks in WorkSpace, all processed documents supplement a training set for the model. Manually processed documents are placed to an automatically created training set in the following cases:

• A model was trained on the task/instance other than model execution had been initiated on. Once a Worker processes at least one document and the task status is Completed, a training set is created automatically with processed documents.
• A model was trained on the task, and the training set used for model training was added manually, with model execution initiated for the same task. Once a Worker processes at least one document and the task status is Completed, a training set is created automatically with processed documents.
• A task is created by copying a task from one of two previous cases without changing the task name.

The automatically created training set has the same name as the manual task definition name with the following changes:

• uppercase is changed to lowercase
• special characters are removed
• spaces are substituted with underscores

To view the retraining status, go to the View All Tasks page.

• When the Automation training starts, you will see the Automation Evaluation label next to your manual task.

  

• When the Automation training completes, you will see the Automation Available label next to your manual task.

  

To find the automatically created training set, go to Configure AutoML > Train new model. The following example shows an automatically created automation training set.

Retrain model

An ML model is constantly improving the quality and continues training on all answers provided on the manual steps (when the machine fails to extract information or during the AutoQC sub-process).

When a new retrained model provides better results than the original one, you will see the Cognitive Bot Ready label on the View All Tasks page.

To automate your manual task with improved quality, do as follows.

1. Go to View Results > Automation. You will see a new Automation chart with better parameters (for example, increased Automation rate for the same Minimal acceptable accuracy).

2. Pick a dot on the chart or select the Accuracy Threshold.

   

   • Accuracy Threshold – the minimum accuracy required from the automatically extracted data. The parameter determines the quality of output data and is calculated by ML model algorithms after comparing it with gold data patterns.
   • Automation Rate – the percent of Records that can be extracted automatically with the given Minimal acceptable accuracy; percent of manual tasks replaced by automation.

3. (Optional) Enable or disable ML model switching by selecting Switch models automatically.

4. Press Apply Recommendation.

5. The automation business process creation wizard opens. Configure and rerun the AutoML business process.