Troubleshoot AutoML model import issues

The execution mechanism for Work.AI is Bot Execution Platform (BEP), including for uploading models or moving them from environment to environment. Model artifacts and trained models are still stored in S3, but all meta information is maintained in the AutoML Model Management Service (AMMS).

Artifacts, or Workers (othwerwise, known as hyper models, or pipelines), are stored in Nexus, and AMMS uploads them there during import. The Worker Management Service (WMS) is responsible for launching Workers and downloading Workers from Nexus.

Symptoms

A Machine Learning Engineer creates or trains a model version and imports it to the environment but fails to see any changes in the model behavior during execution.

Reason: An old Worker (artifact) is used.

Resolution

In S3, artifacts are stored by code or version. In Nexus, artifacts are deployed by GAV (group, artifact, version from pom.xml).

The code and version are the attributes of the @ModelDescription annotation in the model class, while GAV is formed based on the information from pom.xml.

Model class example:

...
@ModelDescription(
        code = "wfc-invoice-processing",
        version = "2.8",
        ...
)
@WorkflowComposer(MultipleModelIeSe20Composer.class)
@HypermodelConfiguration(InvoiceProcessingModelConfiguration.class)
public class InvoiceProcessingModel extends IeGenericSe20Hypermodel {
...

Partial pom.xml example:

 ...
    <groupId>com.workfusion</groupId>
    <artifactId>invoice-data-entry-ml-sdk</artifactId>
    <version>0.2.3</version>
    <packaging>jar</packaging>
...

The resulting model description looks like this:

It is recommended to increment the model version when something is changed, such as a post processor is added, a configuration is updated, and so on. For that, do as follows:

1. Increment the version attribute in the @ModelDescription annotation in the associated hyper model class.
2. Increment the artifact version in the pom.xml file.

If you do not change the version in the pom.xml file (update GAV for the new model version), the WMS downloads a new Worker JAR only when all old Workers are stopped.