Edit

FAQ

Business Processes

How do I kick off a Business Process to run regularly?

You can schedule a Business Process (BP) to run at specific intervals using Scheduled Campaigns.

For that, upload an input CSV file and a CCF configuration file to an external server (S3, FTP, or SFTP) and trigger a Manual Task or BP to run at specific intervals.

Can I set up a BP to loop through tasks?

It is not recommended to do so. Instead, set Scheduled Campaigns to kick off the BP at regular intervals and Data Stores to use updated data in every run.

I want to review process results manually. Can I make the review step part of a BP?

Yes. For that, add a Moderation Step to a BP.

How do I view the BP results?

Proceed in one of the following ways:

• Go to Business Processes > View All, find the BP and the BP run where you want to view the results, and click the Generate snapshot button. For details, read the View all Business Processes topic.
• Go to Business Processes > View All > select a BP > go to the Results tab, and click Final results. For details, refer to the View results topic.

Manual Tasks

How to limit the number of tasks per worker?

For instance, in Manual Task > Run > Advanced Options > Availability, the Limit Number of Tasks parameter was set to 20 for a Run, but some workers managed to complete more than 20 tasks. The Adjudication Rule is 3 + 0.

To address the situation, follow the steps:

1. Go to Task Advanced Options > Adjudication.
2. Set the Min # of Assignments from 3 to 1. This means one worker is allowed to work on one task at a time. Once the task is completed, it is returned to the queue for another worker to complete it. Then, the same cycle is repeated until the third worker completes the task.

Explanation:

The above steps are essential because if Min # of Assignments is set to > 1, an Assignment is not considered completed for a worker until the minimum value is reached and the calculation begins.

In this example, the settings are as follows:

• Adjudication = 3+0
• Min # of Assignments = 3
• Limit Number of Tasks = 20

As a result, a worker submits 20 tasks and can continue doing so until two more workers come and do the same 20 that the first one did, and those tasks are completed. And some workers manage to submit more than 20 tasks until that happens.

Qualifications

What should I do to improve the quality of the MT result data?

When the quality of the Manual Task (MT) result data is low, or the Time Line and Effort values are high, or there are too many Records with the Confidence not found status, make sure you use only qualified workers:

• When creating a Manual Task, use the System Qualifications and Availability settings.
• Create and assign a custom Qualification manually or by creating a Qualification Task.

Why do I get the error: "Qualification Task requires one and only one custom accuracy-based Qualification in requirements list?"

When you create a Qualification Task, it requires one Accuracy Based Qualification. For a Qualification Task, workers are assigned a score for the particular Accuracy Based Qualification.

To eliminate the error, go to Advanced Options > Qualification, and remove all other Accuracy Based Qualifications from the requirement list.

How to assign Qualifications to workers?

To assign Qualifications to workers manually, proceed in one of the following ways:

• Go to Workers > Assign Qualification.
• Navigate to Workers > View All Workers > click Assign Qualification.
• Select Manual Tasks > View All and choose a completed MT. Then, go to Results > Workers > click Assign Qualification.

For details, see the Create and Assign Qualifications to Workers topic.

How to educate workers and improve their skills?

You can create a Training Task as described below:

1. Create a Qualification Task.
2. On the Run tab for the task, click Advanced Options.
3. Go to Qualification and select the Enable Training Mode checkbox.

In this case, explanation messages are shown to workers after they submit Training Tasks.

Mind that the Gold Data file should include a column with the explanation messages. For details, read the Create Qualification Task with Line Item Task article.

What is an Accuracy Based Qualification?

Accuracy Based Qualifications are used to score workers based on their performance against the Gold Data in a Qualification Task or even in a production run. For details, read the Create Qualification Task article.

What is a private Qualification?

Private Qualifications are for internal use, meaning you can assign those to workers for your own reference only. They are not reflected at the Crowd level. For more information, refer to the Create Private Qualification Task article.

How much Gold Data do I need?

The recommendation is to have at least three times the number of tasks you want workers to take for a Qualification Task.

User experience

What do I do when I cannot see some MTs, BPs, or Records?

• Check your filter settings and click the Show button in the top right corner.
• Somebody might have deleted MTs or BPs. Contact your system administrator for activity logs.

Why do I get the message: "Warning! The use case you have selected requires the following column names in the uploaded file?"

To eliminate the issue, go to the Upload Data tab and map the column headers in the input file to the column headers the MT or BP requires. Alternatively, upload another input data file with correct column headers.

How do I resolve the issue when I cannot see some characters in my input or output file?

The platform allows maintaining the character encoding, but sometimes opening a file in Excel can strip the encoding. The recommendation is to work via Open Office and open files using the UTF-8 encoding.

Workforces and Crowds

How do I create a Crowd?

To create a Crowd and Workforce, refer to the Manage Workforces and Crowds article.

How do I create a Crowd for internal employees or SMEs?

You can assign a Qualification to the internal workers specifically and attach the Qualification to a Crowd.

How do multiple Crowds work?

You can add Crowds to Workforces while creating them. The platform distributes tasks between Crowds according to the priority given to each Crowd.

Workers

How to communicate with workers?

Proceed in one of the following ways:

• Using the Dashboard > Worker Feedback widget, you can see new messages and reply to workers.
• Go to Workers > View All Workers, select the workers you want to send the message to, and click Send Message.
• Go to Worker Profile > Communication Center, review the messaging history, and send messages.
• Go to Manual Tasks > View All, select a Manual Task from the list. Then, navigate to Results > Workers, select the worker you want to send the message to, click Send Message.

How do I tell workers about a change in Instructions?

You can either accomplish this via a message as described above or add an Instruction in the Task Designer on the fly. For details, read the Title, Instructions, and FAQs topic.

How to reject work?

While a Manual Task is still running, go to Results > Workers, select workers, and click the Reject Answers button.

As an alternative, use the Moderation flow.