FAQ
Business Processes (BPs)
How do I kick off a Business Process to run regularly?
Click to learn more
You can schedule a Business Process to run at a specific interval using Scheduled Campaigns.
You should upload an input CSV file and a configuration CCF file on an external server (S3, FTP or SFTP) and trigger the Task or BP run at specific time.
Can I set up a Business Process to loop through tasks?
Click to learn more
We recommend not doing so.
Instead you can use Scheduled Campaigns to kick off the BP at regular intervals and use Data Stores to use updated data in every run.
I want to review the results of my process manually. Can I make the review step a part of my Business Process?
Click to learn more
You can add a Moderation Step to your Business process to do so.
How do I view results of my Business Process?
Click to learn more
You can use one of the following actions:
- Go to View All BPs, generate and download a Snapshot.
- Go to BP > View Results > Data and select Final results from the drop-down menu.
Tasks
In Task Advanced Options > Availability, the Limit Number of Tasks parameter was set to 20 for a Run but some Workers managed to complete more than 20 Tasks. Adjudication Rule is 3 + 0
Click to learn more
Solution:
- Go to Task's Advanced Options > Adjudication.
- Set the Min # of Assignments from
3to1. This means one Worker can work on one task at one time. Once it is completed, it is returned to the queue for another Worker to complete it, and then again until the third worker completes it.
Explanation:
You need to do this because if Min # of Assignments is set higher (> 1), an Assignment would not be considered completed for a worker until the minimal point is reached and calculation begins.
In this example:
- Adjudication = "3+0"
- Min # of Assignments = "3"
- Limit Number of Tasks = "20"
As a result, Worker submitted 20 Tasks and he can continue doing those until 2 more Workers come and do the same 20 that he did and those Tasks are completed. And some workers apparently manage to submit more than 20 Tasks until that happens.
Qualifications
The Task result data quality is low, or Task Time Line and Effort is high, or too many Records with the Confidence not found status
Click to learn more
You should use only qualified Workers:
When creating a Task, use the System Qualifications and Availability settings.
OR
Create your Custom Qualification and assign the Qualification manually or by creating a Qualification Task.
Why do I get the error Qualification Task requires one and only one custom accuracy-based Qualification in requirements list?
Click to learn more
When you create a Qualification Task, it requires one Accuracy Based Qualification. For a Qualification Task, Workers are assigned a score for that particular Accuracy Based Qualification.
In Advanced Options > the Qualification popup, remove all other Accuracy Based Qualifications from the requirements list.
How to assign Qualification to Workers?
Click to learn more
You can manually assign Qualifications to Workers in the following places:
- Workers > Assign Qualification
- Workers > View All Workers
- Task/BP Results > Workers
How to educate Workers and improve their skills?
Click to learn more
You can create a Training Task. Create a Qualification Task with the Enable Training Mode checked in Advanced Options > Qualification.
Workers are provided explanation messages after they submit Training Tasks. The Gold Data file should include a column with explanation messages.
What is an Accuracy Based Qualification?
Click to learn more
Accuracy Based Qualifications are used to score Workers based on their performance against Gold Data (in a Qualification Task or even in a production run).
What is a private Qualification?
Click to learn more
Private Qualifications are for internal use. They help you give private Qualifications for your own reference to Workers. They are not reflected at the Crowd.
How much Gold Data do I need?
Click to learn more
We recommend having at least three times the number of Tasks you want Workers to take for the Qualification Task.
User interface and user experience
I cannot see some Tasks, BPs, or Records?
Click to learn more
- Check your filter settings. You can click the Show button in the top right corner.
- Somebody might have deleted Tasks or BPs. Contact your system administrator for activity logs.
Why do I get the message "Warning! The use case you have selected requires the following column names in the uploaded file"?
Click to learn more
You should map column headers of your input file in the Upload Data tab to the column header the Task or BP requires or upload another input data file with correct column headers.
I cannot see some characters in my input or output file.
Click to learn more
SPA maintains character encoding, but sometimes opening the file in Excel can strip the encoding. We recommend using Open Office and open the file using UTF-8 encoding.
Workforces and Crowds
How do I create a Crowd for my internal employees or SMEs?
Click to learn more
You can give your internal Workers a Qualification specifically for them and attach that Qualification to the Crowd.
How do multiple Crowds work?
Click to learn more
You can add Crowds to your Workforce while creating them. SPA will distribute Tasks between Crowds according to priority given to each Crowd.
Managing Workers
How to communicate with the Workers?
Click to learn more
- Dashboard > Worker Feedback widget. You can see new messages and reply to Workers.
- Workers > View All Workers. Check the Worker(s) you want to send the message to and click on Send Message.
- Worker Profile > Communication Center. You can see all the messaging history and send messages.
- Task Results > Workers. Check the Worker(s) you want to send the message to and click on Send Message.
How do I tell Workers about a change in Instructions?
Click to learn more
You can either do this via a message or actually "Add an Instruction" in the Task Design on the fly.
How to reject work?
Click to learn more
While the Task is still running you can go to View Results > Workers, select the Worker(s) and click the Reject Answers button.
As an alternative, you can use the Moderation Flow.