Edit

Start Task and Business Process from Data Source

Data Source is a mechanism providing input data and configuration for your BPs and Tasks. This input format is best suited for those Use Cases where the data resides on an external source such as SFTP Server or Amazon S3 Cloud.

To start a Task/BP from a Data Source you need to have:

1. UUID of existing Task/BP (Definition UUID) - Business Processes List > Open definition in new tab, switch to the opened tab and click Definition UUID to copy UUID to the clipboard
2. Input Data file (.csv) - uploaded to external server
3. Configuration file (.ccf) - uploaded to external server
4. Data Source - WorkFusion object containing external server credentials and path to the configuration file
5. Schedule - number of occurrences per each Data Source update

Create configuration file

The campaign configuration file (CCF) contains all task or BP parameters needed to start a new run.

This file contains parameter=value pairs on each new line. Download an example.

Parameter	Value	Description
ACTIVE	TRUE	default parameter
DATAFILE	input_file.csv	relative path to the input data .csv file (server folder with .ccf file is a root) for s3 - it's full path inside your bucket
DATAFILE_SIZE	-1	default parameter
FILE_SEPARATOR	COMMA; PIPE; SEMICOLON; TAB	separator that has been used in input file
ENV	DEVELOPMENT; PRODUCTION	environment
BLOCK_SIZE	1	block size
TASK_DISPLAY_PRIORITY	MAX; NORMAL; MIN	task priority (tasks with the max priority will be displayed first if task type is the same)
CAMPAIGN_UUID	79eea42a-127e-4613-83a2-7fbe80ba0a38	create a Task/BP (Campaign) in WorkFusion and copy campaign uuid (or copy uuid of the existing Campaign)
GOLD_RUN	false; true	indicates if the run is gold
USE_GOLD_BUCKET	false; true	indicates if gold bucket should be used
tags	datasource, test,	list of tags
SNAPSHOT_TYPE	XLSX; CSV	format for the snapshot
OUTPUT_DIR	results/	relative path for storing the Task/BP snapshot (server folder with .ccf file is a root)
STREAM_TYPE	Immediately; PermanentOpenTask	Immediately - all hits will be created on endpoint; PermanentOpenTask - specific quantity will be displayed; if value not specified - immediately by default
STREAM_VALUE	10	works if STREAM_TYPE=PermanentOpenTask; default value - 10
STREAM_THRESHOLD	1 (if absolute value); 25% (if percentage)	100% by default if value not specified

Upload files to server

Upload input file (CSV) and configuration file (CCF) to an external server (FTPS, S3, SFTP).

Remember to check the file and folder READ and WRITE permissions on the external server.

Create Data Source

To start managing Data Sources, go to Configuration > Campaign Data Sources in the main menu.

On this page, you can create, copy, edit, and delete Data Sources. To create a new Data Source:

1. Click the Create Data Source button.

2. Enter the appropriate Name and Description for your Data Source.
3. WorkFusion will automatically generate a UUID for the new Data Source. You can use this UUID in API calls or Schedules.
4. Select a Type from the dropdown:

• S3 (Amazon's Cloud Server)
• FTPS (File Transfer Protocol + SSL encryption)
• SFTP (Secure File Transfer Protocol based on SSH)

5. Enter the Configuration Parameters, which depend on the connection type:

• S3

• accessKey – Access Key ID

• secretKey – Secret Access Key

• bucket – destination bucket in S3

• keyPrefix – remote folder Note: keyPrefix should have the slash symbol "/" at the end

• SFTP

• host– host name to establish connection over SFTP protocol

• • port – port number to connect to on the SFTP server

• login – SFTP Server account user name

• password – SFTP Server account password

• remote_folder – a directory on the SFTP server to start the session

• private_key – key stored on your local machine to enable authentication without password

• public_key – key stored on the SFTP server to enable authentication without password

• FTPS

• host – host name to establish connection over FTPS protocol* *

• port – port number to connect to on the FTPS server

• login – FTPS Server account user name

• password – FTPS Server account password

• remote_folder – a directory on the FTPS server to start the session

6. Click the Save button.

Create schedule

1. Go to Campaigns > Schedules.
2. Select your Campaign.
3. Select the Data Source you've created.

After the Schedule has been created, the specified Task or BP will start automatically. WorkFusion will poll this Data Source for any input files at a specified interval (every 10 minutes) and if a file is present it will be run.

View result

To verify that your Task/BP has started, log in to the external server and open the folder with the CCF file.

Verify that the {name}.ccf.uploaded file has been created.

When a Task or BP is completed:

• The {name}.ccf.donefile appears.

• The result file is created in the appropriate folder (the OUTPUT_DIR parameter of the CCF file).

• If a Bot Task hasn't started, check that Bot config for this step doesn't contain Source value with Availability options.

• To reuse an existing Data Source:

1. Delete the .ccf.uploaded and .ccf.done files from the external server folder.
2. Update the input CSV and CCF files if needed.