Zip to Files processor
High-level description
Zip to files processor is a part of the Intake framework that recursively extracts a zip archive to a flat structure of files. Inner zip archives and folders are also extracted recursively with no limitations. It does not need any configuration and can be used as shown below:
How it works
- All documents that need to be transformed have to be selected from the transaction. The required documents are filtered by the file extension (zip).
- After that, archives are extracted recursively. The name of a document consists of the path inside of the root archive with
_as a delimiter between folders and archives, for example,folder1_folder2_zipArchive.zip_folder1_perf.xlsx. - Resulting links to the extracted files are saved to the transaction instead of zip files. As a result, we have a transaction without zip archives and with allfiles from them.
Mind that:
- Documents that are not of zip extension will not be passed to the zip to files processor and will be kept as they are.
- If there are inner zip files, they will not be treated like documents and added to the transaction. Only files inside that archive will be added to the transaction.
- It does not support archives with passwords.
- If a zip archive is empty, a single empty document will be added to the transaction.
- If the transaction has multiple zip archives, each archive will be removed from the transaction and replaced with the files from this archive.
- Etraction is done in RAM only, so you have to keep in mind the size of your archive and compression level. Control Tower may run out of memory if you ask too much from it.
See the transaction example and the archive from the image above used in it.
Transaction before processing
{
"meta":{
},
"id":"b0e4b818-8e5b-4d24-bf1d-22232a0c208b",
"docs":[
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
}
]
}
Transaction after processing
{
"meta":{
},
"id":"b0e4b818-8e5b-4d24-bf1d-22232a0c208b",
"docs":[
{
"meta":{ },
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 2_zipArchive.zip_zipArchive_zipArchive_folderInZipArchive_file.zip_file.txt",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/a79afa31-6bc6-480c-8fe1-d7a15d02df53.txt",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 2_zipArchive.zip_zipArchive_zipArchive_folderInZipArchive_file.zip_zipArchive_zipArchive_traceZIP.txt",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/0491e207-ad0e-4d2d-b0b2-94ce85cf655d.txt",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_empty file 2.txt",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/83099935-73ac-4a8e-b705-bc5a6ec2a220.txt",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 2_trace.txt",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/97440391-c7a8-4291-8619-122a5da9742c.txt",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_emty file",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/ca1b36ae-e61e-41d9-b258-4e85d82fb238.",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 2_zipArchive.zip_zipArchive_zipArchive_folderInZipArchive_file.zip_folder in root of archive_pdf file.pdf",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/71050550-fd5c-435f-a348-30e030146887.pdf",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_excel file.xlsx",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/1e86c9ee-3321-4ead-ba26-c4614f2a9247.xlsx",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"file in root of archive.accdb",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/a5e5a1fa-59ea-4716-9a53-d5aa976ab0b6.accdb",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 1_New folder_New folder_tyukffk.pub",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/1319c876-3876-4162-a26c-a0c60f0b31b8.pub",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 2_New Rich Text Document.rtf",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/b661d173-7607-4894-ada1-c3babb9a0c96.rtf",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 2_zipArchive.zip_zipArchive_zipArchive_folderInZipArchive_file.zip_folder in root of archive_New Rich Text Document.rtf",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/e6a5f1d7-e4f0-4b9e-8fd3-a1a3ad59d9b2.rtf",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 1_New folder_New OpenDocument Drawing.odg",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/5dfe5d14-173b-4b1b-9704-8a303fb4852c.odg",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 1_aerbret.pdf",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/ee5c9ba0-b8a0-4f25-a039-cd728a590d09.pdf",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 2_perf.xlsx",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/ee13ec7c-7316-4e00-9936-66f07e7a0d65.xlsx",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 2_zipArchive.zip_zipArchive_zipArchive_folderInZipArchive_file.txt",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/0ed198fc-c798-45cf-9b05-4c64921aff8b.txt",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 2_zipArchive.zip_zipArchive_zipArchive_folderInZipArchive_file.zip_zipArchive_zipArchive_perfZIP.xlsx",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/81c337d9-b060-43e5-b1a1-1e3f8fda488f.xlsx",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_1e0900ca-a20c-41c6-80c7-9f62a0f48f98.pdf",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/03c98c79-e455-4dd4-bf67-ce9614c3765e.pdf",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 2_zipArchive.zip_zipArchive_zipArchive_folderInZipArchive_file.zip_zipArchive_zipArchive_fZIP.docx",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/a1ea2189-baf5-45dd-a7a0-8aaa0bd81b17.docx",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 2_zipArchive.zip_zipArchive_zipArchive_folderInZipArchive_file.zip_zipArchive_zipArchive_gggggggggggggggggggggggggggggggggZIP.rtf",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/51aa008b-6ad5-4116-9d77-069ab4bacb82.rtf",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
},
{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":"folder in root of archive_folder 2_zipArchive.zip_zipArchive_zipArchive_folderInZipArchive_file.zip_folder in root of archive_text file.txt",
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"https://wfinst-307-92-db1.workfusion.com/intake-bucket/zip_flatMap/d52e4c4a-aa15-45a4-92cb-77b5f1431dd6.txt",
"origin":{
"meta":{
},
"id":"c18e1f32-0d4a-4d0e-9063-f993c46eca8f",
"name":null,
"type":null,
"textLink":null,
"taggedTextLink":null,
"originalDocumentLink":"http://wfinst-307-92-db1.workfusion.com/intake-bucket/exampleForFlatMap.zip",
"origin":null,
"merged":false
},
"merged":false
}
]
}