1

Is it possible to import a zipped csv file directly into Talend Open Studio for Big Data 6.3.0.2, if not would there be any work arounds?

Muhammad Faizan Uddin
  • 1,339
  • 12
  • 29
Jess
  • 97
  • 1
  • 2
  • 12

1 Answers1

1

Yes, but in two steps.

Step 1. In the file management section of the components is a tFileUnarchive component. You can use this by first placing a tFileList component and connecting it to the tFileUnarchive with the iterate connector.

Step 2. The unzipped files will be moved to an output directory you specify. You can then use another tFileList to read those files in, within the same job.

If you find Talend moves quicker than the unzipping process or files are locked you can put in a tSleep and wait a few seconds or minutes. I use the tSleep in cases where we need a pause in processing to allow system resources to catch up with the job.

Kromster
  • 7,181
  • 7
  • 63
  • 111
E LaRoche
  • 1,106
  • 1
  • 7
  • 8
  • Yes this works perfectly, thank you E LaRoche! I had a bit of trouble because my files were initially .7z but once I converted to .zip it worked fine – Jess Dec 14 '16 at 13:57
  • glad it worked. That interesting about 7-zip though, because we tested compression with 7-zip, winzip, and native windows zip, and they all worked. perhaps its the version of Talend or 7-zip. We are on Talend 6.2.1 and 7-zip 16.04. – E LaRoche Dec 14 '16 at 18:13
  • I used 7-zip to compress the file, just had to compress it as a .zip. I am using Talend v6.3.0 and 7-Zip 16.04 – Jess Dec 15 '16 at 10:11