0

is there any way to retrieve a file from a web server using FTP protocol without using "Get A FILE WITH FTP" JOB STEP. I can only use TRANSFORMATION in Pentaho. Any ideas.

Nikhil
  • 621
  • 1
  • 13
  • 25
Raymond
  • 103
  • 7
  • Already answered here: https://stackoverflow.com/questions/50547680/how-download-binary-files-with-pentaho/76009230#76009230 – mesompi Apr 13 '23 at 19:42

2 Answers2

1

You can use REST Client to do that in a transformation. I am doing the same thing in some of my transformations. You can GET the file content in the stream using REST Client and use a Text File Output to store the content in a file. File format will be your choice.

Nikhil
  • 621
  • 1
  • 13
  • 25
  • Can u elaborate a bit. i'm fairly new to pentaho – Raymond Oct 25 '16 at 08:48
  • Could you tell me how to do that?, i would appreciate it a lot – Raymond Oct 25 '16 at 08:55
  • Can u explain the underlying working of this process – Raymond Oct 25 '16 at 11:34
  • Here, is the file being retrieved over an FTP or an HTTP connection? – Raymond Oct 25 '16 at 11:57
  • Is FTP mandatory to you? REST is the way to use HTTP, and it can do the thing you want very easily. If you only want to use FTP, then you have to make the use of the job executor, which will call a job. – Nikhil Oct 25 '16 at 15:05
  • Also can u tell me how u are using this REST CLIENT to retrieve the file i.e., what all kinds of parameters u r putting in the REST CLIENT CONFIGURATION WINDOW so that it is retrieving the file to a TEXT FILE OUTPUT – Raymond Oct 26 '16 at 07:36
  • Use Add Constant Step and define you url in the value, then connect REST, and check "Accept url from field". HTTP method will be GET, select the appropriate "Application type" and type the result field name whatever you want (e.g. result). Now join the Text File Output and add the result field in this step. Run the transformation. – Nikhil Oct 26 '16 at 13:12
  • Can u specify the Format for the URL i.e., can u give me an example? – Raymond Oct 26 '16 at 14:29
  • Please elaborate about using the REST CLIENT. I'm still not being to retrieve the file. If u can please depict an example for my better understanding. – Raymond Oct 28 '16 at 07:40
0

Even if you can only use a transformation, a transformation can call a job using the "Job Executor" step. You can do the FTP in the job you are calling.

A note of caution - you've got to explicitly check the output of the Job Executor Step for errors.

Mark Christensen
  • 61
  • 4
  • Yeah that's a good idea too. But, he said he can't use job and job executor is going to call a job, even if it is inside a transformation. – Nikhil Oct 24 '16 at 20:30
  • Can u please explain how to do that? i'm fairly new to pentaho. – Raymond Oct 25 '16 at 11:58