I have to fetch approximately 2000 files using Pentaho Spoon but I am only getting 175 files. Is there any way to fetch all the files?
Asked
Active
Viewed 30 times
0
-
I do not know of a file size limit in fetch files. Please check your file names and regular expression. Do this for each `Get SFPT entry`, starting by the ones which filed (with a red crossed circle). – AlainD Aug 22 '17 at 09:47
-
The problem is not with the file names nor the regular expressions. And I am doing this with "Get files with SFTP". If I were only have 10 files, then it works fine. I discovered that the problem is when there are a lot of files and the job is not able to fetch every file. – Allen BMC Aug 22 '17 at 11:38
-
Are you trying to fetch 2.000 files at once? How many parallel connections does your client, does the server allow? – marabu Aug 27 '17 at 19:47
-
No, Only one connection. I am selecting an entire folder. – Allen BMC Sep 06 '17 at 13:29