Questions tagged [fscrawler]

For everything related to FSCrawler project.

40 questions
0
votes
1 answer

Fatal error received while running the crawler

I want to index binary files (PDF, WORD, TEXT) into elasticsearch, I have used fscrawler for that and I'm getting the following error while running the fscrawler. I have followed this link :…
0
votes
1 answer

Touch command in fscrawler

I am using FScrawler to index my documents. I want to know how to use touch command whenever I add new documents to the folder. or will it be automatically indexed?
0
votes
1 answer

fscrawler container is unhealthy (exit code 126)

I am receiving the following two errors when starting fscrawler from Docker shadiakiki1986/fscrawler: ERROR: for fscrawler Container "XXX" is unhealthy. ERROR: Encountered errors while bringing up the project. The unhealthy container was…
user2514157
  • 545
  • 6
  • 24
0
votes
2 answers

Update Mapping of existing Index in Elasticsearch

I am totally new to elastic search. So please forgive me if this is a stupid Question and my Questions might have been answered somewhere else already but I couldn't find it. I want to use Elastic Search as a search engine for PDF'S and docx's in…
nu11ahnung
  • 15
  • 1
  • 7
0
votes
1 answer

using FSCrawler to create index in Elasticsearch

I have FSCrawler working on a DEV box where the documents are located on the same server as FSCrawler and ElasticSearch. in the _settings.json file I just set the url to be my document location in the form "D:\MyDocs" Now I'm moving elasticsearch…
bilpor
  • 3,467
  • 6
  • 32
  • 77
0
votes
1 answer

fscrawler gives three javascript errors

I'm new to Elasticsearch and have been trying to use the ingest plugin (I have posted a couple of questions about that). It has been suggested that for what I am trying to do I should be using Fscrawler. I'm using Elasticsearch 5.5.1 and I've…
bilpor
  • 3,467
  • 6
  • 32
  • 77
0
votes
1 answer

ElasticSearch file mapping using fscrawler and searching doc by NEST in C#

i indexed documents that are in a folder "/tmp/es" using fscrawler 2.3-SNAPSHOT. It mapped them as : { "properties" : { "attachment" : { "type" : "binary", "doc_values": false }, "attributes" : { "properties" : { …
0
votes
1 answer

Merging data from different sources at index time

I have two file crawler jobs running separately on data which are related to each other using fscrawler(https://github.com/dadoonet/fscrawler). Now I want to in some way merge the data together when indexing(child-parent relation or flat document is…
frods
  • 311
  • 1
  • 3
  • 10
-1
votes
2 answers

in Fscrawler is it possible to derive index name from subfolder name?

I have a folder with several hundred sub folders and would like to index by these sub folder names...That is after running fscrawler I would like to have several hundred different indices...The default is one index (e.g."job_name") for all the sub…
ScottyCov
  • 21
  • 5
-1
votes
1 answer

Can't find the docker-compose.yml file

The documentation states: And, prepare the following docker-compose.yml. You will find this example in the contrib/docker-compose-example-elasticsearch project directory. Where do I find this???
ScottCov
  • 29
  • 4
1 2
3