Questions tagged [eland]

11 questions
2
votes
1 answer

How to search exact index (not index pattern) in elasticsearch eland - updated?

I am calling elasticsearch data using eland. The documentation is simple and I am able to implement it, but when searching the index it searches the index string using es_index_pattern which is basically a wildcard (it is also stated in the…
everestial007
  • 6,665
  • 7
  • 32
  • 72
1
vote
1 answer

How to search exact index (not index pattern) in elasticsearch eland?

I am calling elasticsearch data using eland. The documentation is simple and I am able to implement it, but when searching the index it search using es_index_pattern which is basically a wildcard index-string. from elasticsearch import…
everestial007
  • 6,665
  • 7
  • 32
  • 72
0
votes
0 answers

Elasticsearch eland pandas client time difference between two fields in same document

I have a data pipeline that through its stages adds timestamps to the message. So a document might have: { logTime: "2023-07-05 10:10:23.617241", ingestTime: "2023-07-05 10:13:14.995735", @timestamp: "2023-07-05 10:13:16.937238", …
maehue
  • 505
  • 10
  • 26
0
votes
1 answer

Connection timeout when connecting to Elasticsearch using eland

I'm trying to connect to my 3-node Elasticsearch (version 8.3.3) cluster remotely, using the eland library. I'm trying out with just one of the nodes first. This node has the following configuration in elasticsearch.yml. network.host:…
Rayne
  • 14,247
  • 16
  • 42
  • 59
0
votes
0 answers

Deploying spacy model to Elastic using eland

I'm trying to ingest a spacy model (scispacy abbreviations detector to be specific), but I'm struggling with the deployment. I have deployed many models using eland but spacy models do not contain the config.json file and eland complains about…
llermaly
  • 2,331
  • 2
  • 16
  • 29
0
votes
0 answers

Load Eland dataframe partially by query (ElasticSearch, Python)

I'm trying to fetch data from ElasticSearch into an Eland dataframe partially, because it takes too much time to load the entire index. The following works, except for the _query_compiler. The official Eland docs contains the parameter, but no…
Chiel
  • 662
  • 1
  • 7
  • 30
0
votes
0 answers

How to download only desired entry rows from Eland (Elasticsearch python+pandas client)?

Currently, if I want to create a dataframe with specific entries from an index, using Eland, I must first download a dataframe with all the entries, and then filter them out, locally... this is hardly desirable in terms of CPU and RAM local usage.…
An old man in the sea.
  • 1,169
  • 1
  • 13
  • 30
0
votes
0 answers

How do I use eland to upload a CSV containing dense vectors to Elasticsearch?

I want to use approximate KNN search in Elasticsearch. This requires some fields to have a dense vector mapping type with additional parameters. I would like to use eland to upload CSVs of my data, including the embeddings. For example, I have the…
W.P. McNeill
  • 16,336
  • 12
  • 75
  • 111
0
votes
1 answer

Eland - TypeError: count() got an unexpected keyword argument 'query'

I'm trying to get my ES index as a dataframe using the Eland API in Python. However, i'm getting a typerror. es = Elasticsearch(hosts=["http://1.1.1.1:9100"], send_get_body_as='POST', http_auth=('es-automation', …
Shivam Anand
  • 15
  • 1
  • 2
0
votes
1 answer

Retrieving DataStream list in Elasticsearch using python API

In Kibana dev tools, When I am using the API call GET /_data_stream/ I am getting the list of DataStream. In similar way I want to retrieve it using the Elasticsearch Python API, I am not able to find the way. Can anyone please help me?
0
votes
1 answer

Getting error for basic Eland example (loading index from a locally installed ELK docker container)

We installed ELK in docker based on this example. Like: docker run -d --name elasticsearchdb --net es-stack-network -p 9200:9200 -p 9300:9300 -e "discovery.type=single-node" elasticsearch:6.8.13 docker run -d --name kibana-es-ui --net…
J.Todd
  • 707
  • 1
  • 12
  • 34