Stack Overflow
Stack Overflow

Questions tagged [monstache]

Monstache is a sync daemon written in Go that continuously indexes your MongoDB collections into Elasticsearch. Use this tag only when your question is specific to the Monstache tool. For example when your Monstache setup doesn't work as expected. If there is a connection problem on mongo or elasticsearch make sure you can connect via other tools first.

19 questions
4
votes
0 answers

docker-compose, mongodb, single node replica set

I'm trying to configure a mongodb single node replica set using docker compose for connecting with elasticsearch using monstache in development. Using the documentation docs. I have the following docker compose file: mongo: image: mongo …
tamis
  • 125
  • 5
4
votes
0 answers

Slow elasticsearch indexing with mongodb and monstache

I'm trying to integrate elasticsearch to my mongodb with monstache. Monstache, elasticsearch and kibana are working on my local machine. Mongodb is remote. All things seems running but indexing is so slow, hardly indexing single document in 2…
Erdel
  • 370
  • 3
  • 16
4
votes
2 answers

Unable to connect to mongodb using URL using monstache

I've been trying to synchronize my mongodb with elastic for two days and I'm going crazy. After many attempts and changes in my dockerfile and in my docker-compose I get this error, but the container with mongodb is up and running. monstache …
Koltharius
  • 83
  • 1
  • 10
1
vote
2 answers

MongoDB Atlas : Resume of change stream was not possible, as the resume point may no longer be in the oplog

I'm trying to use a mongo client called monstache to read and synchronise data between mongodb and elasticsearch. But when I run monstache it fails showing the below error continuously : Jan 26 01:04:59 ip-172-31-1-200.eu-west-3.compute.internal…
nixmind
  • 2,060
  • 6
  • 32
  • 54
1
vote
0 answers

Unable to connect to MongoDB using URL mongodb://localhost:27017 using docker and monstache

So I have 1 docker container named elastic which has 2 images, one for elastic search and one for kibana. This is the yml file that creates them version: '3.1' services: elasticsearch: container_name: els image:…
Resident Zero9999
  • 85
  • 6
1
vote
0 answers

Real time data sync between azure cosmos db( with mongo api) and elastic search

In our stack there is both Azure Cosmos DB(with Mongo Api) as well as Elastic search with similar indices. The cosmos DB gets updated frequently with some apis running in the backend. This update also needs to get reflected in elastic search which…
Amar
  • 11
  • 1
1
vote
1 answer

monstache resends all of the mongodb collection data on re-install

I am using monstech version 6 by running a docker container. It syncs data to elastic search as per my requirement but when i re-install it ( docker stop, docker rm, and then docker run) , it re-syncs the entire data again. I am using…
Amit Meena
  • 2,884
  • 2
  • 21
  • 33
0
votes
0 answers

Monstache Configuration in Kubernetes Cluster

I'm currently moving an application into a Kubernetes Cluster. Monstache is giving me headaches over and over. I have one StatefulSet for MongoDB and one Deployment for ElasticSearch and Monstache. For Mongo I have configured a Headless service and…
baeni
  • 3
  • 2
0
votes
0 answers

Mongo data is not synced to Elasticsearch unless monstache is restarted

`I am using Monstache 6.7.11, Elasticsearch 7.17 and Mongodb 4.0 version. Unable to sync Mongodb data into elasticsearch untill we restarted monstache. Below is my monstache.toml file mongo-url = "mongodb://localhost:27017" elasticsearch-urls =…
Dnyansudha Bhirud
  • 1
0
votes
1 answer

Monstache not initiating the first synchronisation of current data from MongoDB and keeps waiting for events on the change stream

It's my first time to use monstache. In fact I've migrated my infrastructure from on premise to the cloud and I'm now using mongoDB Atlas, and AWS opensearch. I've installed monstache on an aws ec2 instance and well configured it. Everything seems…
nixmind
  • 2,060
  • 6
  • 32
  • 54
0
votes
0 answers

How to configure Monstache to use "not_analyzed" index so I can do an exact match?

I realised by default, I cannot match things with special characters like application/json as the analyzer tokenizes it. I want to do something like suggested here…
Jiew Meng
  • 84,767
  • 185
  • 495
  • 805
0
votes
0 answers

Monstache: How do I sync new fields in MongoDB into ElasticSearch?

I notice that when new fields are added into Mongo, ElasticSearch is not updated with these fields, how do I sync them over? I am using Monstache to sync data into ElasticSearch. It appears it does not automatically detect new changes to…
Jiew Meng
  • 84,767
  • 185
  • 495
  • 805
0
votes
1 answer

Confirming Elastic search ERP data modeling / indexing

I wanted to confirm the approach that I am implementing to model my ERP database into Elastic search. That means I am indexing my source ERP data to the destination Elastic search. The source ERP database has some main entities like products,…
htaseer
  • 1
0
votes
1 answer

bulk processor "monstache" was unable to perform work: elastic: Error 400 (Bad Request): Validation Failed: 1: type is missing;

I am trying to integrate mongoDB and elasticsearch using monstache but I am facing this error. Please help me solve it out. I will response with all the output you want. config.toml file mongo-url =…
Prince
  • 21
  • 2
0
votes
1 answer

Can I use Monstache with ingest node?

I am looking for options to sync and enrich documents from MongoDB to Elasticsearch. I found Monstache that can do the sync part. I also found Elasticsearch Ingest Node that can modify the documents before indexing into Elasticsearch. Can I use…
JOHN
  • 1,411
  • 3
  • 21
  • 41
1
2