Stack Overflow
Stack Overflow

Questions tagged [mongo-connector]

15 questions
2
votes
2 answers

Connect to mongodb via ssh tunnel failing

I have tried to connect to my mongodb on a server i own via an ssh tunnel via the following apps but nothing will connect: compass robomongo nosqlbooster4mongo phpstorm inbuilt mongodb java connector Server and mongo: Server: ubuntu 18lts Mongo:…
user1037355
1
vote
0 answers

Support authentication and TLS options in mongo kafka sink connector

I am using offical mongo kafka sink connector jar.I have added mongo-kafka-connect-1.7.0-all.jar in strimzi connect cluster plugins path. I don't see any option for authentication and TLS mentioned in the documentation to secure mongo…
Khumar
  • 316
  • 3
  • 22
1
vote
0 answers

sync mongo collections to elastic search using mongo-connector

I want to sync mongo collections to elastic search using mongo-connector. created the replica-set and trying to sync the data. getting few issues. below versions used so far. mongo 4.4 elastic search 7.15 Followed the below blog for…
BASAVARAJU
  • 11
  • 3
1
vote
2 answers

Bulk Insertion in Py2neo

Im writing a custom doc manager for mongo-connector to replicate mongodb documents to neo4j. Here I would like to create bulk relationships. Im using py2neo2020.0. It seems there are some options in previous versions but not in this version. Is…
Selvakumar Ponnusamy
  • 5,363
  • 7
  • 40
  • 78
0
votes
0 answers

mongodb-kafka-base-mongod fails when mongo have ssl enabled

I followed the documentation (Quick start) docker compose file and everything went fine. Tried to add ssl to mongo instance using this tutorial: generate-mongo-ssl.md then went to ssl part and followed the steps I updated my docker-compose to have…
Ed .d
  • 23
  • 1
  • 3
0
votes
0 answers

Converting pyspark column to ObjectId for mongo spark connector v10.x

I've seen this question but it is not working for me. I think the version of my tools is the problem. Here is a sample code from pyspark.sql import SparkSession from pyspark.sql.functions import struct # Create a SparkSession spark =…
Dhruv
  • 117
  • 11
0
votes
1 answer

Empty schema error when I try to post a new Avro schema to Kafka schema-registry

I am using Confluent Platform for a MongoDB Sink Connector and I need to define an Avro schema in the Schema Registry so that data would be written in a structured manner to MongoDB Collection. I have saved the following schema in a .avsc file: { …
Guy_g23
  • 316
  • 2
  • 7
0
votes
0 answers

Syncing postgres instances with mongo db in a Django project

Please i am working on a Django project that uses postgres as it primary database. Now I have been tasked with syncing the postgres instances with mongo db but I don’t know how to go about it. I cant find any real resources out there. The idea is…
Damilola Sotomi
  • 11
  • 1
0
votes
1 answer

Mongodb Spark SQL ConfigException - Missing configuration for: database

I am using mongo spark connector 10.1.1 (spark v2.13) and am attempting to read a collection's contents into a dataset for processing. The spark session is configured as below: //Build Spark session SparkSession spark = SparkSession.builder() …
nick_j_white
  • 534
  • 6
  • 27
0
votes
0 answers

Not able to fetch specific time period MongoDB data using MongoDB source connector

I have configured MongoDB source connector and sending data to Apache kafka topic and data is coming fine in real time. Now I have requirement to fetch specific time period data from MongoDB and push that data to kafka topic but query is not working…
Prashant Kumar
  • 1
0
votes
0 answers

MongoSinkConnector: how to write data having same schema as the source

I am trying to synchronous data from the MongoDBSourceConnector and write to the destination MongoDBSinkConnector. The problem is when written data has the schema as the topic message in the Kafka, not the same schema as the source…
Pakorn K
  • 111
  • 1
  • 11
0
votes
2 answers

schemas.enable=false config not applied to connector

I am using mongokafka sink connector from kafka to mongo and connector jar is mongo-kafka-connect-1.7.0-all.jar.I have added mongodb-driver-core-4.5.0.jar also in plugins path of connect cluster. I am using strimzi kafka and connect. In kafka I…
Khumar
  • 316
  • 3
  • 22
0
votes
0 answers

Integrating Solr 8.9.0 and MongoDB 5.0 Community Edition

I'm running Solr 8.9.0 and Java 14.0.1 on Linux, and I'm trying to integrate Solr and MongoDB 5.0 Community Edition. I have MongoDB running and loaded with data, and I've installed the mongo-connector. I'm really struggling with what to do next. All…
Muhammad
  • 1
0
votes
1 answer

Missing documents while connecting Mongodb and elasticsearch via mongo-connector

I am trying to transfer documents from MongoDB 4.4.5 to Elasticsearch7.12 via mongo-connector 3.1.1 I start by using: sudo mongo-connector -m 127.0.0.1:27017 -t 127.0.0.1:9200 -d elastic2_doc_manager -n Data.myData --continue-on-error…
Noa
  • 315
  • 1
  • 7
  • 31
0
votes
1 answer

ClientError 404, cannot connect mongodb to neo4j

Rather than going into painful process of bringing everything into neo4j, we I resorted to easier solution. As configuration is not my expertise https://medium.com/neo4j/transform-mongodb-collections-automagically-into-graphs-9ea085d6e3ef I followed…
lpt
  • 931
  • 16
  • 35