Kafka Connect failed to add MySqlConnector

Question

I need someone's help.

I follow a tutorial Streaming Data from MySQL into Kafka with Kafka Connect and Debezium but I have the trouble connecting MySql to Kafka server using Debezium MySQL Connector.

Here is my setup and other information.

OS : Windows 10.

Kafka Connect : Confluent 5.0.

MySQL Connector : 0.8.1 Final.

I keep files

here .

I add the plugins path

When I tried connecting to Kafka Connect, It returned me an error. "Failed to find any class that implements Connector and which name matches io.debezium.connector.mysql.MySqlConnector"

Error 1

Error 2

Am I missing something? Anyone can help?

If you have added the connector while kafka-connect was already up and running then you either need to load the connector manually, or restart kafka-connect — Giorgos Myrianthous, Aug 14 '18 at 07:43
@GiorgosMyrianthous I already restart kafka Connect server but the result still the same. — W.Phromma, Aug 14 '18 at 07:45
You need to put the jar file under `plugins.path` which is defined in kafka-connect properties which usually points to `/usr/share/java` — Giorgos Myrianthous, Aug 14 '18 at 07:48
@GiorgosMyrianthous I have put all the plugin folders in the custom path and i already add the path in the kafka-connect properties file according to Picture 1 and Picture 2. — W.Phromma, Aug 14 '18 at 08:01
@GiorgosMyrianthous Works like a charm. Thank you. Btw, what is the reason why we have to add those Jar files in that folder despite we have pointed the plugin path already? — W.Phromma, Aug 14 '18 at 08:12

score 2 · Accepted Answer · answered Aug 14 '18 at 08:19

2

Make sure that you've placed the .jar connector file under plugins.path which is defined in kafka-connect properties and usually maps to /usr/share/java.

After adding the connector under the correct directory you need to either load the connector or restart kafka-connect so that it is automatically loaded in start-up.

answered Aug 14 '18 at 08:19

Giorgos Myrianthous

36,235
20
134
156

As the Picture 1 I set the plugin.path which map to 2 directories but why It does not map to those path? – W.Phromma Aug 14 '18 at 08:25
Why do you want to put that jar file in another directory? – Giorgos Myrianthous Aug 14 '18 at 09:33
Since I read the documentation about add plugins. I understand that we can use the customized directory then we have to add the customized path in the properties file. If I am wrong, please correct me. – W.Phromma Aug 14 '18 at 09:36
Same doubt about placing jar in another directory . @W.Phromma you got some idea ?And which jar we should copy ? – Divyanshu Jimmy Sep 03 '18 at 07:32

score 0 · Answer 2 · answered Aug 21 '18 at 11:36

0

your plugin path is wrong (confluent-5.0.0\share\java) either it should start with / (which means root of current drive) or you should give complete path.

This is the reason connector jar is not present in classpath

answered Aug 21 '18 at 11:36

Manjeet Duhan

117
2

Kafka Connect failed to add MySqlConnector

2 Answers2

Linked