Stack Overflow
Stack Overflow

Questions tagged [mysqlbinlog]

mysqlbinlog is a MySQL Utility for Processing Binary Log Files

mysqlbinlog is a MySQL Utility for Processing Binary Log Files

The server's binary log consists of files containing “events” that describe modifications to database contents. The server writes these files in binary format. To display their contents in text format, use the mysqlbinlog utility

Docs: https://dev.mysql.com/doc/refman/5.7/en/mysqlbinlog.html

MariaDB Docs: https://mariadb.com/kb/en/library/using-mysqlbinlog/

134 questions
3
votes
0 answers

How to fix out-of-order sequence number with existing GTID error

I am attaching a database to a master and after a while, I get the following error when I run show slave status, I get the following error: An attempt was made to binlog GTID 1-XXX-XXXXXXXXX which would create an out-of-order sequence number with…
Finlay Weber
  • 2,989
  • 3
  • 17
  • 37
3
votes
1 answer

What is the exact meaning of the parameter database.history on Debezium?

We are working on a project using Debezium to Stream data from a Database reading the binlog to a message broker. Working on it a bit deeper, and trying to understand better the tool, two questions related the configuration parameters came up: What…
Miguel
  • 1,361
  • 1
  • 13
  • 24
3
votes
1 answer

Abnormally high MySQL writes and larger than normal Binary Log files. How can I determine what caused this?

We have a MySQL master database which replicates to a MySQL slave. We were experiencing issues where MySQL was showing a high number of writes (but not an increased number of queries being ran) for a short period of time (a few hours). We are…
billvsd
  • 254
  • 2
  • 12
2
votes
0 answers

Debezium misssing some events

During the process of data discrepancy, I realised some events are missed and not written to kafka during CDC. These are the steps I did: 1- Setup two different debezium connector each fetch data from similar mysql table and write to two different…
ArefehTam
  • 367
  • 1
  • 6
  • 20
2
votes
1 answer

MySQL BinLog deleted in Linux

What I did to cause the error: I deleted the bin log files manually in linux server because I ran out of space Issue: Unable to start MySql Command: service mysql status mysql.service - MySQL Community Server Loaded: loaded…
Ravi Jaganathan
  • 141
  • 1
  • 6
2
votes
1 answer

Mysql data recovery using mysqlbinlog

I accidentally dropped a schema without backing it up. And now I want to use mysqlbinlog utility to perform recovery. (It seems that mysqlbinlog is a good tool). And it needs those binary log files to perform recovery. Now I have the following…
xiaohan2012
  • 9,870
  • 23
  • 67
  • 101
2
votes
0 answers

Duplicate messages in kafka when using debezium

I read internals of debezium, but it also can send duplicate messages to kafka, if there is some failure at connector just before updating offset in bin log. In that case, consumer needs to be idempotent. Is there any way we can avoid duplicate…
Rajat Goyal
  • 465
  • 1
  • 5
  • 20
2
votes
1 answer

Enable BinLogs on read-replica with binlog_format="row"

I recently enabled binlogs on my read-replica by enabling automatic backups(As mentioned here). However the default binlog_format was set to MIXED. binlog_format=MIXED Because of this inconsistency the Debezium connector fails since it finds…
user7171758
  • 292
  • 3
  • 10
2
votes
0 answers

mysql-binlog-connector-java - Could not find first log file name in binary log index file

I am doing a POC on this library, and I am having some difficulties setting it up. I have an extremly simple MySQL setup: - a single VM (no master-slaves) - centos 7 - MySQL version 5.7 Here is the code I have until now: public static void…
SockworkOrange
  • 355
  • 4
  • 14
2
votes
1 answer

listen mysql change event using zongji module not working

I am trying to listen mysql change event in my app using mysql-event module. For that I got to know that, i need to make sure if zongji module works fine. So here is what I have tried so far: --my server.js var ZongJi =…
undefined
  • 3,464
  • 11
  • 48
  • 90
2
votes
1 answer

how to enable mysql bin log

OS: Mac OS X Hi Sierra(10.13.1) MySQL: 5.7.20 (install by homebrew) I want to enable bin log, so I should edit my.cnf file, I typed below command to find my.cnf file mysql --verbose --help | grep my.cnf and result /etc/my.cnf /etc/mysql/my.cnf…
perfectacle
  • 59
  • 2
  • 9
2
votes
1 answer

Why mysqlbinlog utility displays two values instead of one?

I am trying investigate something in binlog by mysqlbinlog utility. When I add verbose parameter -vv I see INSERT query with this part @2=-27170 (38366) /* SHORTINT meta=0 nullable=0 is_null=0 */ Does any one know why are there two numbers? What…
howkey
  • 21
  • 3
2
votes
1 answer

Do row-level binlog entries get recorded in MySQL when a non-null column with a default gets added

I wanted to verify the following behavior I noticed with MySQL row-based replication in case there was just something peculiar with our setup or configuration. With row-based replication turned on, and given the following table named pets: | id | …
foxygen
  • 1,368
  • 1
  • 11
  • 22
2
votes
2 answers

Replication via Kafka vs. mysql events

I have a need to maintain a copy of an external database (including some additional derived data). With the same set of hardware, which one of the following solutions would give me faster consistency (low lag) with high availability? Assume updates…
ahuman
  • 25
  • 5
2
votes
0 answers

MySQL replication broken as binlog not in chronological order

Looking at an excerpt from the binary log, it can be seen that these 2 statements are written to the log out of order chronologically: #160628 17:32:46 server id 2220 end_log_pos 64812204 Query thread_id=157061 exec_time=0 …
alison_feik
  • 33
  • 3
1
2
3
…
8 9