Questions tagged [journaling]
66 questions
3
votes
1 answer
Clarification regarding journal_size_limit in SQLite
If I set journal_size_limit = 67110000 (64 MiB) will I be able to:
work with / commit transactions over that value (somewhat unlikely)
be able to successfully perform a VACUUM (even if the database has like 3 GiB or more)
The VACUUM command works…
Alix Axel
- 151,645
- 95
- 393
- 500
2
votes
2 answers
No deleted entries in journal receivers?
We have all Future 3 files journaled, but when I do a DSPJRN command OUTFILFMT(*TYPE3) I have no delete (DL) entries. I have only one record in the physical file, but many add (PT) and update (UP) entries for that one record. How is that possible?…
CRogers
- 41
- 2
2
votes
1 answer
Can the data=journal mode of EXT4 avoid user data loss?
journal mode
data=journal mode provides full data and metadata journaling. All new
data is written to the journal first, and then to its final location.
In the event of a crash, the journal can be replayed, bringing both
data and metadata into a…
benqwu
- 21
- 3
2
votes
1 answer
How to know which address space a buffer head is mapped to?
In the jbd2 source code, any modification in the File System is mapped into a handle_t structure (per process) that later is used to map the buffer_head to the transaction_t which this handle is going to be part of.
As far as I could understand,…
campescassiano
- 809
- 5
- 18
2
votes
1 answer
MongoDB journaling enabled?
I want to find out if MongoDB journaling is enabled with a bash script.
Can I do that some other way than searching the config files, because that is not very reliable, I think.
Is mongo --eval "something" possible?
Jakob Kenda
- 368
- 1
- 3
- 12
2
votes
2 answers
Possible to implement journaling with a single fsync per commit?
Let's say you're building a journaling/write-ahead-logging storage system. Can you simply implement this by (for each transaction) appending the data (with write(2)), appending a commit marker, and then fsync-ing?
The scenario to consider is if you…
Yang
- 16,037
- 15
- 100
- 142
2
votes
1 answer
Will a transport agent execute before journaling occurs exchange 2013?
I am currently working on proof of concept for a new system, but it is based on a transport agent executing before journaling takes place.
My question is: Will a transport agent that adds text to the subject of all messages occur before the…
Jake Stimpson
- 303
- 2
- 13
2
votes
2 answers
MySQL database hangs due to disk journaling?
Occasionally one of our Linux MySQL database servers will hang for a while, creating a long queue of active queries. After 10-20 mins, service resumes as normally.
This happens in kern.log:
May 14 13:58:05 edu02 kernel: [2375521.716786] INFO: task…
sune
- 61
- 2
- 6
2
votes
2 answers
Can I make a Grails web app using db2 jdbc driver not commit?
My situation: I work with a lot of RPG programmers who have created files on the IBM-i in a way that does not create a journal. I've created a Grails app which uses a db2 jdbc driver to connect to a file and update, insert, etc. I'm getting an…
Weezle
- 730
- 10
- 27
1
vote
2 answers
eMail archiving with Ruby
I'm looking for information on any libraries or methods that would help me to build an email archiving system using Ruby (I'm open to other languages if suggested).
The application would need to do the following:
1) Sit on a incoming mail…
doboyleltps
- 13
- 3
1
vote
0 answers
Ordered mode behavior in journaling file system
In the following article, it says "ordered mode is metadata journaling only but writes the data before journaling the metadata." Does this mean the data is physically written to disk before the metadata is written? From what I understand, data…
user2233706
- 6,148
- 5
- 44
- 86
1
vote
1 answer
How to recover a critical python job from system failure
Is there any python library that would provide a (generic) job state journaling and recovery functionality?
Here's my use case:
data received to start a job
job starts processing
job finishes processing
I then want to be able to restart a job back…
Garrett Motzner
- 3,021
- 1
- 13
- 30
1
vote
0 answers
can we replay jdb2 transactions after a corrupted transaction
I am trying to understand the behaviour of jbd2 journaling when one of the many transactions that are written to the journal gets corrupted.
As per my understanding, for a write operation, first a write is done to persist data to the on-disk…
Shehbaz Jaffer
- 1,944
- 8
- 23
- 30
1
vote
1 answer
Windows MongoDB Journal very large
I'm using a MongoDB Server v3.6 on my Windows machine with the following configuration file:
systemLog:
destination: file
path: "C:/data/log/mongodb.log"
logAppend: true
storage:
engine: wiredTiger
dbPath: "C:/data/db"
net:
port: 27017
…
FalcoGer
- 2,278
- 1
- 12
- 34
1
vote
1 answer
ReplaceOneAsync() immediately after InsertOneAsync() not always working, even when journaled
On a single-instance MongoDB server, even with the write concern on the client set to journaled, one in every couple of thousand documents isn't replacable immediately after inserting.
I was under the impression that once journaled, documents are…
CodeCaster
- 147,647
- 23
- 218
- 272