Server Fault Stack Exchange
Server Fault Stack Exchange

Questions tagged [data-integrity]

46 questions
3
votes
5 answers

Is there any value in checking MD5 of files after they have been unzipped?

A project I am working on currently requires that the user runs an MD5 hash checking tool on the entire project, after it has been unzipped. They do not currently request that the ZIP itself is checked. If they were to switch to checking the MD5 of…
Craig Mason
  • 133
  • 1
  • 6
3
votes
3 answers

Is checking data integrity with hashes useful for my scenario?

I have a NAS as production system (mostly video footage and project files) and a 1:1 backup. I only need to retrieve the backup data in cases of emergency. Such a case didn't occur yet. Lately I'm concerned that the data on the backup might can get…
Martin
  • 31
  • 2
2
votes
1 answer

How do you store VMs on HDDs with data integrity AND performance?

First off I know this topic easily gets subjective, but I'm trying to avoid that, as there should be at least 1 good answer to this in a sea of bad answers and it's hard to find. At first sight my question seems simple; How do you store Virtual…
Alex
  • 389
  • 9
  • 23
2
votes
2 answers

Single file changed: intrusion or corruption?

rkhunter reported a single file change on a virtual server (netstat binary). It didn't report any other warning. The change was not the result of a package upgrade (I reinstalled it and the checksum is back as it was before). I'm wondering whether…
Michaël Witrant
  • 358
  • 3
  • 6
2
votes
1 answer

DB2 Integrity Checks and Exception Tables

I am working on planning a migration of a DB2 8.1 database from a horrible IBM encoding to UTF-8 to support further languages etc. I am encountering an issue that I am stuck on. A few notes on this migration: We are using db2move to export and load…
imthefirestartr
  • 53
  • 2
  • 7
2
votes
2 answers

What happens to InnoDB and MyISAM tables if the power fails during a transaction?

We have two MySQL tables, one is InnoDB and the other is MyISAM. If I execute a chunk of inserts in a single transaction on both tables and the power fails in the middle, what will be the status? What will happen to the newly inserted data on the…
Ash
  • 21
  • 3
1
vote
4 answers

How to verify integrity of a remote file transfer

Is there any way I can verify the integrity of a remotely transferred file? I am currently transferring a large amount of files and folders from an ftp server to another remote server using wget, but I have no way of knowing if the files are…
Rafael
1
vote
1 answer

Where do I find the verified checksums for all files in all packages for Ubuntu?

I am looking to verify whether or not my binaries, installed by the Aptitude package manager under Ubuntu 16.04.2 LTS, are either in-tact or have been modified / compromised. I cannot find any list of file checksums for each file from each package -…
Brendan
  • 73
  • 1
  • 8
1
vote
2 answers

Do I need btrfs scrub if a lower layer also scrubs?

I have a multi-TB btrfs made up of virtual disk images that live on NetApp NFS filers. The data are redundant at the NetApp level, so the btrfs is RAID-0. In addition to providing redundancy, the NetApps do their own scrubbing for data…
Reid
  • 302
  • 3
  • 14
1
vote
2 answers

restore mongoDB databases from manual backup (not used mongodump): strange permission problems

Is it possible to restore databases which were manually copied from /var/lib/mongodb to eg. /home/foo/mongobackup ? I am not sure if the backup was made after stopping the mongod service. Either way, no files were written to the database when doing…
nylki
  • 203
  • 2
  • 9
1
vote
0 answers

Verify rdiff backup integrity

I am using rdiff for my differential backup. Recently an issue happened where all versions of my backup failed to patch correctly and rdiff returning an error 106 which after investigation is a code for a corrupt delta. Now I am pretty sure that the…
Zaid Amir
  • 179
  • 6
1
vote
3 answers

Best practices for backing up Windows workstations to Linux server?

I was wondering what strategies others in the community use when backing up their Windows-based workstations to Linux servers. At the moment I'm doing a bit of a test with Ubuntu Server LTS 10.04 and I'm trying to do regular backups from…
toolshed
  • 237
  • 4
  • 15
1
vote
0 answers

Archival storage tool: fast, queryable, has api, reliable

I have large quantities of structured data coming in over the network from disparate sources, and that data is archived in the filesystem, parsed/analyzed, and eventually makes it's way into a database (mysql) to be accessed by a few apps. The data…
mikewaters
  • 1,175
  • 1
  • 14
  • 27
1
vote
2 answers

Ext4 metadata checksums: current feature status

The kernel wiki page for ext4 metadata checksums is marked "last modified on 22 October 2013". I couldn't find more recent status information on this feature, except for this question from 2019, which suggests to disable it and the related 64bit…
MichaelK
  • 123
  • 5
1
vote
2 answers

How to test Snapraid data corruption?

I'm running Snapraid on my hard drives. However, I want to test it's data integrity features, to see how/if they actually work. But I don't really understand how to 'corrupt' my data. I can just manually change the contents of my files. However,…
RazorHail
  • 165
  • 1
  • 9
1
2
3 4