Questions tagged [erasure-code]

Forward error correction (FEC) code for the binary erasure channel, which transforms a message of k symbols into a longer message (code word) with n symbols such that the original message can be recovered from a subset of the n symbols

In information theory, an erasure code is a forward error correction (FEC) code for the binary erasure channel, which transforms a message of k symbols into a longer message (code word) with n symbols such that the original message can be recovered from a subset of the n symbols. The fraction r = k/n is called the code rate, the fraction k’/k, where k’ denotes the number of symbols required for recovery, is called reception efficiency.

19 questions
0
votes
1 answer

Hadoop 3.0 erasure coding: impact on file read performance?

I am trying to understand the impact erasure coding could have on read performance of a file. Before that a brief summary of Hadoop 3.0 erasure coding using the Reed-Solomon method. If a file split into k blocks are encoded into p parity blocks,…
samshers
  • 1
  • 6
  • 37
  • 84
0
votes
1 answer

Erasure Encoding with little resource usage

Hey I'm pretty new to a lot of the erasure encoding concepts. I've mostly only read about Reed-solomon, but it does not fit what I need. I need to find a technique that can create parity shards on large data WITHOUT requiring heavy system resource…
0
votes
2 answers

Erasure Code for chunked file

Is there an erasure code, which can be applied to multiple chunks (maybe 100 or 200, each few hundred kB) by (somehow) adding redundancy chunks ? I heard about Reed-Solomon, but it doesn't look like it can be used for huge data sets and multiple…
Kr0e
  • 2,149
  • 2
  • 24
  • 40
-1
votes
1 answer

ceph active+undersized warning

Setup: 6 node cluster with 3 hosts with 12 hdd osd(s) each (36 total) and other 3 hosts with 24 ssd osd(s) each (72 total). 2 erasure code pool that takes 100% of data one for ssd class and the other for hdd class. # hdd k=22 m=14 64%…
John Karasev
  • 151
  • 2
  • 11
1
2