Human Folly about “content-defined-chunking”

index

• Chunking (docs.attic.rs):

  #Content-defined-chunking in #Nix: “Attic is a self-hostable Nix Binary Cache server backed by an S3-compatible storage provider. It has support for global deduplication and garbage collection.”

  on 02026-08-19
• Xia (usenix.org):

  The "FastCDC" #paper explains the #content-defined-chunking #algorithms used by #Nix’s “attic” to deduplicate 64K chunks, published at #USENIX

  on 02026-08-19
• 2011 bup git (apenwarr.ca):

  #apenwarr’s #bup presentation slides #PDF from 02011, explaining #content-defined-chunking

  on 02026-05-27
• (apenwarr.ca):

  #apenwarr’s announcement in 02010 of #bup #backups, from which we get bupsplit and #content-defined-chunking

  on 02026-05-27
• CDC file transfer (github.com):

  "content-defined chunking" is similar to silentbicycle’s (?) #Jumprope

  on 02023-01-15