|
Revision 80, 1.0 kB
(checked in by bradfitz, 3 years ago)
|
- merge in the refactoring branch, in which a lot of long-standing
pet peeves in the design were rethought/redone.
|
| Line | |
|---|
| 1 | Chunk description in .bracup file: |
|---|
| 2 | Chunks: offset;raw_length;stored_length;typed_digest |
|---|
| 3 | Proposal to change: |
|---|
| 4 | Chunks: offset;raw_length;stored_length;typed_digest(stored);typed_digest(raw);flags |
|---|
| 5 | |
|---|
| 6 | Where flags is comma separate list of \w+. e.g. "gz" for gzip compression |
|---|
| 7 | |
|---|
| 8 | ------ |
|---|
| 9 | |
|---|
| 10 | Document: purpose of chunks named by their final digest is twofold: |
|---|
| 11 | 1) can verify integrity of storage medium. is it corrupt? |
|---|
| 12 | 2) hides proof of ownership of contents (when encrypted) |
|---|
| 13 | side-effect: |
|---|
| 14 | -- when we do compression, we'll be consistent and store it as its |
|---|
| 15 | compressed digest, even if not encrypted as well. |
|---|
| 16 | |
|---|
| 17 | --- |
|---|
| 18 | |
|---|
| 19 | Maybe we don't need per-chunk meta files: |
|---|
| 20 | -- can get it all from .brackup (meta)files on the server. |
|---|
| 21 | (TODO: abstract out parser for multiple users) |
|---|
| 22 | |
|---|
| 23 | --- |
|---|
| 24 | |
|---|
| 25 | smart chunk-sizing on certain files w/ metadata and data separate: |
|---|
| 26 | like mp3 files and their id3. have a smart chunker that's the data |
|---|
| 27 | part vs. the id3 part, so updating id3 later doesn't reupload the |
|---|
| 28 | entire data part. :-) |
|---|
