| 1 |
-- make mogilefsd trackers speak FUSE, so we could mount all of mogilefs using, say: |
|---|
| 2 |
http://noedler.de/projekte/wdfs/index.html |
|---|
| 3 |
things like paths could be exposed as extended attributes, or as pseudo files: |
|---|
| 4 |
cat /mnt/mogile/<domain>/paths/<key> |
|---|
| 5 |
cat /mnt/mogile/<domain>/contents/<key> |
|---|
| 6 |
|
|---|
| 7 |
-- if create_open before monitor runs yet, block and wait for a round? better than 'no_devices' |
|---|
| 8 |
might need some marker for 'end of monitoring'? or just wait until we have 1 or 3? |
|---|
| 9 |
or if they asked for 3, only return 1 in that rare case, preferring latency to redundancy. |
|---|
| 10 |
plus, we'd know that 1 is writable in last few seconds! |
|---|
| 11 |
|
|---|
| 12 |
-- update the 'repl' command for new file_to_replicate table |
|---|
| 13 |
|
|---|
| 14 |
-- replication policy error storm when a device is known to be observably down: |
|---|
| 15 |
|
|---|
| 16 |
[replicate(28037)] replication policy ran out of suggestions for us replicating fid 197214 |
|---|
| 17 |
[replicate(28037)] replication policy ran out of suggestions for us replicating fid 197237 |
|---|
| 18 |
[replicate(28037)] replication policy ran out of suggestions for us replicating fid 197219 |
|---|
| 19 |
[replicate(28037)] replication policy ran out of suggestions for us replicating fid 197256 |
|---|
| 20 |
[replicate(28037)] replication policy ran out of suggestions for us replicating fid 197226 |
|---|
| 21 |
|
|---|
| 22 |
-- telnet to 7001 and send "!"<enter> will crash. |
|---|
| 23 |
|
|---|
| 24 |
-- fsck job/command. need 'last fsck' table per fid? or column? |
|---|
| 25 |
|
|---|
| 26 |
-- fix haphazard CapitalStyle vs capital_style in ProcManager for class methods |
|---|
| 27 |
|
|---|
| 28 |
-- 'every' func should select on psock, to process parent-sent commands |
|---|
| 29 |
during worker's breaks |
|---|
| 30 |
|
|---|
| 31 |
-- create close could wake a replicate process. |
|---|
| 32 |
|
|---|
| 33 |
-- optional 'wait_until_replicated=1' flag to create close, so client doesn't |
|---|
| 34 |
get success until file is everywhere. |
|---|
| 35 |
|
|---|
| 36 |
-- redo/reevaluate the 'unreachable_fids' logic: unreachable should only mean |
|---|
| 37 |
host/device are up, but file is 404. |
|---|
| 38 |
|
|---|
| 39 |
-- test database failures |
|---|
| 40 |
|
|---|
| 41 |
-- identify idempotent commands and replay them 'n' times if query worker dies |
|---|
| 42 |
during processing. |
|---|
| 43 |
|
|---|
| 44 |
-- have queries workers be able to broadcast back up to parent "can't parse this" |
|---|
| 45 |
at which point parent parses it (e.g. "help" command), so admins don't |
|---|
| 46 |
need to remember the "!" prefix. of course, "!" prefix can always be used to |
|---|
| 47 |
reach parent faster. |
|---|
| 48 |
|
|---|
| 49 |
-- mb_asof handling in find_deviceid seems broken. less than max age? wrong units. |
|---|
| 50 |
|
|---|
| 51 |
-- make generic script to write out usage files for people not using mogstored |
|---|
| 52 |
-- or, let mogstored be run in 'usage' file writing only mode |
|---|
| 53 |
|
|---|
| 54 |
-- wake up deleter process? totally overkill, but why not? |
|---|
| 55 |
|
|---|
| 56 |
* 404 storms during replicating: (1.5 year old email, might be fixed, verify) |
|---|
| 57 |
|
|---|
| 58 |
:: [replicate(12648)] Error: Resource http://10.0.0.82:7500/dev15/0/015/693/0015693821.fid failed: HTTP 404 |
|---|
| 59 |
:: [replicate(12648)] Copier failed replicating 15693821 |
|---|
| 60 |
:: [replicate(12648)] Error: Resource http://10.0.0.82:7500/dev15/0/015/693/0015693819.fid failed: HTTP 404 |
|---|
| 61 |
:: [replicate(12648)] Copier failed replicating 15693819 |
|---|
| 62 |
:: [replicate(12648)] Error: Resource http://10.0.0.81:7500/dev9/0/015/693/0015693844.fid failed: HTTP 404 |
|---|
| 63 |
:: [replicate(12648)] Copier failed replicating 15693844 |
|---|
| 64 |
:: [replicate(12646)] Copier failed replicating 15693846 |
|---|
| 65 |
:: [replicate(12646)] Error: Resource http://10.0.0.82:7500/dev15/0/015/693/0015693821.fid failed: HTTP 404 |
|---|
| 66 |
:: [replicate(12646)] Copier failed replicating 15693821 |
|---|
| 67 |
:: [replicate(12646)] Error: Resource http://10.0.0.81:7500/dev9/0/015/693/0015693844.fid failed: HTTP 404 |
|---|
| 68 |
:: [replicate(12646)] Copier failed replicating 15693844 |
|---|
| 69 |
:: [replicate(12648)] Error: Resource http://10.0.0.81:7500/dev3/0/015/693/0015693848.fid failed: HTTP 404 |
|---|
| 70 |
:: [replicate(12650)] Error: Resource http://10.0.0.82:7500/dev15/0/015/693/0015693819.fid failed: HTTP 404 |
|---|
| 71 |
:: [replicate(12648)] Copier failed replicating 15693848 |
|---|
| 72 |
...... |
|---|
| 73 |
|
|---|
