root/tags/mogilefs-server-2.07/TODO

Revision 388, 3.7 kB (checked in by bradfitz, 2 years ago)

todo item

Line 
1 -- make mogilefsd trackers speak FUSE, so we could mount all of mogilefs using, say:
2       http://noedler.de/projekte/wdfs/index.html
3    things like paths could be exposed as extended attributes, or as pseudo files:
4       cat /mnt/mogile/<domain>/paths/<key>
5       cat /mnt/mogile/<domain>/contents/<key>
6
7 -- if create_open before monitor runs yet, block and wait for a round?  better than 'no_devices'
8    might need some marker for 'end of monitoring'?  or just wait until we have 1 or 3?
9    or if they asked for 3, only return 1 in that rare case, preferring latency to redundancy.
10    plus, we'd know that 1 is writable in last few seconds!
11
12 -- update the 'repl' command for new file_to_replicate table
13
14 -- replication policy error storm when a device is known to be observably down:
15
16 [replicate(28037)] replication policy ran out of suggestions for us replicating fid 197214
17 [replicate(28037)] replication policy ran out of suggestions for us replicating fid 197237
18 [replicate(28037)] replication policy ran out of suggestions for us replicating fid 197219
19 [replicate(28037)] replication policy ran out of suggestions for us replicating fid 197256
20 [replicate(28037)] replication policy ran out of suggestions for us replicating fid 197226
21
22 -- telnet to 7001 and send "!"<enter>  will crash.
23
24 -- fsck job/command.  need 'last fsck' table per fid?  or column?
25
26 -- fix haphazard CapitalStyle vs capital_style in ProcManager for class methods
27
28 -- 'every' func should select on psock, to process parent-sent commands
29    during worker's breaks
30
31 -- create close could wake a replicate process.
32
33 -- optional 'wait_until_replicated=1' flag to create close, so client doesn't
34    get success until file is everywhere.
35
36 -- redo/reevaluate the 'unreachable_fids' logic:  unreachable should only mean
37    host/device are up, but file is 404.
38
39 -- test database failures
40
41 -- identify idempotent commands and replay them 'n' times if query worker dies
42    during processing.
43
44 -- have queries workers be able to broadcast back up to parent "can't parse this"
45    at which point parent parses it (e.g. "help" command), so admins don't
46    need to remember the "!" prefix.  of course, "!" prefix can always be used to
47    reach parent faster.
48
49 -- mb_asof handling in find_deviceid seems broken.  less than max age?  wrong units.
50
51 -- make generic script to write out usage files for people not using mogstored
52     -- or, let mogstored be run in 'usage' file writing only mode
53
54 -- wake up deleter process?  totally overkill, but why not?
55
56 * 404 storms during replicating:  (1.5 year old email, might be fixed, verify)
57
58 :: [replicate(12648)] Error: Resource http://10.0.0.82:7500/dev15/0/015/693/0015693821.fid failed: HTTP 404
59 :: [replicate(12648)] Copier failed replicating 15693821
60 :: [replicate(12648)] Error: Resource http://10.0.0.82:7500/dev15/0/015/693/0015693819.fid failed: HTTP 404
61 :: [replicate(12648)] Copier failed replicating 15693819
62 :: [replicate(12648)] Error: Resource http://10.0.0.81:7500/dev9/0/015/693/0015693844.fid failed: HTTP 404
63 :: [replicate(12648)] Copier failed replicating 15693844
64 :: [replicate(12646)] Copier failed replicating 15693846
65 :: [replicate(12646)] Error: Resource http://10.0.0.82:7500/dev15/0/015/693/0015693821.fid failed: HTTP 404
66 :: [replicate(12646)] Copier failed replicating 15693821
67 :: [replicate(12646)] Error: Resource http://10.0.0.81:7500/dev9/0/015/693/0015693844.fid failed: HTTP 404
68 :: [replicate(12646)] Copier failed replicating 15693844
69 :: [replicate(12648)] Error: Resource http://10.0.0.81:7500/dev3/0/015/693/0015693848.fid failed: HTTP 404
70 :: [replicate(12650)] Error: Resource http://10.0.0.82:7500/dev15/0/015/693/0015693819.fid failed: HTTP 404
71 :: [replicate(12648)] Copier failed replicating 15693848
72 ......
73
Note: See TracBrowser for help on using the browser.