summaryrefslogtreecommitdiffstats
Commit message (Collapse)AuthorAgeFilesLines
* added new function file.no_of_shards + tests.Siddharth Ravikumar2015-08-252-0/+46
| | | | | modified: combox/file.py modified: tests/file_test.py
* setup.py: added new dependency `simplejson'.Siddharth Ravikumar2015-08-242-1/+2
| | | | | | | | Looks like pickledb requires `simplejson'. modded: README.md setup.py
* combox.config: silo directory is expanded to its abs. path when no silo ↵Siddharth Ravikumar2015-08-242-2/+2
| | | | | | | directory is given. modified: combox/config.py modified: tests/utils.py
* updated combox.cbox.run_cb.Siddharth Ravikumar2015-08-241-0/+3
| | | | | Now, the first node monitor does the housekeeping thing on the node directories.
* combox/events.py: fixed typo in comment.Siddharth Ravikumar2015-08-241-1/+1
|
* Intergrated node monitor into the combox.cbox module.Siddharth Ravikumar2015-05-081-9/+34
| | | | modified: combox/cbox.py
* updated TODO.orgSiddharth Ravikumar2015-05-011-1/+14
|
* Updated combox.events.NodeDirMonitor.housekeep's 're-construct file' ↵Siddharth Ravikumar2015-05-012-24/+63
| | | | | | | | | | | | | | | | | | | | functionality. - Now the housekeep method re-contructs the files, whose shards were created when combox was off, in the combox directory only if all of its shards have made it to the respective node directories. - If it finds only some of all the shards of a file missing, it stores this information in the `file_created' dict inside the silo. - tests.events_tests.TestEvents.test_NDM_housekeep_create tests the 're-construct file' functionality of combox.events.NodeDirMonitor.housekeep method. modified: combox/events.py modified: tests/events_test.py
* added comments in combox.events.NodDirMonitor.housekeep method.Siddharth Ravikumar2015-05-011-0/+3
|
* Updated combox.events.NodeDirMonitor.housekeep's delete functionality.Siddharth Ravikumar2015-04-302-12/+45
| | | | | | | | | | | | | | | | | | - Now the housekeep method deletes the file in the combox directory only if all of its shards are missing in the respective node directories -- meaning it was deleted on another computer (running combox). - If it finds only some of all the shards of a file missing, it stores this information in the `file_deleted' dict inside the silo. - tests.events_tests.TestEvents.test_NDM_housekeep_delete tests the delete functionality of combox.events.NodeDirMonitor.housekeep method. modified: combox/events.py modified: tests/events_test.py
* combox.silo.ComboxSilo.node_set: added an optional parameter called `num'.Siddharth Ravikumar2015-04-292-1/+20
| | | | | | | - Updated tests as usual. modified: combox/silo.py modified: tests/silo_test.py
* TODO.org: rewrote combox.events.NodeDirMonitor.on_moved methodSiddharth Ravikumar2015-04-221-2/+4
| | | | | | | | | | | | | | ------- Theory: Productivity is directly proportional to the slowness of your Internet connection -- slower it is better you are. Proof of theory: Joey Hess -- http://joeyh.name (lives in a cabin, has a dialup connection to the Internet). Hence, proved. ------- I did this zarking rewrite with the Internet zarking turned off.
* rewrote combox.events.NodeDirMonitor.on_moved method.Siddharth Ravikumar2015-04-222-15/+42
| | | | | | | | | | | | | - Now the node monitor waits for all shards of the file, which was moved/renamed on a remote computer, to get moved/renamed on this computer, before it finally reconstructs the moved/renamed file in the combox directory on this computer. - Updated the tests for on_moved method at tests.events_test.TestEvents.test_NDM_onmoved method. modified: combox/events.py modified: tests/events_test.py
* TODO.org: added deadline for rewriting ↵Siddharth Ravikumar2015-04-221-0/+1
| | | | "combox.events.NodeDirMonitor.on_moved method".
* TODO.org: rewrote combox.events.NodeDirMonitor.on_deleted methodSiddharth Ravikumar2015-04-151-2/+4
|
* rewrote combox.events.NodeDirMonitor.on_deleted method.Siddharth Ravikumar2015-04-152-6/+75
| | | | | | | | | | | | | | | | | | | | | - Now the the node monitor waits for all shards of the file, which was deleted on a remote computer, to get deleted on this computer, before it finally deletes the respective file in the combox directory. - Tests for it is at tests.events_test.TestEvents.test_NDM_ondeleted method. modified: combox/events.py modified: tests/events_test.py Did some of this while listening to Cat Stevens' (Yusuf): - Just Another Night - Wild World - Father and son (*) - Peace train - Moonshadow (*)
* combox/silo.py: added comment in ComboxSilo.node_set()Siddharth Ravikumar2015-04-151-1/+4
|
* TODO.org: added deadline for TODO rewrite ↵Siddharth Ravikumar2015-04-151-0/+1
| | | | combox.events.NodeDirMonitor.on_deleted method
* TODO.org: bug #1 is done.Siddharth Ravikumar2015-04-091-1/+4
|
* fixed bug #1 (platform-specific)Siddharth Ravikumar2015-04-092-5/+8
| | | | | | | we're using os.path.expanduser instead of os.getenv('HOME'). modified: combox/cbox.py modified: combox/config.py
* updated TODO.org: added tags to bugs section.Siddharth Ravikumar2015-04-091-3/+3
|
* TODO.org: added 'bugs' section.Siddharth Ravikumar2015-04-091-76/+86
| | | | | Registered the first combox bug found by someone other than the one writing combox -- Dr. Green.
* README.md: added new section `canonical repo'.Siddharth Ravikumar2015-04-091-0/+4
|
* updated README.mdSiddharth Ravikumar2015-04-091-1/+1
|
* updated README.md -- criticism is good.Siddharth Ravikumar2015-04-081-0/+2
|
* TODO.org: rewrote combox.events.NodeDirMonitor.on_modified methodSiddharth Ravikumar2015-04-081-2/+6
|
* rewrote combox.events.NodeDirMonitor.on_modified method.Siddharth Ravikumar2015-04-082-3/+66
| | | | | | | | | | | | | | | | - Now the the node monitor waits for all shards of the file, which was modified on a remote computer, to arrive on this computer, before it re-constructs the file into the respective location in the combox directory. - Tests for it is at tests.events_test.TestEvents.test_NDM_onmodified method. modified: combox/events.py modified: tests/events_test.py Part of this was done while listening to Avril's "Complicated" ; I think this is the only modern Pop song which I like.
* After a file which was created a in a remote computer is reconstructed in ↵Siddharth Ravikumar2015-04-082-1/+8
| | | | | | | this computer, its info is removed from the 'file_created' dictionary in the silo. modified: combox/events.py modified: tests/events_test.py
* new method combox.silo.ComboxSilo.node_remSiddharth Ravikumar2015-04-082-0/+33
| | | | | | | | | | | The method removes information about a file in the category `type_' where `type_' can be 'file_created', 'file_modified', 'file_removed', 'file_moved'. Also wrote tests for it :~( modified: combox/silo.py modified: tests/silo_test.py
* added test file to purge list in tests.events_test.TestEvents.test_NDM_oncreatedSiddharth Ravikumar2015-04-081-0/+3
| | | | modified: tests/events_test.py
* Added test for directory creation in ↵Siddharth Ravikumar2015-04-081-15/+15
| | | | | | tests.events_test.TestEvents.test_NDM_oncreated. modified: tests/events_test.py
* renamed method test_NDM_oncreate -> test_NDM_oncreated in ↵Siddharth Ravikumar2015-04-081-2/+2
| | | | | | tests.event_test.TestEvents. modified: tests/events_test.py
* TODO.org: set deadline for the week.Siddharth Ravikumar2015-04-061-0/+1
|
* modded teardown method in tests.events_test.TestEvents.Siddharth Ravikumar2015-04-031-6/+2
| | | | | | the silo is purged using the deldb method instead of doing a os.remove. modfied: tests/events_test.py
* updated TODO.orgSiddharth Ravikumar2015-04-031-0/+2
|
* updated TODO.org: Done rewriting combox.events.NodeDirMonitor.on_created methodSiddharth Ravikumar2015-04-011-1/+4
|
* [golden commit]: rewrote combox.events.NodeDirMonitor.on_created method.Siddharth Ravikumar2015-04-012-13/+76
| | | | | | | | | | | | | | | | | | | | | - Now the the node monitor waits for all shards of the file, which was created on a remote computer, to arrive on this computer, before it re-constructs the file into the respective location in the combox directory. - Tests for it is at tests.events_test.TestEvents.test_NDM_oncreate method. - The main test method, tests.events_test.TestEvents.test_NDM, was disabled by renaming it to tests.events_test.TestEvents.test_NDM. - Now the NodeDirMonitor requires passing the 'node monitor lock' when creating an instance of it. :~( modified: combox/events.py modified: tests/events_test.py
* updated TODO.orgSiddharth Ravikumar2015-04-011-0/+4
|
* updated combox.file.relative_path.Siddharth Ravikumar2015-04-012-3/+18
| | | | | | | | | This method now returns relative paths w. r. t all node directories. Before it used to return relative paths only w. r. t the first node directory. Also updated the tests for it :~( modified: combox/file.py modified: tests/file_test.py
* new variable at NodeDirMonitor -- `num_nodes'Siddharth Ravikumar2015-04-012-0/+11
| | | | | | | `num_nodes' a value that represents the number of node directories. modified: combox/events.py modified: tests/events_test.py
* renamed dict names in combox.silo.ComboxSilo from shard_* -> file_*Siddharth Ravikumar2015-04-012-55/+55
| | | | | | | | The main zarking reason for the name is that we might also want to track directories apart from shards in the node directories. modified: combox/silo.py modified: tests/silo_test.py
* updated TODO.orgSiddharth Ravikumar2015-04-011-1/+4
|
* Now combox.silo.ComboxSilo reloads db from disk before reading/writing.Siddharth Ravikumar2015-04-012-30/+13
| | | | | modified: combox/events.py modified: combox/silo.py
* updated TODO.orgSiddharth Ravikumar2015-04-011-0/+1
|
* updated TODO.orgSiddharth Ravikumar2015-04-011-2/+4
|
* refactored the way locks work in combox.siloComboxSilo.Siddharth Ravikumar2015-04-015-51/+64
| | | | | | | | modified: combox/cbox.py modified: combox/events.py modified: combox/silo.py modified: tests/events_test.py modified: tests/silo_test.py
* updated TODO.org -- changed the TODO for this week.Siddharth Ravikumar2015-03-311-1/+1
|
* new methods in combox.silo.ComboxSilo -- node_get, node_set. noddicts.Siddharth Ravikumar2015-03-312-0/+149
| | | | | | | | These methods will be used to manage the dictionaries in the db related to the zarking shards. modified: combox/silo.py modified: tests/silo_test.py
* ComboxSilo is now going to have dictionaries that track information about ↵Siddharth Ravikumar2015-03-312-2/+18
| | | | | | | the shards. modified: combox/events.py modified: combox/silo.py
* updated TODO.orgSiddharth Ravikumar2015-03-311-0/+2
|
siddharth ravikumar snafu