Commit message (Collapse) | Author | Age | Files | Lines | |
---|---|---|---|---|---|
* | Update chunk references on chunk flush too, so we don't lose partially used | Steve Slaven | 2009-08-07 | 1 | -37/+44 |
| | | | | | chunks that never get locked or unlocked because we haven't sync'd the whole file yet | ||||
* | A note about refcount testing as a TODO | Steve Slaven | 2009-08-07 | 1 | -1/+2 |
| | |||||
* | Turned off profiling | Steve Slaven | 2009-08-07 | 1 | -1/+1 |
| | |||||
* | Don't re-read the entire file in case we are extending it when we don't | Steve Slaven | 2009-08-07 | 1 | -2/+7 |
| | | | | | have enough blocks, just start from the last block. This increases performace significantly for large files | ||||
* | More notes about profiling | Steve Slaven | 2009-08-07 | 1 | -0/+5 |
| | |||||
* | Switched to cProfile | Steve Slaven | 2009-08-07 | 1 | -5/+4 |
| | |||||
* | Trying out md5 to see if it speeds up some | Steve Slaven | 2009-08-07 | 1 | -2/+3 |
| | |||||
* | Added some logging | Steve Slaven | 2009-08-07 | 1 | -1/+9 |
| | |||||
* | Digest wrapper | Steve Slaven | 2009-08-07 | 1 | -0/+7 |
| | |||||
* | Add swapable digest for key generation | Steve Slaven | 2009-08-07 | 2 | -4/+6 |
| | |||||
* | Kill the logging.debug function if we're not debugging, otherwise it shows | Steve Slaven | 2009-08-07 | 1 | -0/+4 |
| | | | | | up in the top 3 functions in profiling, making it mostly nop speeds things up a bit | ||||
* | Moved everything to main() so we can run the profiler again | Steve Slaven | 2009-08-07 | 1 | -34/+38 |
| | |||||
* | Added note about open/unlink for temp file probably not working (but not | Steve Slaven | 2009-08-07 | 1 | -0/+2 |
| | | | | tested though) | ||||
* | Added a method to free blocks before unlink, just doing ftruncate then | Steve Slaven | 2009-08-07 | 2 | -2/+9 |
| | | | | | unlink left the "empty" file and "empty" block with an extra ref for every unlink since we never freed those blocks | ||||
* | Changed the way we look for the debug flag and actually turn the flag on | Steve Slaven | 2009-08-07 | 1 | -2/+1 |
| | | | | ONLY when we see debug enabled | ||||
* | Turn on debugging with -d instead of having to edit the script | Steve Slaven | 2009-08-07 | 1 | -9/+13 |
| | |||||
* | Updated some things that are done | Steve Slaven | 2009-08-07 | 1 | -3/+3 |
| | |||||
* | Don't gzip serialized data anymore since it's basically just a single key | Steve Slaven | 2009-08-07 | 1 | -5/+5 |
| | | | | | | | in the physical file, and the chunked data that has the actual file chunk contents is already compressed. Compressing the single key data in the tree actually makes it bigger (50+ bytes instead of 34) which can be seen by gzipping them manually to test | ||||
* | Added note about wanting to delete empty directories | Steve Slaven | 2009-08-07 | 1 | -1/+4 |
| | |||||
* | Store a key in the phyiscal file that pulls the data from a chunk to | Steve Slaven | 2009-08-07 | 2 | -4/+35 |
| | | | | minimize 100% file duplicates to be nothing more than a key length | ||||
* | Update usage, took out xmp.py sample copyrights since almost all of xmp.py | Steve Slaven | 2009-08-07 | 1 | -4/+4 |
| | | | | has been replaced | ||||
* | Pre-init original_chunks because we might need to fflush early in the | Steve Slaven | 2009-08-06 | 2 | -1/+14 |
| | | | | | constructor, use ftruncate since truncate doesn't exist, and handle unlocking unused chunks due to ftruncate | ||||
* | Truncate files on unlink so we free their blocks | Steve Slaven | 2009-08-06 | 1 | -0/+4 |
| | |||||
* | Update chunk ref counts when we update the on-disk chunk list | Steve Slaven | 2009-08-06 | 1 | -23/+30 |
| | |||||
* | Add reference counting so we can delete unused chunks | Steve Slaven | 2009-08-06 | 5 | -24/+93 |
| | |||||
* | Another thoughtstable2009080601 | Steve Slaven | 2009-08-06 | 1 | -0/+2 |
| | |||||
* | Debugging utilities | Steve Slaven | 2009-08-04 | 2 | -0/+32 |
| | |||||
* | More thoughts/notes | Steve Slaven | 2009-08-04 | 1 | -0/+7 |
| | |||||
* | Made header length a variable so we can change it later if needed | Steve Slaven | 2009-08-04 | 1 | -4/+6 |
| | |||||
* | Added more logging, fixed error with storage size for block length | Steve Slaven | 2009-08-04 | 1 | -3/+18 |
| | |||||
* | Added note about fsck | Steve Slaven | 2009-08-04 | 1 | -0/+3 |
| | |||||
* | Don't use a stream class for now | Steve Slaven | 2009-08-04 | 1 | -3/+5 |
| | |||||
* | Fix deserialize name | Steve Slaven | 2009-08-04 | 1 | -1/+1 |
| | |||||
* | Added binary format chunk serializer | Steve Slaven | 2009-08-04 | 2 | -1/+74 |
| | |||||
* | Namespace/module fixes | Steve Slaven | 2009-08-04 | 1 | -3/+3 |
| | |||||
* | Namespace/module fixes | Steve Slaven | 2009-08-04 | 2 | -2/+8 |
| | |||||
* | Added storage switch back in | Steve Slaven | 2009-08-04 | 1 | -3/+8 |
| | |||||
* | Fix namespace problem | Steve Slaven | 2009-08-04 | 3 | -5/+5 |
| | |||||
* | Fix some missing symbols | Steve Slaven | 2009-08-04 | 1 | -2/+4 |
| | |||||
* | Use the new chunk storage | Steve Slaven | 2009-08-04 | 1 | -1/+4 |
| | |||||
* | Chunk storage handlers | Steve Slaven | 2009-08-04 | 3 | -0/+197 |
| | |||||
* | Split up main classes | Steve Slaven | 2009-08-04 | 5 | -982/+769 |
| | |||||
* | Use some more printf like % stuff instead of str()before-class-split | Steve Slaven | 2009-07-29 | 1 | -6/+6 |
| | |||||
* | Eliminated some more str() stuff | Steve Slaven | 2009-07-29 | 1 | -6/+9 |
| | |||||
* | Changed debug to use param args instead of way too much + str() | Steve Slaven | 2009-07-29 | 1 | -76/+72 |
| | |||||
* | Use "best" cpickle format | Steve Slaven | 2009-07-29 | 1 | -1/+1 |
| | |||||
* | More notes/thoughts | Steve Slaven | 2009-07-29 | 1 | -1/+8 |
| | |||||
* | Changed default log level | Steve Slaven | 2009-07-29 | 1 | -1/+1 |
| | |||||
* | Some thoughts/info on stuff that should be done some day | Steve Slaven | 2009-07-29 | 1 | -0/+53 |
| | |||||
* | Be more explicit about saving chunks, since some other parts of the code | Steve Slaven | 2009-07-29 | 1 | -2/+8 |
| | | | | look at len(self.chunks) and this is NOT extended until we do a _save_chunk |