Jim Paris
b7688844fa
Add a Nosetests plugin that lets me specify a test order within a directory.
9 years ago
Jim Paris
3d212e7592
Move test helpers into subdirectory
9 years ago
Jim Paris
7aedfdf9c3
Add lower level bulkdata test
9 years ago
Jim Paris
ebd4f74959
Remove "pragma: no cover" from things that should get tested
9 years ago
Jim Paris
ebe2fbab92
Add wrap_verify option to nilmdb.utils.must_close decorator
9 years ago
Jim Paris
4831a0cae1
Small doc updates
9 years ago
Jim Paris
07192c6ffb
nilmdb.BulkData: Switch to nested subdir/filename layout
Use numbered subdirectories to avoid having too many files in one dir.
Add appropriate tests.
Also fix an issue where the mmap_open LRU cache could inappropriately
open a file twice because it was using the optional "newsize"
parameter as a key -- now lrucache can be given a slice object that
describes which arguments are important.
9 years ago
Jim Paris
09d325e8ab
Rename format -> _format in data dirs
9 years ago
Jim Paris
11b0293d5f
Clean up BulkData file size calculations, test more thoroughly
Now the goal is 128 MiB files, rather than a specific length.
9 years ago
Jim Paris
493bbed82c
More coverage and tests
9 years ago
Jim Paris
3bc25daaab
Trim urllib to get full coverage of the features in use
9 years ago
Jim Paris
40a3bc4bc3
Update README with Python 2.7 requirement
9 years ago
Jim Paris
c083d63c96
Tests for Unicode compliance
9 years ago
Jim Paris
0221e3ea21
Update commandline test helpers to better handle Unicode
We replace cStringIO with StringIO subclass that forces UTF-8
encoding, and explicitly convert commandlines to UTF-8 before
shlex. These changes will only affect tests, not normal commandline
operation.
9 years ago
Jim Paris
f5fd2b064e
Replace urllib.encode() with a version that encodes Unicode as UTF-8 instead
9 years ago
Jim Paris
06e91a6a98
Always use function version of print()
9 years ago
Jim Paris
41b3f3c018
Always use UTF-8 for filenames in nilmdb.bulkdata
9 years ago
Jim Paris
842076fef4
Cleanup server error handling with decorator
9 years ago
Jim Paris
10d58f6a47
More test coverage
9 years ago
Jim Paris
e2464efc12
Test everything; remove debugging
9 years ago
Jim Paris
1beae5024e
Bulkdata extract works now.
9 years ago
Jim Paris
c7c65b6542
Work around CherryPy bug #1200 ; related cleanups
Spent way too long trying to track down a cryptic error that turned
out to be a CherryPy bug. Now we catch this using a decorator in the
'extract' and 'intervals' generators that transforms exceptions that
trigger the bugs into one that does not. fun!
9 years ago
Jim Paris
f41ff0a6e8
Inserting bulk data is essentially done, not tested
9 years ago
Jim Paris
389c1d189f
Make option to turn off chunked encoding for debugging more clear.
9 years ago
Jim Paris
487298986e
More work towards bulkdata
9 years ago
Jim Paris
d4cd045c48
Fix path stuff, build packer in bulkdata.Table
9 years ago
Jim Paris
3816645313
More work on BulkData
9 years ago
Jim Paris
83b937c720
More Pytables -> bulkdata conversion
9 years ago
Jim Paris
b3e6e8976f
More work towards flat bulk data storage.
Cleaned up OS-specific path handling in nilmdb, bulkdata.
9 years ago
Jim Paris
c890ea93cb
WIP switching away from PyTables
9 years ago
Jim Paris
84c68c6913
Better documentation, cache Tables
9 years ago
Jim Paris
6f1e6fe232
Isolate all PyTables stuff to a single file.
This will make migrating to my own data storage engine easier.
9 years ago
Jim Paris
b0d76312d1
Add must_close() decorator, use it in nilmdb
Warns at runtime if a class's close() method wasn't called before the
object was destroyed.
9 years ago
Jim Paris
19c846c71c
Remove outdated files
9 years ago
Jim Paris
f355c73209
Refactor utility classes into nilmdb.utils subdir/namespace
There's some bug with the testing harness where placing e.g.
from du import du
in nilmdb/utils/__init__.py doesn't quite work -- sometimes the
module "du" replaces the function "du". Not exactly sure why;
we work around that by just renaming files so they don't match
the imported names directly.
9 years ago
Jim Paris
173014ba19
Use nilmdb.lrucache for caching interval sets
9 years ago
Jim Paris
24d4752bc3
Add LRU cache memoizing decorator for functions
9 years ago
Jim Paris
a85b273e2e
Remove compression.
Messes up extraction, since we random access for the timestamp binary
search. In the future, maybe switching to multiple tables (one for
timestamp, one for compressed data) would be smart.
9 years ago
Jim Paris
7f73b4b304
Use compression in pytables
9 years ago
Jim Paris
f3eb6d1b79
Time it!
9 years ago
Jim Paris
9082cc9f44
Merging adjacent intervals is working now!
Adjust test expectations accordingly, since the number of intervals
they print out will now be smaller.
9 years ago
Jim Paris
bf64a40472
Some misc test additions, interval optimizations. Still need adjacency test
9 years ago
Jim Paris
32dbeebc09
More insertion checks. Need to get interval concatenation working.
9 years ago
Jim Paris
66ddc79b15
Inserting works again, with proper end/start for paired blocks.
timeit.sh script works too!
9 years ago
Jim Paris
7a8bd0bf41
Don't include layout on client side
9 years ago
Jim Paris
ee552de740
Start reworking/fixing insert timestamps
9 years ago
Jim Paris
6d1fb61573
Use 'repr' instead of 'str' in Interval string representation.
Otherwise timestamps get truncated to 2 decimal places.
9 years ago
Jim Paris
f094529e66
TODO update
9 years ago
Jim Paris
5fecec2a4c
Support deleting streams with new 'destroy' command
9 years ago
Jim Paris
85bb46f45c
Use pytable's createparents flag to avoid having to create group
structure manually.
9 years ago