Jim Paris
dfdd0e5c74
Fix line parsing in http client
9 years ago
Jim Paris
9a2699adfc
Attempt at fixing up more Unicode issues with metadata.
9 years ago
Jim Paris
9bbb95b18b
Add unicode decode/encode helpers
9 years ago
Jim Paris
6bbed322c5
Fix unicode in completion
9 years ago
Jim Paris
2317894355
Tweak cache sizes to account for large numbers of decimated tables
9 years ago
Jim Paris
539c92226c
Add more disk space info
9 years ago
Jim Paris
77c766d85d
Bump MAX_LAYOUT_COUNT to 1024
9 years ago
Jim Paris
49d04db1d6
Allow start==end in stream_insert_context, if no data was provided.
9 years ago
Jim Paris
ea838d05ae
Warn against reused context managers, and fix broken tests
9 years ago
Jim Paris
f2a48bdb2a
Test binary extract; fix bugs
9 years ago
Jim Paris
6d14e0b8aa
Allow binary extract
9 years ago
Jim Paris
b31b9327b9
Add tool to fix oversize files (the bug fixed by b98ff13
)
9 years ago
Jim Paris
b98ff1331a
Fix bug where too much data was getting written to each file.
We were still calculating the maximum number of rows correctly,
so the extra data was really extra and would get re-written to the
beginning of the subsequent file.
The only case in which this would lead to database issues is if the
very last file was lengthened incorrectly, and the "nrows" calculation
would therefore be wrong when the database was reopened. Still, even
in that case, it should just leave a small gap in the data, not cause
any errors.
9 years ago
Jim Paris
00e6ba1124
Avoid ENOENT in nilmdb.utils.diskusage.du
ENOENT might show up if we're actively deleting files in the nilmdb
thread while trying to read available space from e.g. the server
thread.
9 years ago
Jim Paris
01029230c9
Tweaks to sorting
9 years ago
Jim Paris
ecc4e5ef9d
Improve test coverage
9 years ago
Jim Paris
23f31c472b
Split sort_streams_nicely into separate file
9 years ago
Jim Paris
a1e2746360
Fix bug in nilmdb.stream_remove with max_removals
9 years ago
Jim Paris
1c40d59a52
server: use a generator in /stream/remove
Instead of returning a single number at the end of N nilmdb calls, we
now use a generator that returns one line of text every time there's a
new count of rows removed. This ensures that the connection will stay
alive for very long removals.
9 years ago
Jim Paris
bfb09a189f
Fix coverage
9 years ago
Jim Paris
416a499866
Support wildcards for destroy
9 years ago
Jim Paris
637d193807
Fix unicode processing of command line arguments
9 years ago
Jim Paris
b7fa5745ce
nilmtool list: allow multiple paths to be supplied
9 years ago
Jim Paris
0104c8edd9
nilmtool remove: allow wildcards and multiple paths
9 years ago
Jim Paris
cf3b8e787d
Add test for wrong number of fields in numpy insert
9 years ago
Jim Paris
83d022016c
nilmtool list: add new --layout option to show layouts
9 years ago
Jim Paris
43b740ecaa
nilmtool list: remove old -p parameter
9 years ago
Jim Paris
4ce059b920
Give a slightly more clear error on bad array sizes
9 years ago
Jim Paris
99a4228285
Set up default SIGPIPE handler
This lets you do something like "nilmtool extract | head" without
triggering backtraces.
9 years ago
Jim Paris
230ec72609
Fix timestamp display issues with --annotate
9 years ago
Jim Paris
d36ece3767
Fix up dependencies
9 years ago
Jim Paris
231963538e
Add some info about binary interface to design docs
9 years ago
Jim Paris
b4d6aad6de
Merge branch 'binary'
9 years ago
Jim Paris
e95142eabf
Huge update to support inserting in client.numpyclient, with tests
This includes both client.stream_insert_numpy and
client.stream_insert_numpy_context(). The test code is based on
similar test code for client.stream_insert_context, so it should be
fairly complete.
9 years ago
Jim Paris
d21c3470bc
Client cleanups; fix tests to account for time epsilon = 1
9 years ago
Jim Paris
7576883f49
Add basic binary support to client, and restructure a bit
9 years ago
Jim Paris
cc211542f8
Add binary support to nilmdb.server; enforce content-type
9 years ago
Jim Paris
8292dcf70b
Clean up stream/extract content-type and add a test for it
9 years ago
Jim Paris
b362fd37f6
Add binary option to nilmdb.stream_insert
9 years ago
Jim Paris
41ec13ee17
Rename bulkdata.append_string to bulkdata.append_data
9 years ago
Jim Paris
efa9aa9097
Add binary option to bulkdata.append_string
9 years ago
Jim Paris
d9afb48f45
Make append_binary signature look like append_string
9 years ago
Jim Paris
d1140e0f16
Timestamps are int64, not uint64
9 years ago
Jim Paris
6091e44561
Fix fread return value check
9 years ago
Jim Paris
e233ba790f
Add append_binary to rocket
9 years ago
Jim Paris
f0304b4c00
Merge branch 'binary' into HEAD
9 years ago
Jim Paris
60594ca58e
Numpy is required for tests now, due to nilmdb.client.numpyclient
Still allow installation without it, though.
9 years ago
Jim Paris
c7f2df4abc
Add nilmdb.client.numpyclient.NumpyClient with stream_extract_numpy
This is a subclass of nilmdb.client.client.Client that adds numpy
specific routines, which should be a lot faster.
9 years ago
Jim Paris
5b7409f802
Add binary extract to client, server, nilmdb, bulkdata, and rocket.
9 years ago
Jim Paris
06038062a2
Fix error in time parsing
9 years ago