nilm/nilmdb
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
209 Commits 3 Branches 64 Tags 3.2 MiB
insert-rework-wip
Commit Graph

209 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Jim Paris
8afaf8f329 Improve insert strutcure 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10562 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-03-14 20:29:30 +00:00
Jim Paris
610860c379 Update 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10556 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-03-13 22:12:30 +00:00
Jim Paris
c076af64af for reference 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10548 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-03-12 20:19:32 +00:00
Jim Paris
d0435cbf91 for reference 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10547 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-03-12 20:19:29 +00:00
Jim Paris
ace199ffa8 Working client-side pycurl code to send a streaming chunked PUT. 
Working server-side cherrypy code to receive a streaming chunked PUT.


git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10546 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-03-12 20:09:17 +00:00
Jim Paris
5b89fa7ccf Fix style 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10446 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-02-21 21:30:53 +00:00
Jim Paris
d8929467eb Cleanup 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10445 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-02-20 06:13:54 +00:00
Jim Paris
ba66668fff playing with coverage a bit 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10444 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-02-20 06:09:42 +00:00
Jim Paris
1e1c7fa9c4 Create StreamException class in NilmDB, which can get caught and 
handled by the HTTP server.

Add /stream/get_metadata HTTP request.

Fill out test_stream_metadata

Add runserver.py script to just run the server from the command line,
outside of the testing environment.  Add necessary hooks within
nilmdb/server.py to allow this to happen.

Metadata operations get stream_id first and report error on missing
stream, instead of returning an empty dict.


git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10443 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-02-20 05:52:33 +00:00
Jim Paris
9b64a18daf Remove nilmdbsql; move functions into nilmdb.py instead 
TODO                |    2 
 nilmdb/__init__.py  |    1 
 nilmdb/nilmdb.py    |  113 +++++++++++++++++++++++++++++++++++++++++-----
 nilmdb/nilmdbsql.py |  126 ----------------------------------------------------
 4 files changed, 102 insertions(+), 140 deletions(-)



git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10428 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-02-17 20:42:08 +00:00
Jim Paris
398d382dac Stuff goes into the SQL database now. 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10427 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-02-17 00:32:36 +00:00
Jim Paris
53e3c44186 Move schema updates to a dict 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10421 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-02-15 23:11:37 +00:00
Jim Paris
4395f68662 Start SQL stuff 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10419 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-02-14 21:54:30 +00:00
Jim Paris
c5ec07a661 Start working towards mixed sql/pytables db 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10373 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-02-08 19:28:16 +00:00
Jim Paris
4ca726439b Branch 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10372 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-02-08 18:11:31 +00:00
Jim Paris
72deddcd9b tags 
git-svn-id: https://bucket.mit.edu/svn/nilm/tags/nilmdb-pytables@10371 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-02-08 18:07:32 +00:00
Jim Paris
bc1d0260eb ignore 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10368 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-02-08 18:01:21 +00:00
Jim Paris
ef2db81d11 Misc 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10367 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-02-08 18:01:05 +00:00
Jim Paris
6812a28131 Make stream_list return number of rows. 
Update layouts to include expected number of rows per day -- this is
used (as strongly suggested by the PyTables docs) to form a rough
estimate of the number of rows in a table during CreateTable.


git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb-new@10340 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-30 20:25:11 +00:00
Jim Paris
7933775462 TODO 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb-new@10339 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-30 18:09:05 +00:00
Jim Paris
3b9d84d689 Adjust how layouts are managed: now we pass strings representing the 
layouts, rather than direct dict objects.  This allows us to go
backwards and match the description of tables in the database with the
layouts defined within nilmdb.layout.

Fix some big issues with the nilmdb.server and startup errors like an
invalid port number.  We have to catch os._exit and report the error
ourselves.

Add some timeouts and otherwise clean up tests.

Make NilmDB track and complain about files that weren't closed before
the object is destroyed.

Update stream_list and /stream/list to return the layout corresponding
to each table.



git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb-new@10338 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-28 00:36:23 +00:00
Jim Paris
b5e3b22558 Fixups, and add serializer to NilmDB access from CherryPy 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb-new@10336 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-27 19:17:09 +00:00
Jim Paris
93d7088af3 update TODO 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb-new@10335 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-27 01:28:45 +00:00
Jim Paris
9f4d88cc8f Added serialization wrapper. This will let us wrap the NilmDB object 
and ensure that all function calls happen from within the context of a
single thread.


git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb-new@10334 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-27 01:27:21 +00:00
Jim Paris
8da7de817c Update TODO 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb-new@10332 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-26 00:14:16 +00:00
Jim Paris
acdea5f00b Integrated CherryPy server into tree 
Added testing framework for cherrypy server.
Added tests for basic server functionality.


git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb-new@10331 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-26 00:13:44 +00:00
Jim Paris
6c9cf198d7 indexing 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb-new@10330 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-23 21:07:59 +00:00
Jim Paris
5fa3ff9610 TODO, and ignore stuff 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb-new@10329 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-23 20:38:37 +00:00
Jim Paris
35a801d997 Don't include the test database 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb-new@10328 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-23 20:38:01 +00:00
Jim Paris
a3634c468f Misc 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb-new@10327 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-23 00:59:17 +00:00
Jim Paris
dfaeddefa2 Mics 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb-new@10326 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-23 00:40:48 +00:00
Jim Paris
e1d827e246 new 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10325 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-21 23:46:13 +00:00
Jim Paris
3e703ea9ed nilmdb server, connector 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10324 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-21 22:39:51 +00:00
Jim Paris
211b652f8c misc 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@10323 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2012-01-20 22:41:32 +00:00
Jim Paris
2f4802a2a8 asdf 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9743 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-07-01 18:59:26 +00:00
Jim Paris
33be62a8c5 add read binary speed tests 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9736 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-06-27 17:31:53 +00:00
Jim Paris
9f9636c201 ignore generated files 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9735 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-06-27 17:10:59 +00:00
Jim Paris
11d9f9d6e5 add read/writebinary tests 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9734 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-06-27 17:10:49 +00:00
Jim Paris
b4a0f737f5 misc updates 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9733 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-06-27 16:35:18 +00:00
Jim Paris
f02f6c69ee update todo a bit 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9681 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-06-01 20:07:26 +00:00
Jim Paris
5fcdefd824 add some speed tests for reading ASCII files 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9680 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-06-01 20:04:13 +00:00
Jim Paris
5784468693 misc updates 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9679 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-06-01 18:18:09 +00:00
Jim Paris
b0ed5d7616 This is broken -- need to either keep overriding __setattr__, or...? 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9349 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-03-06 21:38:09 +00:00
Jim Paris
8c53d338df Minor coverage fixups 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9339 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-03-04 00:32:20 +00:00
Jim Paris
75c1851d55 some todo 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9299 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-02-24 23:54:16 +00:00
Jim Paris
35c933dd0b Add basic fileinterval & do tests 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9298 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-02-24 23:19:00 +00:00
Jim Paris
22c8b08523 Misc 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9297 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-02-24 22:48:09 +00:00
Jim Paris
0e800f24e8 Remove src dir 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9296 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-02-24 21:01:03 +00:00
Jim Paris
2c8b80b2ca Remove Interval.merge() because we likely can't merge interval 
metadata in the future.

Add Interval.subset() which we SHOULD be able to do (just keep track
of an offset/length as a subset of the original interval data)

Since we don't have merge, remove IntervalSet._optimized_copy()

Since we don't have _optimized_copy, add Interval.adjacent() and fix
__eq__ to use that instead.



git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9283 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-02-18 20:53:41 +00:00
Jim Paris
c011907e96 Update comments 
git-svn-id: https://bucket.mit.edu/svn/nilm/nilmdb@9281 ddd99763-3ecb-0310-9145-efcb8ce7c51f
 2011-02-17 23:25:12 +00:00