52 Commits

Author SHA1 Message Date
Shane Bryldt
743a768a3f FS-9775: First round of integration of DHT into libblade, requires ongoing changes to DHT for proper exposure to blade level 2017-01-25 14:59:38 -06:00
Shane Bryldt
aaa13f3ba6 FS-9775: Tweaks, bug fixes, etc. Committing in preparation for introducing into libblade. 2017-01-25 14:59:38 -06:00
colm
66fdf5fa19 FS-9775: Implement serialization, deserialization & repopulation for dht table 2017-01-25 14:59:38 -06:00
Shane Bryldt
183116452b FS-9775: A bunch of stuff related to chaining multiple jobs, bug fixes, few other changes 2017-01-25 14:59:38 -06:00
colm
a698651018 FS-9775: DHT Repopulate empty buckets 2017-01-25 14:59:38 -06:00
colm
4a0132f7b7 FS-9775: DHT Process table timing changes & test cleanup 2017-01-25 14:59:38 -06:00
Shane Bryldt
c4ed130073 FS-9775: First tested pass on search functionality, not tested with deep searching at multiple levels 2017-01-25 14:59:38 -06:00
colm
58e48a54f0 FS-9775: Add flags to dhtrt_create_node (merge) 2017-01-25 14:59:38 -06:00
Shane Bryldt
5dfd6d1b8f FS-9775: Bug fixes and exposed interface changes while implementing tests for get/put which are functional and pass initial tests now. Deep searching needs to be revamped now to complete the full announcing process. 2017-01-25 14:59:38 -06:00
colm
4970c7e9a6 FS-9775: Exclude newly created nodes from find 2017-01-25 14:59:38 -06:00
colm
f6a2908ea8 FS-9775: Fix memory reuse. Remove redundant fields 2017-01-25 14:59:38 -06:00
colm
1aee27863f FS-9775: Format sources 2017-01-25 14:59:38 -06:00
colm
eac02b764b FS-9775: Implement deinit dht routetable 2017-01-25 14:59:38 -06:00
colm
59608400d1 FS-9775: Add sharelock api for dht nodes 2017-01-25 14:59:38 -06:00
colm
64a44ed3a5 FS-9775: Improve dht route table query performance 2017-01-25 14:59:37 -06:00
Shane Bryldt
8be2251b76 FS-9775: Started working on "put", ran into a bug in job states which is fixed now, adjusted find_node response to add nodes to the job 2017-01-25 14:59:37 -06:00
colm
4338c1b941 FS-9775: Drive ping logic from dhtrt_process_table 2017-01-25 14:59:37 -06:00
colm
51c1b7a719 FS-9775: Exclude non-active nodes from dhtrt_find_node 2017-01-25 14:59:37 -06:00
Shane Bryldt
41731d553a FS-9775: Overhauled query/response handling by implementing a reusable job system to handle the common plumbing 2017-01-25 14:59:37 -06:00
Shane Bryldt
767326b047 FS-9775: Search for both v4 and v6 should now be implemented, untested currently 2017-01-25 14:59:37 -06:00
colm
c2868dbf8a FS-9775: update dht bucket tests 2017-01-25 14:59:37 -06:00
colm
df61ab87bf FS-9775: initialize dht nodes as dubious 2017-01-25 14:59:36 -06:00
Anthony Minessale
d2f04e2133 make ks_pool_free appear take double pointer 2017-01-25 14:59:36 -06:00
Anthony Minessale
68e5321da0 regression from nolock mode 2017-01-25 14:59:36 -06:00
colm
aed03077ef FS-9775: Bucket synchronization fixes & Updated tests 2017-01-25 14:59:36 -06:00
Shane Bryldt
4517a511d5 FS-9775: Major cleanup around allocations, more work on search functionality, adjusted polling to reduce timeout when outgoing messages are pending 2017-01-25 14:59:36 -06:00
Shane Bryldt
e52a85eb8d FS-9775: Added initialization of threadpool, and switched parsing and processing of a received datagram to dispatch through the threadpool. Also a bit more work on searches sneaking in here. 2017-01-25 14:59:36 -06:00
Shane Bryldt
fe36139965 FS-9775: Started mocking out structures for ks_dht_search, but merged route table updates and updated the tests for current pending issues 2017-01-25 14:59:35 -06:00
colm
779592a9aa FS-9775: Updates for latest dht_bucket changes 2017-01-25 14:59:35 -06:00
Shane Bryldt
b88437fcbe FS-9775: Some cleanup, some commenting, some fixes. 2017-01-25 14:59:35 -06:00
Shane Bryldt
9e9adb8e4b FS-9775: Incorporated route table to test find_node before adding deep searching, but routetable bug is currently returning same values for all closest nodes results 2017-01-25 14:59:35 -06:00
Shane Bryldt
e56c388707 FS-9775: Adjusted to proper destructor pattern, cleaned up unneccessary zeroing in allocators, and reduced preallocs to use memset 2017-01-25 14:59:35 -06:00
colm
579e32013e FS-9775: add tests for dht buckets 2017-01-25 14:59:35 -06:00
Shane Bryldt
9e5121eb00 FS-9775: Changed local nodeid to be per endpoint, and removed ks_dht_node_t in preparation for changes based on route table discussions 2017-01-25 14:59:34 -06:00
Shane Bryldt
88ee82a380 FS-9775: Removed building of old dht code, renamed new dht code from dht2 to dht 2017-01-25 14:59:34 -06:00
Shane Bryldt
3e12cca293 FS-9775: Refactored sending of messages to utilize a more scalable and throttled queue for outgoing messages 2017-01-25 14:59:34 -06:00
Shane Bryldt
7ac7a7e75b FS-9775: Added support for removing finished transactions via latent purging while expiring
Also added support to send error message responses and updated the test to confirm, errors still need to be updated to send an error responses
2017-01-25 14:59:34 -06:00
Shane Bryldt
f95ca83b06 FS-9775: Fixed some bugs, unit test now successfully sends, processes, responds, and receives and validates a ping, more on this soon 2017-01-25 14:59:34 -06:00
Shane Bryldt
e4176f5873 FS-9775: Initial work towards sending messages, refactored into less headers, test updated 2017-01-25 14:59:33 -06:00
Shane Bryldt
ed8e4dc610 FS-9775: Renamed registries, added query registry with ping callback, unit test updated 2017-01-25 14:59:33 -06:00
Shane Bryldt
e9fdd9c946 FS-9775: Encapsulated message details into ks_dht2_message_t 2017-01-25 14:59:33 -06:00
Shane Bryldt
6eed8d3f94 FS-9775: Added initial registry for 'y' keys, and some unit testing 2017-01-25 14:59:33 -06:00
Shane Bryldt
f9ed958ecc FS-9775: Added some preliminary message processing, and unit testing for it 2017-01-25 14:59:33 -06:00
Shane Bryldt
2b3b2ef93d FS-9775: Added initial unit test of preliminary allocation, initialization and binding code 2017-01-25 14:59:33 -06:00
Anthony Minessale
b6df83dd10 FS-9820 #resolve [Add thread_pool to libks] 2016-12-06 16:46:08 -06:00
Anthony Minessale
a0180288cf FS-9803 #resolve [Add support for arbitrary data as hash keys] 2016-12-01 18:11:52 -06:00
Shane Bryldt
198a6debff FS-9767: Fixed the size of the keys to use crypto_sign_XXXXBYTES for proper key size
Also added parsing of identity in message_mutable to force directing test messages
which are now recieved by the designated peer
2016-11-23 20:20:26 +00:00
Mike Jerris
3ddaf0f269 cleanup new libks deleted files 2016-11-23 13:29:36 -06:00
Mike Jerris
9fd0b6bd2f update libks 2016-11-23 13:23:33 -06:00
Mike Jerris
6445012dd6 windows test program working 2015-09-04 16:37:49 -04:00