Conversation
|
those are really odd that they got in, probably during yesterday's commit of indentation fixes. anyway thanks, I'm merging these. |
|
txs, where are you located? |
|
Tel Aviv. You? |
|
same, cool! |
|
glad you're interested in this. BTW we're hosting a meetup about modules in a few weeks, I hope you'll attend. I think it's going to be in 18/7. |
|
sounds good. I have been working with Redis in production for about 2 years, now on sabbatical devoted almost exclusively to Redis. I am a Julia coder, right now undertaking massive refak of the Redis.jl package and will be issuing a RedisModules.jl soon after to interface with all these very cool modules, plus 2 modules that I am presently working on. My focus is streaming/online stats for online media and finance + nonstationarity TS modelling. I believe this could be a good contender in what is becoming a very competitive environment. |
|
you have a redislabs email? |
|
yep, dvir at ... |
|
sent a linked in invite, Yaakov Borstein |
…obal Config (#5137) * * move cursor limitation per index to be a configuration parameter * solve a bug where the coordinator would stop reading from internal cursors * * remove int return type for iterate callback functions, since their return value is ignored and has no real meaning. * * Code Review - Round #1 * * Code Review - Round #1, missing file change * * fix crash in testAggregate.py * * Code Review - Round #2 * * replace comma with a period * * if we somehow ended up with a closed channel, free the reply * Update src/config.c Co-authored-by: GuyAv46 <[email protected]> * Update src/cursor.c Co-authored-by: Omer Shadmi <[email protected]> * - fix channel test * - add logging for the broadcasting failure flow * - changed broadcast failure to be verbose instead of warning * Update tests/pytests/test_cursors.py Co-authored-by: Omer Shadmi <[email protected]> --------- Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Omer Shadmi <[email protected]>
…obal Config (#5137) * * move cursor limitation per index to be a configuration parameter * solve a bug where the coordinator would stop reading from internal cursors * * remove int return type for iterate callback functions, since their return value is ignored and has no real meaning. * * Code Review - Round #1 * * Code Review - Round #1, missing file change * * fix crash in testAggregate.py * * Code Review - Round #2 * * replace comma with a period * * if we somehow ended up with a closed channel, free the reply * Update src/config.c Co-authored-by: GuyAv46 <[email protected]> * Update src/cursor.c Co-authored-by: Omer Shadmi <[email protected]> * - fix channel test * - add logging for the broadcasting failure flow * - changed broadcast failure to be verbose instead of warning * Update tests/pytests/test_cursors.py Co-authored-by: Omer Shadmi <[email protected]> --------- Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Omer Shadmi <[email protected]> (cherry picked from commit 602fe76)
…obal Config (#5137) * * move cursor limitation per index to be a configuration parameter * solve a bug where the coordinator would stop reading from internal cursors * * remove int return type for iterate callback functions, since their return value is ignored and has no real meaning. * * Code Review - Round #1 * * Code Review - Round #1, missing file change * * fix crash in testAggregate.py * * Code Review - Round #2 * * replace comma with a period * * if we somehow ended up with a closed channel, free the reply * Update src/config.c Co-authored-by: GuyAv46 <[email protected]> * Update src/cursor.c Co-authored-by: Omer Shadmi <[email protected]> * - fix channel test * - add logging for the broadcasting failure flow * - changed broadcast failure to be verbose instead of warning * Update tests/pytests/test_cursors.py Co-authored-by: Omer Shadmi <[email protected]> --------- Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Omer Shadmi <[email protected]> (cherry picked from commit 602fe76)
…obal Config (#5137) * * move cursor limitation per index to be a configuration parameter * solve a bug where the coordinator would stop reading from internal cursors * * remove int return type for iterate callback functions, since their return value is ignored and has no real meaning. * * Code Review - Round #1 * * Code Review - Round #1, missing file change * * fix crash in testAggregate.py * * Code Review - Round #2 * * replace comma with a period * * if we somehow ended up with a closed channel, free the reply * Update src/config.c Co-authored-by: GuyAv46 <[email protected]> * Update src/cursor.c Co-authored-by: Omer Shadmi <[email protected]> * - fix channel test * - add logging for the broadcasting failure flow * - changed broadcast failure to be verbose instead of warning * Update tests/pytests/test_cursors.py Co-authored-by: Omer Shadmi <[email protected]> --------- Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Omer Shadmi <[email protected]> (cherry picked from commit 602fe76)
…obal Config (#5137) * * move cursor limitation per index to be a configuration parameter * solve a bug where the coordinator would stop reading from internal cursors * * remove int return type for iterate callback functions, since their return value is ignored and has no real meaning. * * Code Review - Round #1 * * Code Review - Round #1, missing file change * * fix crash in testAggregate.py * * Code Review - Round #2 * * replace comma with a period * * if we somehow ended up with a closed channel, free the reply * Update src/config.c Co-authored-by: GuyAv46 <[email protected]> * Update src/cursor.c Co-authored-by: Omer Shadmi <[email protected]> * - fix channel test * - add logging for the broadcasting failure flow * - changed broadcast failure to be verbose instead of warning * Update tests/pytests/test_cursors.py Co-authored-by: Omer Shadmi <[email protected]> --------- Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Omer Shadmi <[email protected]> (cherry picked from commit 602fe76)
…ugh Global Config (#5165) MOD-8009: Allow Users To Configure Cursor Index Limitation Through Global Config (#5137) * * move cursor limitation per index to be a configuration parameter * solve a bug where the coordinator would stop reading from internal cursors * * remove int return type for iterate callback functions, since their return value is ignored and has no real meaning. * * Code Review - Round #1 * * Code Review - Round #1, missing file change * * fix crash in testAggregate.py * * Code Review - Round #2 * * replace comma with a period * * if we somehow ended up with a closed channel, free the reply * Update src/config.c Co-authored-by: GuyAv46 <[email protected]> * Update src/cursor.c Co-authored-by: Omer Shadmi <[email protected]> * - fix channel test * - add logging for the broadcasting failure flow * - changed broadcast failure to be verbose instead of warning * Update tests/pytests/test_cursors.py Co-authored-by: Omer Shadmi <[email protected]> --------- Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Omer Shadmi <[email protected]> (cherry picked from commit 602fe76) Co-authored-by: kei-nan <[email protected]>
…ugh Global Config (#5167) * MOD-8009: Allow Users To Configure Cursor Index Limitation Through Global Config (#5137) * * move cursor limitation per index to be a configuration parameter * solve a bug where the coordinator would stop reading from internal cursors * * remove int return type for iterate callback functions, since their return value is ignored and has no real meaning. * * Code Review - Round #1 * * Code Review - Round #1, missing file change * * fix crash in testAggregate.py * * Code Review - Round #2 * * replace comma with a period * * if we somehow ended up with a closed channel, free the reply * Update src/config.c Co-authored-by: GuyAv46 <[email protected]> * Update src/cursor.c Co-authored-by: Omer Shadmi <[email protected]> * - fix channel test * - add logging for the broadcasting failure flow * - changed broadcast failure to be verbose instead of warning * Update tests/pytests/test_cursors.py Co-authored-by: Omer Shadmi <[email protected]> --------- Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Omer Shadmi <[email protected]> (cherry picked from commit 602fe76) * * fix config test
…ough Global Config (#5166) MOD-8009: Allow Users To Configure Cursor Index Limitation Through Global Config (#5137) * * move cursor limitation per index to be a configuration parameter * solve a bug where the coordinator would stop reading from internal cursors * * remove int return type for iterate callback functions, since their return value is ignored and has no real meaning. * * Code Review - Round #1 * * Code Review - Round #1, missing file change * * fix crash in testAggregate.py * * Code Review - Round #2 * * replace comma with a period * * if we somehow ended up with a closed channel, free the reply * Update src/config.c Co-authored-by: GuyAv46 <[email protected]> * Update src/cursor.c Co-authored-by: Omer Shadmi <[email protected]> * - fix channel test * - add logging for the broadcasting failure flow * - changed broadcast failure to be verbose instead of warning * Update tests/pytests/test_cursors.py Co-authored-by: Omer Shadmi <[email protected]> --------- Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Omer Shadmi <[email protected]> (cherry picked from commit 602fe76)
…ugh Global Config (#5168) * MOD-8009: Allow Users To Configure Cursor Index Limitation Through Global Config (#5137) * * move cursor limitation per index to be a configuration parameter * solve a bug where the coordinator would stop reading from internal cursors * * remove int return type for iterate callback functions, since their return value is ignored and has no real meaning. * * Code Review - Round #1 * * Code Review - Round #1, missing file change * * fix crash in testAggregate.py * * Code Review - Round #2 * * replace comma with a period * * if we somehow ended up with a closed channel, free the reply * Update src/config.c Co-authored-by: GuyAv46 <[email protected]> * Update src/cursor.c Co-authored-by: Omer Shadmi <[email protected]> * - fix channel test * - add logging for the broadcasting failure flow * - changed broadcast failure to be verbose instead of warning * Update tests/pytests/test_cursors.py Co-authored-by: Omer Shadmi <[email protected]> --------- Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Omer Shadmi <[email protected]> (cherry picked from commit 602fe76) * * use RSGlobalConfig.indexCursorLimit * * apply missing cherry-pick changes * * fix netCursorCallback callback return type * * code review comments + test crash fix * * fix remaining code review comments
* MOD-7864: initial commit * * modify object obfuscate api * * compilation fixes * * fix tests * * add query node obfuscation test * * Code Review - Round #1 * * add field path obfuscation * update tests * * Code Review - Round #2 * * Code Review - Round #3 * * Code Review - Round #4 * * add MAX_UNIQUE_ID_TEXT_LENGTH_UPPER_BOUND, compute it based on sizeof t_uniqueId * * add copyright
* MOD-7864: initial commit * * modify object obfuscate api * * compilation fixes * * fix tests * * add query node obfuscation test * * Code Review - Round #1 * * add field path obfuscation * update tests * * Code Review - Round #2 * * Code Review - Round #3 * * Code Review - Round #4 * * add MAX_UNIQUE_ID_TEXT_LENGTH_UPPER_BOUND, compute it based on sizeof t_uniqueId * * add copyright (cherry picked from commit 9235579)
MOD-7864: Obfuscation API (#5060) * MOD-7864: initial commit * * modify object obfuscate api * * compilation fixes * * fix tests * * add query node obfuscation test * * Code Review - Round #1 * * add field path obfuscation * update tests * * Code Review - Round #2 * * Code Review - Round #3 * * Code Review - Round #4 * * add MAX_UNIQUE_ID_TEXT_LENGTH_UPPER_BOUND, compute it based on sizeof t_uniqueId * * add copyright (cherry picked from commit 9235579) Co-authored-by: kei-nan <[email protected]>
…ing them as valid results (#4858) * * initial commit * * fix missing case in test_expire.py * * fix coord compilation * * fix doc info test * * try and fix some of the tests * * release iterator * * do not set expiration time in the context of the coordinator since it doesn't have an index spec * * support c++ tests that do not provide spec for iterators * * no point in passing timestamp in coordinator flow * * redis 7.4 version in ci is actually 7.3, for codecov we need our tests to run * * reduce max memory from + 200000 to 150000 * * fix test * * cleanup code * * Code Review: Round #1 * * Add geoshape tests, only pass index instead of pointer to filter ctx * * Add vector test * * Code Review - Round #2 * * try and fix tests * * Code Review - Round #3 * * Fix Sanitizer Build * * Code Review - Round #4 * * Minor change in debug command SET_MONITOR_EXPIRATION * * Code Review - Round #5 * * fix tests * * Code Review - Round #6 * * fix crash * * fix test * * improve field mask translation time * fix compilation * fix compilation error * handle field mask of 64 bit * * Code Review - Round #7 * * fix opening of key edge cases * * free fieldIdToIndex array * Code Review - Round #9 * * fix rebase conflicts * support wild card reader filtering * * mac os: fallback to CLOCK_REALTIME if CLOCK_REALTIME_COARSE is not defined (cherry picked from commit 4a67a87)
…ing them as valid results (#4858) * * initial commit * * fix missing case in test_expire.py * * fix coord compilation * * fix doc info test * * try and fix some of the tests * * release iterator * * do not set expiration time in the context of the coordinator since it doesn't have an index spec * * support c++ tests that do not provide spec for iterators * * no point in passing timestamp in coordinator flow * * redis 7.4 version in ci is actually 7.3, for codecov we need our tests to run * * reduce max memory from + 200000 to 150000 * * fix test * * cleanup code * * Code Review: Round #1 * * Add geoshape tests, only pass index instead of pointer to filter ctx * * Add vector test * * Code Review - Round #2 * * try and fix tests * * Code Review - Round #3 * * Fix Sanitizer Build * * Code Review - Round #4 * * Minor change in debug command SET_MONITOR_EXPIRATION * * Code Review - Round #5 * * fix tests * * Code Review - Round #6 * * fix crash * * fix test * * improve field mask translation time * fix compilation * fix compilation error * handle field mask of 64 bit * * Code Review - Round #7 * * fix opening of key edge cases * * free fieldIdToIndex array * Code Review - Round #9 * * fix rebase conflicts * support wild card reader filtering * * mac os: fallback to CLOCK_REALTIME if CLOCK_REALTIME_COARSE is not defined (cherry picked from commit 4a67a87)
…ing them as valid results (#4858) * * initial commit * * fix missing case in test_expire.py * * fix coord compilation * * fix doc info test * * try and fix some of the tests * * release iterator * * do not set expiration time in the context of the coordinator since it doesn't have an index spec * * support c++ tests that do not provide spec for iterators * * no point in passing timestamp in coordinator flow * * redis 7.4 version in ci is actually 7.3, for codecov we need our tests to run * * reduce max memory from + 200000 to 150000 * * fix test * * cleanup code * * Code Review: Round #1 * * Add geoshape tests, only pass index instead of pointer to filter ctx * * Add vector test * * Code Review - Round #2 * * try and fix tests * * Code Review - Round #3 * * Fix Sanitizer Build * * Code Review - Round #4 * * Minor change in debug command SET_MONITOR_EXPIRATION * * Code Review - Round #5 * * fix tests * * Code Review - Round #6 * * fix crash * * fix test * * improve field mask translation time * fix compilation * fix compilation error * handle field mask of 64 bit * * Code Review - Round #7 * * fix opening of key edge cases * * free fieldIdToIndex array * Code Review - Round #9 * * fix rebase conflicts * support wild card reader filtering * * mac os: fallback to CLOCK_REALTIME if CLOCK_REALTIME_COARSE is not defined (cherry picked from commit 4a67a87)
…ing them as valid results (#4858) * * initial commit * * fix missing case in test_expire.py * * fix coord compilation * * fix doc info test * * try and fix some of the tests * * release iterator * * do not set expiration time in the context of the coordinator since it doesn't have an index spec * * support c++ tests that do not provide spec for iterators * * no point in passing timestamp in coordinator flow * * redis 7.4 version in ci is actually 7.3, for codecov we need our tests to run * * reduce max memory from + 200000 to 150000 * * fix test * * cleanup code * * Code Review: Round #1 * * Add geoshape tests, only pass index instead of pointer to filter ctx * * Add vector test * * Code Review - Round #2 * * try and fix tests * * Code Review - Round #3 * * Fix Sanitizer Build * * Code Review - Round #4 * * Minor change in debug command SET_MONITOR_EXPIRATION * * Code Review - Round #5 * * fix tests * * Code Review - Round #6 * * fix crash * * fix test * * improve field mask translation time * fix compilation * fix compilation error * handle field mask of 64 bit * * Code Review - Round #7 * * fix opening of key edge cases * * free fieldIdToIndex array * Code Review - Round #9 * * fix rebase conflicts * support wild card reader filtering * * mac os: fallback to CLOCK_REALTIME if CLOCK_REALTIME_COARSE is not defined (cherry picked from commit 4a67a87)
…returning them as valid results (#5118) * MOD-7329: Determine if fields and documents are expired before returning them as valid results (#4858) * * initial commit * * fix missing case in test_expire.py * * fix coord compilation * * fix doc info test * * try and fix some of the tests * * release iterator * * do not set expiration time in the context of the coordinator since it doesn't have an index spec * * support c++ tests that do not provide spec for iterators * * no point in passing timestamp in coordinator flow * * redis 7.4 version in ci is actually 7.3, for codecov we need our tests to run * * reduce max memory from + 200000 to 150000 * * fix test * * cleanup code * * Code Review: Round #1 * * Add geoshape tests, only pass index instead of pointer to filter ctx * * Add vector test * * Code Review - Round #2 * * try and fix tests * * Code Review - Round #3 * * Fix Sanitizer Build * * Code Review - Round #4 * * Minor change in debug command SET_MONITOR_EXPIRATION * * Code Review - Round #5 * * fix tests * * Code Review - Round #6 * * fix crash * * fix test * * improve field mask translation time * fix compilation * fix compilation error * handle field mask of 64 bit * * Code Review - Round #7 * * fix opening of key edge cases * * free fieldIdToIndex array * Code Review - Round #9 * * fix rebase conflicts * support wild card reader filtering * * mac os: fallback to CLOCK_REALTIME if CLOCK_REALTIME_COARSE is not defined (cherry picked from commit 4a67a87) * MOD-7979: Protect Against RS_FIELDMASK_ALL Mask Edge Case (#5128) * * check mask edge case * * Code Review - Round #1 (cherry picked from commit 2c037bc) * [8.0] MOD-7976: Fix HFE Regression (#5336) MOD-7976: Fix HFE Regression (#5318) * * use new expiration API to avoid regression issues with HFE support when expiration isn't being used * * update sdk to get new hash field expiration API * * set monitorFieldExpiration default based on the existence of `RedisModule_HashFieldMinExpire` * * skip field expiration tests if below 8.0 API * * Code Review Comments * Prevent turning on the monitorFieldExpiration if the API does not exist * * move to run against redis 8.0 (cherry picked from commit bebdeb7) * * rebase fixes * * add REDISMODULE_OPEN_KEY_NOEFFECTS to OpenKey when loading json document * * fix for test_debug_commands.py
* MOD-7864: initial commit * * modify object obfuscate api * * compilation fixes * * fix tests * * add query node obfuscation test * * Code Review - Round #1 * * add field path obfuscation * update tests * * Code Review - Round #2 * * Code Review - Round #3 * * Code Review - Round #4 * * add MAX_UNIQUE_ID_TEXT_LENGTH_UPPER_BOUND, compute it based on sizeof t_uniqueId * * add copyright (cherry picked from commit 9235579)
* MOD-7864: initial commit * * modify object obfuscate api * * compilation fixes * * fix tests * * add query node obfuscation test * * Code Review - Round #1 * * add field path obfuscation * update tests * * Code Review - Round #2 * * Code Review - Round #3 * * Code Review - Round #4 * * add MAX_UNIQUE_ID_TEXT_LENGTH_UPPER_BOUND, compute it based on sizeof t_uniqueId * * add copyright (cherry picked from commit 9235579)
* MOD-7864: initial commit * * modify object obfuscate api * * compilation fixes * * fix tests * * add query node obfuscation test * * Code Review - Round #1 * * add field path obfuscation * update tests * * Code Review - Round #2 * * Code Review - Round #3 * * Code Review - Round #4 * * add MAX_UNIQUE_ID_TEXT_LENGTH_UPPER_BOUND, compute it based on sizeof t_uniqueId * * add copyright (cherry picked from commit 9235579)
MOD-7864: Obfuscation API (#5060) * MOD-7864: initial commit * * modify object obfuscate api * * compilation fixes * * fix tests * * add query node obfuscation test * * Code Review - Round #1 * * add field path obfuscation * update tests * * Code Review - Round #2 * * Code Review - Round #3 * * Code Review - Round #4 * * add MAX_UNIQUE_ID_TEXT_LENGTH_UPPER_BOUND, compute it based on sizeof t_uniqueId * * add copyright (cherry picked from commit 9235579)
* MOD-7864: Obfuscation API (#5060) * MOD-7864: initial commit * * modify object obfuscate api * * compilation fixes * * fix tests * * add query node obfuscation test * * Code Review - Round #1 * * add field path obfuscation * update tests * * Code Review - Round #2 * * Code Review - Round #3 * * Code Review - Round #4 * * add MAX_UNIQUE_ID_TEXT_LENGTH_UPPER_BOUND, compute it based on sizeof t_uniqueId * * add copyright (cherry picked from commit 9235579) * * fix compilation * * forward declare index spec in query_node.h * * fix test
* MOD-7864: Obfuscation API (#5060) * MOD-7864: initial commit * * modify object obfuscate api * * compilation fixes * * fix tests * * add query node obfuscation test * * Code Review - Round #1 * * add field path obfuscation * update tests * * Code Review - Round #2 * * Code Review - Round #3 * * Code Review - Round #4 * * add MAX_UNIQUE_ID_TEXT_LENGTH_UPPER_BOUND, compute it based on sizeof t_uniqueId * * add copyright (cherry picked from commit 9235579) * * fix compilation * * forward declare index spec in query_node.h * * compilation fix * * fix test
* cherry-pick and resolve conflicts (WIP) working currently build only wip: - tests - coord * running CI with pytest and unit tests (standalone) wip - coord * Changes to support coord build and pytest * fix enable assert, and mt build * Fix hiredis to include ssl, fix build for coverage , make sure COORD env var is respected * allow passing COORD=1 * align the bin output dir names with what is was * fix test flows * allow coord=1 * allow coord=1 FROM ENV VAR * fix MT_BUILD in coord and pass COORD var properly to pytests * pass COORD var properly #2 + use ./build for running pytests * build coord with san build extension module always * link statically to libstdc++ * Pass static-libstdc++ to linker * fix binary dirname for arm and build for apple * Pass QUICK config as build.sh requires * fox to support empty coord string * revert "quick=1" pass fix (will be handled in different PR) * Revert "Pass QUICK config as build.sh requires" This reverts commit 8c7b67c.
* Add numeric_range_tree crate (core data structure) * Address review feedback. * Address review feedback, round #2
I found a few minor issues that prevented compilation. Ran a few tests on the compiled module and seems to be fine.