[MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR#6053
Merged
[MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR#6053
Conversation
Contributor
There was a problem hiding this comment.
Pull Request Overview
This PR updates the default configuration value for _BG_INDEX_MEM_PCT_THR from 80 to 100 in Redis, ensuring that production behavior now uses a 100% threshold while tests simulate a lower threshold (80%) as needed. Key changes include:
- Updating test expectations and configuration queries in tests/pytests/test_config.py.
- Adjusting memory limit helper functions in tests/pytests/common.py to use 100% as their default while tests explicitly pass 0.8 where a lower limit is required.
- Changing the default value in src/config.h and updating relevant help text in src/config.c.
Reviewed Changes
Copilot reviewed 6 out of 6 changed files in this pull request and generated no comments.
Show a summary per file
| File | Description |
|---|---|
| tests/pytests/test_index_oom.py | Adjusted tests to conditionally set the memory limit to 80% for simulating OOM cases. |
| tests/pytests/test_debug_commands.py | Updated OOM tests to pass 0.8 to helper functions after default config change. |
| tests/pytests/test_config.py | Updated expected default config value from 80 to 100. |
| tests/pytests/common.py | Modified default parameters for memory limit helper functions to 1.0 (100%). |
| src/config.h | Changed DEFAULT_INDEXING_MEMORY_LIMIT from 80 to 100. |
| src/config.c | Updated help text to reflect the new default of 100 percent. |
Comments suppressed due to low confidence (1)
tests/pytests/common.py:861
- The inline comment and default parameter now imply a 100% memory limit by default; consider updating the comment to explicitly state that the default value of memory_limit_per corresponds to 100%, ensuring clarity given that tests override this with 0.8 for OOM simulation.
def set_tight_maxmemory_for_oom(env, memory_limit_per = 1.0):
Codecov ReportAll modified and coverable lines are covered by tests ✅
Additional details and impacted files@@ Coverage Diff @@
## master #6053 +/- ##
==========================================
- Coverage 88.24% 88.24% -0.01%
==========================================
Files 220 220
Lines 39516 39516
Branches 2780 2780
==========================================
- Hits 34871 34870 -1
- Misses 4636 4637 +1
Partials 9 9
Flags with carried forward coverage won't be shown. Click here to find out more. ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
lerman25
commented
Apr 29, 2025
| @@ -11,42 +11,48 @@ | |||
|
|
|||
| @skip(cluster=True) | |||
| def test_stop_background_indexing_on_low_mem(env): | |||
Collaborator
Author
There was a problem hiding this comment.
Note that most of the test didn't change, I just fixed the indentation
alonre24
approved these changes
Apr 30, 2025
| {.name = "_BG_INDEX_MEM_PCT_THR", | ||
| .helpText = "Set the percentage of memory usage threshold (out of maxmemory) at which background indexing will stop. Once this limit is reached," | ||
| " any queries on the affected index will result in an error. The default is 80 percent.", | ||
| " any queries on the affected index will result in an error. The default is 100 percent.", |
Collaborator
There was a problem hiding this comment.
Remember to update the help text when we change the behavior
github-merge-queue
bot
removed this pull request from the merge queue due to failed status checks
redisearch-backport-pull-request bot
pushed a commit
that referenced
this pull request
May 6, 2025
* change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value (cherry picked from commit fc06756)
Contributor
|
Successfully created backport PR for |
github-merge-queue bot
pushed a commit
that referenced
this pull request
May 6, 2025
#6088) [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value (cherry picked from commit fc06756) Co-authored-by: lerman25 <[email protected]>
BenGoldberger
pushed a commit
that referenced
this pull request
May 7, 2025
* change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value
nafraf
pushed a commit
that referenced
this pull request
May 13, 2025
* change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value
github-merge-queue bot
pushed a commit
that referenced
this pull request
May 21, 2025
* add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml Co-authored-by: Tim Janus <[email protected]> --------- Co-authored-by: Tim Janus <[email protected]> * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]>
BenGoldberger
added a commit
that referenced
this pull request
May 21, 2025
* add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml Co-authored-by: Tim Janus <[email protected]> --------- Co-authored-by: Tim Janus <[email protected]> * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]>
BenGoldberger
added a commit
that referenced
this pull request
May 21, 2025
* add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml Co-authored-by: Tim Janus <[email protected]> --------- Co-authored-by: Tim Janus <[email protected]> * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]> (cherry picked from commit 035a8b4)
BenGoldberger
added a commit
that referenced
this pull request
May 21, 2025
* add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml Co-authored-by: Tim Janus <[email protected]> --------- Co-authored-by: Tim Janus <[email protected]> * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]> (cherry picked from commit 035a8b4)
BenGoldberger
added a commit
that referenced
this pull request
May 22, 2025
* add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml Co-authored-by: Tim Janus <[email protected]> --------- Co-authored-by: Tim Janus <[email protected]> * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]> (cherry picked from commit 035a8b4)
github-merge-queue bot
pushed a commit
that referenced
this pull request
May 22, 2025
Yield to redis while indexing - [MOD-9220] (#6103) * add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml --------- * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- (cherry picked from commit 035a8b4) Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]>
BenGoldberger
added a commit
that referenced
this pull request
May 22, 2025
* add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml Co-authored-by: Tim Janus <[email protected]> --------- Co-authored-by: Tim Janus <[email protected]> * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]> (cherry picked from commit 035a8b4)
github-merge-queue bot
pushed a commit
that referenced
this pull request
May 22, 2025
* Yield to redis while indexing - [MOD-9220] (#6103) * add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml Co-authored-by: Tim Janus <[email protected]> --------- Co-authored-by: Tim Janus <[email protected]> * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]> (cherry picked from commit 035a8b4) * fix missing NODEBUG_ERR --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]>
github-merge-queue bot
pushed a commit
that referenced
this pull request
May 22, 2025
* Yield to redis while indexing - [MOD-9220] (#6103) * add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml Co-authored-by: Tim Janus <[email protected]> --------- Co-authored-by: Tim Janus <[email protected]> * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]> (cherry picked from commit 035a8b4) * fix missing comma * fix debug command * fix RedisModule_Yield may not exist * undo * fix test --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]>
JoanFM
pushed a commit
that referenced
this pull request
May 27, 2025
* change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value
JoanFM
pushed a commit
that referenced
this pull request
May 27, 2025
* add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml Co-authored-by: Tim Janus <[email protected]> --------- Co-authored-by: Tim Janus <[email protected]> * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]>
JoanFM
pushed a commit
that referenced
this pull request
May 27, 2025
* change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value
JoanFM
pushed a commit
that referenced
this pull request
May 27, 2025
* add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml Co-authored-by: Tim Janus <[email protected]> --------- Co-authored-by: Tim Janus <[email protected]> * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]>
github-merge-queue bot
pushed a commit
that referenced
this pull request
May 28, 2025
* test config set doesnt effect other configs * change config setters and getters * handle isInverted * fix partial indexes tests * rename cluster_timeout * fix py test * refactor tests * mll change to test * Some cargo clippy fixes (#6122) Clippy fixes * Use the correct Rust profile for every task (#6128) * Compute coverage for Rust tests in CI (#6127) * restore macos-latest-xlarge (#6132) * CI - update release flow - [MOD-9681] (#6131) * change release flow to be triggered by a tag push * TEMP call this branch 3.2.1 * dummy content * fix branch validation * improve error message * revert temporary changes * improve message * [MOD-9694] Trie prefixes iterator (#6119) * Prefixes iterator * Align with C: do not track keys in the prefixes iterator * Compile arr.h as a standalone static library * Fix memory issue in bench * Add license header * Re-add tests for values iterator * Add another prefix benchmark using the full Gutenberg dataset. * [MOD-9693] IntoValues trie iterator. (#6129) IntoValues iterator * rockylinux:8 install python3.12 packages (#6147) rockylinux:8 install python3.12-devel * Fix linting failure on Rust LowMemoryThinVec drop implementation (#6146) replace `mem::replace` with `mem::take` * [master] [8.0] Remove -Werror linker flags [MOD-9624] (#6105) [8.0] Remove -Werror linker flags [MOD-9624] (#6104) * remove linker flag -werror * remove linker flag -werror - one more (cherry picked from commit 5688fcc) Co-authored-by: alonre24 <[email protected]> * Coverage Report Without `readies` - Phase 2 - [MOD-6711] (#5909) * WIP new coverage flow * move coverage logic to task-test.yml and build.sh * type change and rust test fixes * comment-out run_miri input * minor fixes and improvements * update file paths * fix build for coverage * remove redundancy * fix redis build * fix command * another attempt * fix * run against latest redis * fix coordinator env vars * add missing rust tests * don't run rust tests on sanitizer (for now) * attempt to fix coverage capture * attempt to fix rust sanitizer * attempt to fix the rust test instead * replace single quotes with double quotes * improve prints * remove quotes * attempt to fix unit-test paths * debug build on coverage * cleanups * Revert "MOD-8391: Report active threads-indexes upon crash (#5403)" This reverts commit 384a2f6. * Reapply "MOD-8391: Report active threads-indexes upon crash (#5403)" This reverts commit ed38b62. * better capture * add a tests extraction step for a unified flow in older versions * fix step to allow no-op * CI Improvements (#6153) * improvements * use job-based concurrency * notify benchmark failure only on push * improve job name * test notification * skip actual benchamrks * Revert "skip actual benchamrks" This reverts commit 59e8fb2. * Revert "test notification" This reverts commit 1661e0a. * re-implement notification condition with input * test * Revert "test" This reverts commit 80206ae. * cleanup * test recent changes * change and test * fix * cleanup * fixes * Add .cache to git ignore list (#6157) Seems clang creates a cache under this directory, so let's put it to git ignore list. * Remove base64 code from codebase (#6161) remove base64 code * [MOD-9372 , MOD-9733] Stop indexing OOM - Add wait before OOM (#6114) * Add config * insert oom_scan field to scanner, remove check for oom in debug pause on oom * fix comment * create basis for function * handle last scanned key * change sleep function name * Add pause before and after reset * Add pause before and after statuses code * Add pause before and after reset to bg scan * wait if config >0 * adjust default sleep time * fix last scanned key * temp tests * bsaic test strcuture * styling * Add scanner status strings * Add first test * Add update option for dbug scanner and more tests * remove scanner cancleation * Alter and Drop tests * spellcheck * skip cluster in tests * Add config test for new config * shortern tests * styling * remove pause on OOM from drop test * Add tests, style * style * style * Remove unused pause after OOM reset * debug commands tests and cluster tests * Naming, styling, formatting * rename, change structure for simplicity * improve test robustness * remove unused and move to better location * Ben comments round1 * Add 0 thresh test * comment * ADd skip cluster * change config and other Alon's comments * small tess * remove pause after Remove duplicates in tests * more test compression * fix assert * Temp disable coverage as required for CI to pass in PRs (#6166) temp to allow PRs * [MOD-9735] Track the number of unique keys in the trie. (#6156) Track the number of unique keys in the trie. * [MOD-9692] Wildcard trie iterator. (#6130) Wildcard trie iterator * Fix micro-benchmarking job on master branch (#6162) Fix workspace benching * Use the correct profile name for Rust debug builds (#6170) * Add More Diagnostics When Active Queries Are Not Empty (#6167) * initial commit * Apply suggestions from code review Co-authored-by: GuyAv46 <[email protected]> * code review comments * output the explain string for queries if hide user data from logs is off when dumping queries * fix typo * free allocated query string --------- Co-authored-by: GuyAv46 <[email protected]> * [MOD-9372 , MOD-9733] Stop indexing OOM - Add wait before OOM (#6114) * Add config * insert oom_scan field to scanner, remove check for oom in debug pause on oom * fix comment * create basis for function * handle last scanned key * change sleep function name * Add pause before and after reset * Add pause before and after statuses code * Add pause before and after reset to bg scan * wait if config >0 * adjust default sleep time * fix last scanned key * temp tests * bsaic test strcuture * styling * Add scanner status strings * Add first test * Add update option for dbug scanner and more tests * remove scanner cancleation * Alter and Drop tests * spellcheck * skip cluster in tests * Add config test for new config * shortern tests * styling * remove pause on OOM from drop test * Add tests, style * style * style * Remove unused pause after OOM reset * debug commands tests and cluster tests * Naming, styling, formatting * rename, change structure for simplicity * improve test robustness * remove unused and move to better location * Ben comments round1 * Add 0 thresh test * comment * ADd skip cluster * change config and other Alon's comments * small tess * remove pause after Remove duplicates in tests * more test compression * fix assert * mention BM25 as default scorer in README (#6165) * Yield to redis while indexing - [MOD-9220] (#6103) * add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml Co-authored-by: Tim Janus <[email protected]> --------- Co-authored-by: Tim Janus <[email protected]> * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]> * change config setters and getters * rename cluster_timeout * [MOD-9372 , MOD-9733] Stop indexing OOM - Add wait before OOM (#6114) * Add config * insert oom_scan field to scanner, remove check for oom in debug pause on oom * fix comment * create basis for function * handle last scanned key * change sleep function name * Add pause before and after reset * Add pause before and after statuses code * Add pause before and after reset to bg scan * wait if config >0 * adjust default sleep time * fix last scanned key * temp tests * bsaic test strcuture * styling * Add scanner status strings * Add first test * Add update option for dbug scanner and more tests * remove scanner cancleation * Alter and Drop tests * spellcheck * skip cluster in tests * Add config test for new config * shortern tests * styling * remove pause on OOM from drop test * Add tests, style * style * style * Remove unused pause after OOM reset * debug commands tests and cluster tests * Naming, styling, formatting * rename, change structure for simplicity * improve test robustness * remove unused and move to better location * Ben comments round1 * Add 0 thresh test * comment * ADd skip cluster * change config and other Alon's comments * small tess * remove pause after Remove duplicates in tests * more test compression * fix assert * pr changes * remove unwanted changes * dont change 'search-conn-per-shard' to max value, because it causes the test to be flaky * change 'search-conn-per-shard' maxvalue in test * change 'search-conn-per-shard' maxvalue in test --------- Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: meiravgri <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: nafraf <[email protected]> Co-authored-by: redisearch-backport-pull-request[bot] <182669528+redisearch-backport-pull-request[bot]@users.noreply.github.com> Co-authored-by: alonre24 <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: kei-nan <[email protected]> Co-authored-by: Joan Fontanals <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]>
BenGoldberger
added a commit
that referenced
this pull request
May 28, 2025
* test config set doesnt effect other configs * change config setters and getters * handle isInverted * fix partial indexes tests * rename cluster_timeout * fix py test * refactor tests * mll change to test * Some cargo clippy fixes (#6122) Clippy fixes * Use the correct Rust profile for every task (#6128) * Compute coverage for Rust tests in CI (#6127) * restore macos-latest-xlarge (#6132) * CI - update release flow - [MOD-9681] (#6131) * change release flow to be triggered by a tag push * TEMP call this branch 3.2.1 * dummy content * fix branch validation * improve error message * revert temporary changes * improve message * [MOD-9694] Trie prefixes iterator (#6119) * Prefixes iterator * Align with C: do not track keys in the prefixes iterator * Compile arr.h as a standalone static library * Fix memory issue in bench * Add license header * Re-add tests for values iterator * Add another prefix benchmark using the full Gutenberg dataset. * [MOD-9693] IntoValues trie iterator. (#6129) IntoValues iterator * rockylinux:8 install python3.12 packages (#6147) rockylinux:8 install python3.12-devel * Fix linting failure on Rust LowMemoryThinVec drop implementation (#6146) replace `mem::replace` with `mem::take` * [master] [8.0] Remove -Werror linker flags [MOD-9624] (#6105) [8.0] Remove -Werror linker flags [MOD-9624] (#6104) * remove linker flag -werror * remove linker flag -werror - one more (cherry picked from commit 5688fcc) Co-authored-by: alonre24 <[email protected]> * Coverage Report Without `readies` - Phase 2 - [MOD-6711] (#5909) * WIP new coverage flow * move coverage logic to task-test.yml and build.sh * type change and rust test fixes * comment-out run_miri input * minor fixes and improvements * update file paths * fix build for coverage * remove redundancy * fix redis build * fix command * another attempt * fix * run against latest redis * fix coordinator env vars * add missing rust tests * don't run rust tests on sanitizer (for now) * attempt to fix coverage capture * attempt to fix rust sanitizer * attempt to fix the rust test instead * replace single quotes with double quotes * improve prints * remove quotes * attempt to fix unit-test paths * debug build on coverage * cleanups * Revert "MOD-8391: Report active threads-indexes upon crash (#5403)" This reverts commit 384a2f6. * Reapply "MOD-8391: Report active threads-indexes upon crash (#5403)" This reverts commit ed38b62. * better capture * add a tests extraction step for a unified flow in older versions * fix step to allow no-op * CI Improvements (#6153) * improvements * use job-based concurrency * notify benchmark failure only on push * improve job name * test notification * skip actual benchamrks * Revert "skip actual benchamrks" This reverts commit 59e8fb2. * Revert "test notification" This reverts commit 1661e0a. * re-implement notification condition with input * test * Revert "test" This reverts commit 80206ae. * cleanup * test recent changes * change and test * fix * cleanup * fixes * Add .cache to git ignore list (#6157) Seems clang creates a cache under this directory, so let's put it to git ignore list. * Remove base64 code from codebase (#6161) remove base64 code * [MOD-9372 , MOD-9733] Stop indexing OOM - Add wait before OOM (#6114) * Add config * insert oom_scan field to scanner, remove check for oom in debug pause on oom * fix comment * create basis for function * handle last scanned key * change sleep function name * Add pause before and after reset * Add pause before and after statuses code * Add pause before and after reset to bg scan * wait if config >0 * adjust default sleep time * fix last scanned key * temp tests * bsaic test strcuture * styling * Add scanner status strings * Add first test * Add update option for dbug scanner and more tests * remove scanner cancleation * Alter and Drop tests * spellcheck * skip cluster in tests * Add config test for new config * shortern tests * styling * remove pause on OOM from drop test * Add tests, style * style * style * Remove unused pause after OOM reset * debug commands tests and cluster tests * Naming, styling, formatting * rename, change structure for simplicity * improve test robustness * remove unused and move to better location * Ben comments round1 * Add 0 thresh test * comment * ADd skip cluster * change config and other Alon's comments * small tess * remove pause after Remove duplicates in tests * more test compression * fix assert * Temp disable coverage as required for CI to pass in PRs (#6166) temp to allow PRs * [MOD-9735] Track the number of unique keys in the trie. (#6156) Track the number of unique keys in the trie. * [MOD-9692] Wildcard trie iterator. (#6130) Wildcard trie iterator * Fix micro-benchmarking job on master branch (#6162) Fix workspace benching * Use the correct profile name for Rust debug builds (#6170) * Add More Diagnostics When Active Queries Are Not Empty (#6167) * initial commit * Apply suggestions from code review Co-authored-by: GuyAv46 <[email protected]> * code review comments * output the explain string for queries if hide user data from logs is off when dumping queries * fix typo * free allocated query string --------- Co-authored-by: GuyAv46 <[email protected]> * [MOD-9372 , MOD-9733] Stop indexing OOM - Add wait before OOM (#6114) * Add config * insert oom_scan field to scanner, remove check for oom in debug pause on oom * fix comment * create basis for function * handle last scanned key * change sleep function name * Add pause before and after reset * Add pause before and after statuses code * Add pause before and after reset to bg scan * wait if config >0 * adjust default sleep time * fix last scanned key * temp tests * bsaic test strcuture * styling * Add scanner status strings * Add first test * Add update option for dbug scanner and more tests * remove scanner cancleation * Alter and Drop tests * spellcheck * skip cluster in tests * Add config test for new config * shortern tests * styling * remove pause on OOM from drop test * Add tests, style * style * style * Remove unused pause after OOM reset * debug commands tests and cluster tests * Naming, styling, formatting * rename, change structure for simplicity * improve test robustness * remove unused and move to better location * Ben comments round1 * Add 0 thresh test * comment * ADd skip cluster * change config and other Alon's comments * small tess * remove pause after Remove duplicates in tests * more test compression * fix assert * mention BM25 as default scorer in README (#6165) * Yield to redis while indexing - [MOD-9220] (#6103) * add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml Co-authored-by: Tim Janus <[email protected]> --------- Co-authored-by: Tim Janus <[email protected]> * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]> * change config setters and getters * rename cluster_timeout * [MOD-9372 , MOD-9733] Stop indexing OOM - Add wait before OOM (#6114) * Add config * insert oom_scan field to scanner, remove check for oom in debug pause on oom * fix comment * create basis for function * handle last scanned key * change sleep function name * Add pause before and after reset * Add pause before and after statuses code * Add pause before and after reset to bg scan * wait if config >0 * adjust default sleep time * fix last scanned key * temp tests * bsaic test strcuture * styling * Add scanner status strings * Add first test * Add update option for dbug scanner and more tests * remove scanner cancleation * Alter and Drop tests * spellcheck * skip cluster in tests * Add config test for new config * shortern tests * styling * remove pause on OOM from drop test * Add tests, style * style * style * Remove unused pause after OOM reset * debug commands tests and cluster tests * Naming, styling, formatting * rename, change structure for simplicity * improve test robustness * remove unused and move to better location * Ben comments round1 * Add 0 thresh test * comment * ADd skip cluster * change config and other Alon's comments * small tess * remove pause after Remove duplicates in tests * more test compression * fix assert * pr changes * remove unwanted changes * dont change 'search-conn-per-shard' to max value, because it causes the test to be flaky * change 'search-conn-per-shard' maxvalue in test * change 'search-conn-per-shard' maxvalue in test --------- Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: meiravgri <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: nafraf <[email protected]> Co-authored-by: redisearch-backport-pull-request[bot] <182669528+redisearch-backport-pull-request[bot]@users.noreply.github.com> Co-authored-by: alonre24 <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: kei-nan <[email protected]> Co-authored-by: Joan Fontanals <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]> (cherry picked from commit fc03b3e)
github-merge-queue bot
pushed a commit
that referenced
this pull request
May 29, 2025
change config setters and getters - [MOD-9673] (#6151) * test config set doesnt effect other configs * change config setters and getters * handle isInverted * fix partial indexes tests * rename cluster_timeout * fix py test * refactor tests * mll change to test * Some cargo clippy fixes (#6122) Clippy fixes * Use the correct Rust profile for every task (#6128) * Compute coverage for Rust tests in CI (#6127) * restore macos-latest-xlarge (#6132) * CI - update release flow - [MOD-9681] (#6131) * change release flow to be triggered by a tag push * TEMP call this branch 3.2.1 * dummy content * fix branch validation * improve error message * revert temporary changes * improve message * [MOD-9694] Trie prefixes iterator (#6119) * Prefixes iterator * Align with C: do not track keys in the prefixes iterator * Compile arr.h as a standalone static library * Fix memory issue in bench * Add license header * Re-add tests for values iterator * Add another prefix benchmark using the full Gutenberg dataset. * [MOD-9693] IntoValues trie iterator. (#6129) IntoValues iterator * rockylinux:8 install python3.12 packages (#6147) rockylinux:8 install python3.12-devel * Fix linting failure on Rust LowMemoryThinVec drop implementation (#6146) replace `mem::replace` with `mem::take` * [master] [8.0] Remove -Werror linker flags [MOD-9624] (#6105) [8.0] Remove -Werror linker flags [MOD-9624] (#6104) * remove linker flag -werror * remove linker flag -werror - one more (cherry picked from commit 5688fcc) * Coverage Report Without `readies` - Phase 2 - [MOD-6711] (#5909) * WIP new coverage flow * move coverage logic to task-test.yml and build.sh * type change and rust test fixes * comment-out run_miri input * minor fixes and improvements * update file paths * fix build for coverage * remove redundancy * fix redis build * fix command * another attempt * fix * run against latest redis * fix coordinator env vars * add missing rust tests * don't run rust tests on sanitizer (for now) * attempt to fix coverage capture * attempt to fix rust sanitizer * attempt to fix the rust test instead * replace single quotes with double quotes * improve prints * remove quotes * attempt to fix unit-test paths * debug build on coverage * cleanups * Revert "MOD-8391: Report active threads-indexes upon crash (#5403)" This reverts commit 384a2f6. * Reapply "MOD-8391: Report active threads-indexes upon crash (#5403)" This reverts commit ed38b62. * better capture * add a tests extraction step for a unified flow in older versions * fix step to allow no-op * CI Improvements (#6153) * improvements * use job-based concurrency * notify benchmark failure only on push * improve job name * test notification * skip actual benchamrks * Revert "skip actual benchamrks" This reverts commit 59e8fb2. * Revert "test notification" This reverts commit 1661e0a. * re-implement notification condition with input * test * Revert "test" This reverts commit 80206ae. * cleanup * test recent changes * change and test * fix * cleanup * fixes * Add .cache to git ignore list (#6157) Seems clang creates a cache under this directory, so let's put it to git ignore list. * Remove base64 code from codebase (#6161) remove base64 code * [MOD-9372 , MOD-9733] Stop indexing OOM - Add wait before OOM (#6114) * Add config * insert oom_scan field to scanner, remove check for oom in debug pause on oom * fix comment * create basis for function * handle last scanned key * change sleep function name * Add pause before and after reset * Add pause before and after statuses code * Add pause before and after reset to bg scan * wait if config >0 * adjust default sleep time * fix last scanned key * temp tests * bsaic test strcuture * styling * Add scanner status strings * Add first test * Add update option for dbug scanner and more tests * remove scanner cancleation * Alter and Drop tests * spellcheck * skip cluster in tests * Add config test for new config * shortern tests * styling * remove pause on OOM from drop test * Add tests, style * style * style * Remove unused pause after OOM reset * debug commands tests and cluster tests * Naming, styling, formatting * rename, change structure for simplicity * improve test robustness * remove unused and move to better location * Ben comments round1 * Add 0 thresh test * comment * ADd skip cluster * change config and other Alon's comments * small tess * remove pause after Remove duplicates in tests * more test compression * fix assert * Temp disable coverage as required for CI to pass in PRs (#6166) temp to allow PRs * [MOD-9735] Track the number of unique keys in the trie. (#6156) Track the number of unique keys in the trie. * [MOD-9692] Wildcard trie iterator. (#6130) Wildcard trie iterator * Fix micro-benchmarking job on master branch (#6162) Fix workspace benching * Use the correct profile name for Rust debug builds (#6170) * Add More Diagnostics When Active Queries Are Not Empty (#6167) * initial commit * Apply suggestions from code review * code review comments * output the explain string for queries if hide user data from logs is off when dumping queries * fix typo * free allocated query string --------- * [MOD-9372 , MOD-9733] Stop indexing OOM - Add wait before OOM (#6114) * Add config * insert oom_scan field to scanner, remove check for oom in debug pause on oom * fix comment * create basis for function * handle last scanned key * change sleep function name * Add pause before and after reset * Add pause before and after statuses code * Add pause before and after reset to bg scan * wait if config >0 * adjust default sleep time * fix last scanned key * temp tests * bsaic test strcuture * styling * Add scanner status strings * Add first test * Add update option for dbug scanner and more tests * remove scanner cancleation * Alter and Drop tests * spellcheck * skip cluster in tests * Add config test for new config * shortern tests * styling * remove pause on OOM from drop test * Add tests, style * style * style * Remove unused pause after OOM reset * debug commands tests and cluster tests * Naming, styling, formatting * rename, change structure for simplicity * improve test robustness * remove unused and move to better location * Ben comments round1 * Add 0 thresh test * comment * ADd skip cluster * change config and other Alon's comments * small tess * remove pause after Remove duplicates in tests * more test compression * fix assert * mention BM25 as default scorer in README (#6165) * Yield to redis while indexing - [MOD-9220] (#6103) * add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml --------- * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- * change config setters and getters * rename cluster_timeout * [MOD-9372 , MOD-9733] Stop indexing OOM - Add wait before OOM (#6114) * Add config * insert oom_scan field to scanner, remove check for oom in debug pause on oom * fix comment * create basis for function * handle last scanned key * change sleep function name * Add pause before and after reset * Add pause before and after statuses code * Add pause before and after reset to bg scan * wait if config >0 * adjust default sleep time * fix last scanned key * temp tests * bsaic test strcuture * styling * Add scanner status strings * Add first test * Add update option for dbug scanner and more tests * remove scanner cancleation * Alter and Drop tests * spellcheck * skip cluster in tests * Add config test for new config * shortern tests * styling * remove pause on OOM from drop test * Add tests, style * style * style * Remove unused pause after OOM reset * debug commands tests and cluster tests * Naming, styling, formatting * rename, change structure for simplicity * improve test robustness * remove unused and move to better location * Ben comments round1 * Add 0 thresh test * comment * ADd skip cluster * change config and other Alon's comments * small tess * remove pause after Remove duplicates in tests * more test compression * fix assert * pr changes * remove unwanted changes * dont change 'search-conn-per-shard' to max value, because it causes the test to be flaky * change 'search-conn-per-shard' maxvalue in test * change 'search-conn-per-shard' maxvalue in test --------- (cherry picked from commit fc03b3e) Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: meiravgri <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: nafraf <[email protected]> Co-authored-by: redisearch-backport-pull-request[bot] <182669528+redisearch-backport-pull-request[bot]@users.noreply.github.com> Co-authored-by: alonre24 <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: kei-nan <[email protected]> Co-authored-by: Joan Fontanals <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]>
github-merge-queue bot
pushed a commit
that referenced
this pull request
Jun 3, 2025
* Yield to redis while indexing - [MOD-9220] (#6103) * add op-counter + config * Run all Rust benchmarks in the workspace (#6030) * Run all Rust benchmarks in the workspace * Allow forcing the run for micro-benchmarks * Fix bench run * Update .github/workflows/flow-micro-benchmarks.yml Co-authored-by: Tim Janus <[email protected]> --------- Co-authored-by: Tim Janus <[email protected]> * Fix Rust build after switching off readies (#6086) Fix Rust linking * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * Build unit tests without readies [MOD-9099] (#6082) * purge readeis from cmake. Use new build script instead of makefile * call script in CI * libuv * restore build folder * libuv * unit tests * pretty build.sh * pytest * fixed extension build error * Add profile flags + try pass linker flag properly (wip) * fix build and linkage + pytest + adjust json * small cleanup * Add pytz dep * bump googletest version, use same variant name as before * remove ld libs * Fix executable linker flags - build unit test properly. run unit tests with old "make unit-tests" way (until this is fixed via ./build.sh) * fix rust build via build.sh * fix san build * Set coverage flags and use the same bin dir for sanitizer (build it for debug) * update benchmark image for regression test * remove leftover * Build hiredis static * fix json env flag in CI * CR changes * Restore deleted files until unit tests are done as well, use boolean params * restore vecsim version * fix profile and fix build error * fix for profile * try fix mac build * fix unit tests for arm * Define boost dir * remove the policies * try fix the binroot for unit-tests * change dir name for arm * remove policy from hash as well * use clang in mac * try to set hardcoded clang * try to mimic readies in macos includes * try set CMAKE_OSX_DEPLOYMENT_TARGET * whitespace formatting * Set CC to clang in apple * try to export llvm * try set compiler in build script * use bin in path * try EXPORT properly with homebrew * remove setting bad path to clang * set clang path * update to llvm@18 * update c++ path * set compiler with LLVM env var * fix? * set proper link flags for mac * remove bsymbolic from hiredis * revert hiredis in non macos to how it was * clean stuff * cleanups * Fix the extract debug symbols command so it will work as before (required for packing properly) * update deps * fix for alpine * Refactor unit-tests script to not using readies WIP * revert vecsim accidental change * Fix script so it will work for sanitizer as well, address CR --------- Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> * Wrongly included the text of GPLv3 instead of AGPLv3 (#6089) * README.md - added no standalone released note (#6074) * Update README.md * Update README.md * Update README.md * small change to opcounter * debug command for yield counter + test * add config test * Update SECURITY.md (#6070) * Update SECURITY.md * Update SECURITY.md * Enforce license headers for Rust files (#6090) * A small binary to enforce license headers in all Rust files * Enforce license headers in CI * MOD-6151: Build without readies - simplify packing (#5908) * fix * change ramp version * fix macos * GHA3 * fix macos * fix maxos * fix * fix * fix * new * purge readies * double * typo * remove debug * shapshot * gp * go conflict * darwin to macos * Account for get-platform change, remove redundant mkdir, remove not used/used once variables * remove unused DEP_NAMES * remove unused function * remove un condition * improve pack_ramp * remove unused DEPS * macos * remove xtx * replace eprint * remove runn * replace realapth * Revert "remove xtx" This reverts commit 6efb895. * try remove xtx * remove NOP * remove NUMVER * without tmp * delete * remove eval * remove release * Assume SNAPSHOT=1 * remove SEMVER * fin * remove sbin/getver * Don't add unnecessary \n after the license header (#6095) Otherwise, `cargo fmt` fails on them. * [MOD-9547] Core trie iterators (#6016) * Basic iterators * Typo * Clean up API * Add tests for iterators * More comments * Fix warning for miri * Verify that all prefixed iterators agree with each other and match expectations * Test both lending and non-lending traversals * Clarify comment * Test the empty key case * Fix where bounds on traversal_filter * Add missing license headers * SSPLv1.txt - removed irrelevant text (#6097) * MOD-9612: Fix flaky test and change early timeout error message (#6100) * Fix flaky test AND change early timeout error message * Fix TimeLimit initialization * Add comment * remove deps changes * remove deps changes * fix a possibly new flaky test * temp fix for config * changes to use the config_cmd func * try to fix issue test * use cluster conn in test * handle num of yield with cluster * dont test with cluster * pr changes * move whitespace * add tag and geoshape idx * pr changes * changes to yield only while server is loading * and check if module function exist * remove white space * add wait_for_index in test * pr change rename config * change help text * add isLoading argument * check globally if loading with g_isLoading * pr change --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]> (cherry picked from commit 035a8b4) * fix debug commands * fix debug commands * fix RedisModule_Yield may not exist * fix redismodule.h to have yield declaration * remove skip * fix debug command args * fix tests * fix tests --------- Co-authored-by: Luca Palmieri <[email protected]> Co-authored-by: Tim Janus <[email protected]> Co-authored-by: lerman25 <[email protected]> Co-authored-by: alonre24 <[email protected]> Co-authored-by: DvirDukhan <[email protected]> Co-authored-by: GuyAv46 <[email protected]> Co-authored-by: Lior Kogan <[email protected]> Co-authored-by: Zeeshan Ali Khan <[email protected]> Co-authored-by: Raz Monsonego <[email protected]>
lerman25
added a commit
that referenced
this pull request
Jun 5, 2025
* change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value
github-merge-queue bot
pushed a commit
that referenced
this pull request
Jun 10, 2025
* MOD-8862: Add DebugCTX mechanism and DebugIndexesScanner (#5672) * Create dbg ctx and dbgIndScan * Fix * fixing mechanism and pytest * Add pause before scan mechanism and pytest * Revert "Add pause before scan mechanism and pytest" This reverts commit b842ce9. * Re-adding 'Add pause before scan mechanism and pytest' * fix testDebugHelp * fixing Guy's comment + skipping on cluster in pytest * Move volatile pause to BG scanner, move debug scanner flag to base IndexesScanner * fix pytest * thread safety * Cover more code * pause before scan coverage * fix - can't create a flow to reach 'Debug mode enabled but scanner is not a debug scanner' error * fixing Alon's comment * wrong arity check and comment on not used function * format * MOD-7795: Background indexing memory limitation & configuration * fix test * fix-test2 * fix flaky OOM tests MOD-9406 (#5941) * fix flaky * comment * change to ceil * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR (#6053) * change default value * change default value in config pytest * change index oom tests to lower value then new default * change debug commands tests to lower value then default value * change default value of set tight memory functions * 100testv1 * test default value * [MOD-9560] Change default config value for _BG_INDEX_MEM_PCT_THR * fix json * [MOD-9372 , MOD-9733] Stop indexing OOM - Add wait before OOM * skip query error test * fix typo * support different default values * change test config * fix config * skip non cluster * [MOD-9560] Revert marking index as faulty after reaching OOM * [MOD-9372] - Add GIL release in OOM wait * remove cargo * fix pytest
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Change the default value of _BG_INDEX_MEM_PCT_THR to 100% (Align to Redis behavior).
The pytests structure remains the same, with changing _BG_INDEX_MEM_PCT_THR to 80% at the start of each test.