Is your feature request related to a problem or challenge?
We have been running out of diskspace when running CI jobs
For example
Part of this is due to the fact that each binary that is created (example, test, etc) gets an entire
copy of the DataFusion codebase compiled into it.
For example, on my machine, after running ./ci/scripts/rust_example.sh each example binary is 50-60MB in size:
(venv) andrewlamb@Andrews-MacBook-Pro-3:~/Software/datafusion$ du -s -h target/ci/examples/
52M target/ci/examples/tracing
52M target/ci/examples/simple_udf
55M target/ci/examples/thread_pools
Describe the solution you'd like
Thus I think it will be helpful to reduce the number of examples
Describe alternatives you've considered
Two options, depending on the example:
- consolidate multiple examples into a single binary with subcommands
- Move some of the sort examples into the rustdocs closer to the code they are demonstrating
Tasks