New tutorial for 'pdal tindex create' and readers.tindex #4550
New tutorial for 'pdal tindex create' and readers.tindex #4550ibell13 wants to merge 4 commits intoPDAL:masterfrom
Conversation
commit 3a91939 Author: ibell13 <[email protected]> Date: Thu Nov 14 14:09:04 2024 -0600 add link in tutorial commit 3450dda Author: ibell13 <[email protected]> Date: Wed Nov 13 12:43:23 2024 -0600 add parquet format commit cc845ac Author: ibell13 <[email protected]> Date: Tue Nov 12 14:55:41 2024 -0600 tutorial - add images commit 5c2e4c6 Author: ibell13 <[email protected]> Date: Tue Nov 12 14:27:09 2024 -0600 tindex tutorial - draft 2 commit fe33e2d Author: ibell13 <[email protected]> Date: Thu Nov 7 23:26:49 2024 -0600 initial powershell additions commit ffbc849 Author: ibell13 <[email protected]> Date: Mon Nov 4 16:54:00 2024 -0600 _toc.yml: link tutorial commit 3e81991 Author: ibell13 <[email protected]> Date: Mon Nov 4 16:40:35 2024 -0600 new TIndex tutorial - draft
| implementation of the Apache Parquet format. | ||
|
|
||
| `tindex create` can take input from stdin (the -s flag) or a glob pattern | ||
| (the --filespec option). Filespec can read files from a local directory, using |
There was a problem hiding this comment.
put CLI arguments in <pre> sections.
doc/tutorial/tindex/index.md
Outdated
| pdal tindex create WI_Adams.gpkg -s < files.txt | ||
| ``` | ||
|
|
||
| For each of these files, an internal filter (a version of {ref}`filters.hexbin`) |
There was a problem hiding this comment.
why does the user care about an "internal filter"?
| $ pdal tindex create -s --tindex "WI_Adams_2019.parquet" -f Parquet \ | ||
| --readers.copc.threads=10 --readers.copc.resolution=10 \ | ||
| --lyr_name "WI_Adams_2019" --threads=8 --edge_length=20 \ | ||
| < files.txt |
There was a problem hiding this comment.
instead of files.txt, maybe have the user fetch the URLs from github directly via curl or something. The idea is to give them something they can just copy/paste and have working.
| --lyr_name "WI_Adams_2019" --threads=8 --edge_length=20 \ | ||
| < files.txt | ||
| ``` | ||
| ```{note} |
There was a problem hiding this comment.
Update this comment to state something to the effect that most of these threads are waiting for i/o over the network in our scenario, so it is possible to use quite a few of them. If you were running on local data, lots of threads might cause contention because most of them would be doing work instead of waiting on i/o.
|
picked up in #4599 |
2 participants
Made a new tutorial for some PDAL tile index workflows:
pdal tindex createWhen #4548 gets implemented, it could make some of the garbage I do to feed WKT into readers.tindex unnecessary; but right now I think that's the simplest way to do it.
Suggestions for clarification or improvement are welcome!