Skip to content

Build_merge accepts only csv arguments #1804

@Ha-Ree

Description

@Ha-Ree

Step of lookup could run faster on larger files if allowed to use parquet (or other filetype in future)

Time spent on big csv file:

(platenv) ubuntu@ubuntu:~/GitHub/gemchina$ oasislmf model generate-keys -C /home/ubuntu/GitHub/gemchina/oasislmf-test-sr.json
2025-11-25 16:11:03,399 - oasislmf - INFO - COMPLETED: oasislmf.manager.interface in 24.81s

Time with same file as parquet:

(platenv) ubuntu@ubuntu:~/GitHub/gemchina$ oasislmf model generate-keys -C /home/ubuntu/GitHub/gemchina/oasislmf-test-sr.json
2025-11-25 16:10:12,327 - oasislmf - INFO - COMPLETED: oasislmf.manager.interface in 14.82s

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Status

Done

Relationships

None yet

Development

No branches or pull requests

Issue actions