Skip to content

Option --storage-gcs-keep-local true does not retain remote outputs locally #56

@tadasbar

Description

@tadasbar

The option --storage-gcs-keep-local true does not work - remote outputs are not kept locally.

A minimal example:

Snakefile:

rule all:
  output:
    touch("keep_local_test.txt")

Command:

snakemake \
  --storage-gcs-project $GCLOUD_PROJECT \
  --default-storage-provider gcs \
  --storage-gcs-keep-local true \
  --default-storage-prefix gs://${BUCKET_NAME}/output/snakemake8_test \
  --force keep_local_test.txt

The issue - the remote file should be present locally, but is not:

$ ls .snakemake/storage/gcs/${BUCKET_NAME}/output/snakemake8_test/keep_local_test.txt
ls: cannot access '.snakemake/storage/gcs/<...>/output/snakemake8_test/keep_local_test.txt': No such file or directory
$ gsutil ls gs://${BUCKET_NAME}/output/snakemake8_test/keep_local_test.txt
gs://<...>/output/snakemake8_test/keep_local_test.txt

Package versions:

- snakemake=8.29.2
- snakemake-storage-plugin-gcs=1.1.2
- snakemake-executor-plugin-googlebatch=0.5.0

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

Status

Done

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions