Skip to content

fix: Streamline gated models and fix LFM2 transformers versioning#224

Merged
HenryNdubuaku merged 2 commits into
cactus-compute:mainfrom
harshaljanjani:hf-token-and-optional-import
Nov 24, 2025
Merged

fix: Streamline gated models and fix LFM2 transformers versioning#224
HenryNdubuaku merged 2 commits into
cactus-compute:mainfrom
harshaljanjani:hf-token-and-optional-import

Conversation

@harshaljanjani

@harshaljanjani harshaljanjani commented Nov 24, 2025

Copy link
Copy Markdown
Contributor

→ Add --token CLI argument to support authentication for gated HuggingFace models like Gemma 3 to reduce user friction (Closes #197).

Before adding the inline token option (when the HF token is not exported):
Before adding the inline token option (when the HF token is not exported)
After adding the inline token option (when the HF token is not exported):
After adding the inline token option (when the HF token is not exported)

→ Make Lfm2VlForConditionalGeneration optional during import to prevent startup failures on older Transformers versions and avoid misleading “Please install required libraries with pip install transformers torch” errors when the libraries are already installed.

Before making the Lfm2VlForConditionalGeneration import optional (which caused a misleading error):
Before making the Lfm2VlForConditionalGeneration import optional
After making the Lfm2VlForConditionalGeneration import optional (preventing startup failures):
After making the Lfm2VlForConditionalGeneration import optional

cc: @HenryNdubuaku

HenryNdubuaku
HenryNdubuaku previously approved these changes Nov 24, 2025
Signed-off-by: HenryNdubuaku <[email protected]>
@HenryNdubuaku
HenryNdubuaku merged commit 79dba79 into cactus-compute:main Nov 24, 2025
1 check failed
@harshaljanjani
harshaljanjani deleted the hf-token-and-optional-import branch November 25, 2025 03:24
HenryNdubuaku added a commit that referenced this pull request Nov 27, 2025
* fix: Streamline gated models; fix LFM2 transformers versioning

* Clean up CLi and docs

Signed-off-by: HenryNdubuaku <[email protected]>

---------

Signed-off-by: HenryNdubuaku <[email protected]>
Co-authored-by: HenryNdubuaku <[email protected]>
HenryNdubuaku added a commit that referenced this pull request Nov 27, 2025
* fix: Streamline gated models; fix LFM2 transformers versioning

* Clean up CLi and docs

Signed-off-by: HenryNdubuaku <[email protected]>

---------

Signed-off-by: HenryNdubuaku <[email protected]>
Co-authored-by: HenryNdubuaku <[email protected]>
ncylich pushed a commit that referenced this pull request Feb 24, 2026
* fix: Streamline gated models; fix LFM2 transformers versioning

* Clean up CLi and docs

Signed-off-by: HenryNdubuaku <[email protected]>

---------

Signed-off-by: HenryNdubuaku <[email protected]>
Co-authored-by: HenryNdubuaku <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

hf_hub_download requires authentication for Gemma 3 models

2 participants