Skip to content

Conversation

@ggerganov
Copy link
Member

Add -embd 1 to llama-bench to benchmark embeddings computation

@ggerganov ggerganov requested a review from slaren March 7, 2024 14:22
@ggerganov ggerganov merged commit 6cdabe6 into master Mar 7, 2024
@ggerganov ggerganov deleted the gg/bench-embd branch March 7, 2024 14:32
hazelnutcloud pushed a commit to hazelnutcloud/llama.cpp that referenced this pull request Mar 10, 2024
* llama-bench : add embeddings option

* llama-bench : do not hard code embd default value

---------

Co-authored-by: slaren <[email protected]>
NeoZhangJianyu pushed a commit to NeoZhangJianyu/llama.cpp that referenced this pull request Mar 12, 2024
* llama-bench : add embeddings option

* llama-bench : do not hard code embd default value

---------

Co-authored-by: slaren <[email protected]>
jordankanter pushed a commit to jordankanter/llama.cpp that referenced this pull request Mar 13, 2024
* llama-bench : add embeddings option

* llama-bench : do not hard code embd default value

---------

Co-authored-by: slaren <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants