feat(server): Remove temperature bounds checks for server. Closes #1384

abetlen · abetlen · commit 0a454bebe67d · 2024-05-03T15:23:06.000-04:00
diff --git a/llama_cpp/server/types.py b/llama_cpp/server/types.py
@@ -18,8 +18,6 @@
 
 temperature_field = Field(
     default=0.8,
-    ge=0.0,
-    le=2.0,
     description="Adjust the randomness of the generated text.\n\n"
     + "Temperature is a hyperparameter that controls the randomness of the generated text. It affects the probability distribution of the model's output tokens. A higher temperature (e.g., 1.5) makes the output more random and creative, while a lower temperature (e.g., 0.5) makes the output more focused, deterministic, and conservative. The default value is 0.8, which provides a balance between randomness and determinism. At the extreme, a temperature of 0 will always pick the most likely next token, leading to identical outputs in each run.",
 )

Original file line number	Diff line number	Diff line change
`@@ -18,8 +18,6 @@`
`18`	`18`
`19`	`19`	`temperature_field = Field(`
`20`	`20`	`default=0.8,`
`21`		`- ge=0.0,`
`22`		`- le=2.0,`
`23`	`21`	`description="Adjust the randomness of the generated text.\n\n"`
`24`	`22`	+ "Temperature is a hyperparameter that controls the randomness of the generated text. It affects the probability distribution of the model's output tokens. A higher temperature (e.g., 1.5) makes the output more random and creative, while a lower temperature (e.g., 0.5) makes the output more focused, deterministic, and conservative. The default value is 0.8, which provides a balance between randomness and determinism. At the extreme, a temperature of 0 will always pick the most likely next token, leading to identical outputs in each run.",
`25`	`23`	`)`