Skip to content

Commit 54f619d

Browse files
committed
fix: use openai client 1.76.0 in vllm_inference.py
The suggested 1.13.3 is incompatible with httpx 0.28.0 and higher. With Python 3.13.3, my `pip install openai==1.13.3` installed httpx 0.28.1. Then `python openai_compatible/client.py` failed with `TypeError: Client.__init__() got an unexpected keyword argument 'proxies'`. This is a bug in older versions of openai. It was first reported in openai/openai-python#1902 and fixed in openai/openai-python#1905 `pip install openai==1.76.0 && python openai_compatible/client.py` worked. Signed-off-by: David Xia <[email protected]>
1 parent a0474ed commit 54f619d

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

‎06_gpu_and_ml/llm-serving/vllm_inference.py‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -151,7 +151,7 @@ def serve():
151151
# to take it for a spin:
152152

153153
# ```bash
154-
# # pip install openai==1.13.3
154+
# # pip install openai==1.76.0
155155
# python openai_compatible/client.py
156156
# ```
157157

0 commit comments

Comments
 (0)