I’m new to working with my Jetson Orin Nano 8gb development kit. I installed the latest jetpack 6 and docker and ran the setup and install scripts for the jetson-containers project on GitHub. However I can’t get text-generation-webui to run, no matter what I’ve tried. I’ve got ubuntu 22.04 running on a bootable 500gb ssd. I can run the docker container for the module but docker inspect shows an empty IP and port and I have no way to connect to the web app.
Running jetson-containers build text-generation-webui command generates a number of errors. I’ve posted a tail of the ouput below in the hopes that someone can explain the problem(s) and help me to work through them.
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 198, in _new_conn
sock = connection.create_connection(
File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 85, in create_connection
raise err
File "/usr/local/lib/python3.10/dist-packages/urllib3/util/connection.py", line 73, in create_connection
sock.connect(sa)
ConnectionRefusedError: [Errno 111] Connection refused
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 787, in urlopen
response = self._make_request(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 493, in _make_request
conn.request(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 494, in request
self.endheaders()
File "/usr/lib/python3.10/http/client.py", line 1278, in endheaders
self._send_output(message_body, encode_chunked=encode_chunked)
File "/usr/lib/python3.10/http/client.py", line 1038, in _send_output
self.send(msg)
File "/usr/lib/python3.10/http/client.py", line 976, in send
self.connect()
File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 325, in connect
self.sock = self._new_conn()
File "/usr/local/lib/python3.10/dist-packages/urllib3/connection.py", line 213, in _new_conn
raise NewConnectionError(
urllib3.exceptions.NewConnectionError: <urllib3.connection.HTTPConnection object at 0xffff86300880>: Failed to establish a new connection: [Errno 111] Connection refused
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 644, in send
resp = conn.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 871, in urlopen
return self.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 871, in urlopen
return self.urlopen(
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 871, in urlopen
return self.urlopen(
[Previous line repeated 2 more times]
File "/usr/local/lib/python3.10/dist-packages/urllib3/connectionpool.py", line 841, in urlopen
retries = retries.increment(
File "/usr/local/lib/python3.10/dist-packages/urllib3/util/retry.py", line 519, in increment
raise MaxRetryError(_pool, url, reason) from reason # type: ignore[arg-type]
urllib3.exceptions.MaxRetryError: HTTPConnectionPool(host='localhost', port=80): Max retries exceeded with url: /jp6/cu126 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0xffff86300880>: Failed to establish a new connection: [Errno 111] Connection refused'))
During handling of the above exception, another exception occurred:
Traceback (most recent call last):
File "/usr/local/bin/twine", line 7, in <module>
sys.exit(main())
File "/usr/local/lib/python3.10/dist-packages/twine/__main__.py", line 33, in main
error = cli.dispatch(sys.argv[1:])
File "/usr/local/lib/python3.10/dist-packages/twine/cli.py", line 139, in dispatch
return main(args.args)
File "/usr/local/lib/python3.10/dist-packages/twine/commands/upload.py", line 258, in main
return upload(upload_settings, parsed_args.dists)
File "/usr/local/lib/python3.10/dist-packages/twine/commands/upload.py", line 202, in upload
resp = repository.upload(package)
File "/usr/local/lib/python3.10/dist-packages/twine/repository.py", line 165, in upload
resp = self._upload(package)
File "/usr/local/lib/python3.10/dist-packages/twine/repository.py", line 151, in _upload
resp = self.session.post(
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 637, in post
return self.request("POST", url, data=data, json=json, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 589, in request
resp = self.send(prep, **send_kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/sessions.py", line 703, in send
r = adapter.send(request, **kwargs)
File "/usr/local/lib/python3.10/dist-packages/requests/adapters.py", line 677, in send
raise ConnectionError(e, request=request)
requests.exceptions.ConnectionError: HTTPConnectionPool(host='localhost', port=80): Max retries exceeded with url: /jp6/cu126 (Caused by NewConnectionError('<urllib3.connection.HTTPConnection object at 0xffff86300880>: Failed to establish a new connection: [Errno 111] Connection refused'))
failed to upload wheel to http://localhost/jp6/cu126
Installing nvidia-cutlass for Python 3.10
+ echo 'failed to upload wheel to http://localhost/jp6/cu126'
+ '[' 3.10 == 3.12 ']'
+ echo 'Installing nvidia-cutlass for Python 3.10'
+ python3 -c 'import cutlass'
Traceback (most recent call last):
File "<string>", line 1, in <module>
ModuleNotFoundError: No module named 'cutlass'
The command '/bin/sh -c /tmp/cutlass/install.sh || /tmp/cutlass/build.sh' returned a non-zero code: 1
[20:59:39] =====================================================================================
[20:59:39] =====================================================================================
[20:59:39] 💣 `jetson-containers build` failed after 1314.8 seconds (21.9 minutes)
[20:59:39] Error: Command 'DOCKER_BUILDKIT=0 docker build --network=host --tag text-generation-webui:r36.4.tegra-aarch64-cu126-22.04-cutlass --file /home/glenn/git/jetson-containers/packages/cuda/cutlass/Dockerfile --build-arg BASE_IMAGE=text-generation-webui:r36.4.tegra-aarch64-cu126-22.04-cuda-python --build-arg CUTLASS_VERSION="4.2.0" /home/glenn/git/jetson-containers/packages/cuda/cutlass 2>&1 | tee /home/glenn/git/jetson-containers/logs/20250826_203744/build/22o29_text-generation-webui_r36.4.tegra-aarch64-cu126-22.04-cutlass.txt; exit ${PIPESTATUS[0]}' returned non-zero exit status 1.
[20:59:39] =====================================================================================
[20:59:39] =====================================================================================
[20:59:39] Failed building: text-generation-webui