Text-generation-webui no webpage

Robotics & Edge Computing Jetson & Embedded Systems Jetson Orin Nano
1

Hello,

I followed the tutorial to get the text-generation-webui running on the Jetson Orin Nano. I meet the requirements and when I run
jetson-containers run $(autotag text-generation-webui)
no webpage even with

cd /opt/text-generation-webui && python3 server.py \
  --model-dir=/data/models/text-generation-webui \
  --chat \
  --listen

I have to say that there are a number of tutorials that are out of date or broken and this is very fustrating for someone to get started.

So why is the webpage not displaying on both the device and on the lan with port 7860, openwebui works fine.

3

Hi,

Do you have more info or error logs can share with us?

For Orin Nano, due to the limited memory, please try the 7B model and also run the memory optimization below:

Thanks.

4

That was done.
Now I am not getting any errors, other than the Web page does not open.
running

jetson-containers run $(autotag text-generation-webui)

Namespace(packages=[‘text-generation-webui’], prefer=[‘local’, ‘registry’, ‘build’], disable=[‘’], user=‘dustynv’, output=‘/tmp/autotag’, quiet=False, verbose=False)

-- L4T_VERSION=36.4.4 JETPACK_VERSION=6.2.1 CUDA_VERSION=12.6

-- Finding compatible container image for [‘text-generation-webui’]

text-generation-webui:r36.4.tegra-aarch64-cu126-22.04-xformers

V4L2_DEVICES:

### ARM64 architecture detected

### Jetson Detected

SYSTEM_ARCH=tegra-aarch64

+ docker run --runtime nvidia --env NVIDIA_DRIVER_CAPABILITIES=compute,utility,graphics -it --rm --network host --shm-size=8g --volume /tmp/argus_socket:/tmp/argus_socket --volume /etc/enctune.conf:/etc/enctune.conf --volume /etc/nv_tegra_release:/etc/nv_tegra_release --volume /tmp/nv_jetson_model:/tmp/nv_jetson_model --volume /var/run/dbus:/var/run/dbus --volume /var/run/avahi-daemon/socket:/var/run/avahi-daemon/socket --volume /var/run/docker.sock:/var/run/docker.sock --volume /home/coperai/jetson-containers/data:/data -v /etc/localtime:/etc/localtime:ro -v /etc/timezone:/etc/timezone:ro --device /dev/snd -e PULSE_SERVER=unix:/run/user/1000/pulse/native -v /run/user/1000/pulse:/run/user/1000/pulse --device /dev/bus/usb --device /dev/i2c-0 --device /dev/i2c-1 --device /dev/i2c-2 --device /dev/i2c-4 --device /dev/i2c-5 --device /dev/i2c-7 --device /dev/i2c-9 --name jetson_container_20251002_191509 text-generation-webui:r36.4.tegra-aarch64-cu126-22.04-xformers

I finally got it running, but it did not install on the SSD and instead it installed it on the SD card and that is completely full. I had followed the tutorial to have everything on the ssd.

5

Hi,

Do you mean the text-generation-webui container can work correctly after using external ssd?

Thanks.

6

No, I thought that the tutorial to have everything on the SDD, Except the OS would installed on the SSD and not the SD Card.

7

Hi,

You can find some setup tutorials in the link below:

Storage

  • microSD card (64GB or bigger)
  • NVMe SSD (Optional, but highly recommended for following tutorials on this site)

Thanks.

8

I exactly follow that tutorial.

10

Hi,

It looks like the container isn’t built completely in your environment.
Could you rebuild it again?

jetson-containers build $(autotag text-generation-webui)

Or you can find a similar container that we built for r36.4.4 in the link below:

Thanks

11

I have downgraded to r36.4.3 because there was a leak with the latest version. Also I can not install CUDA!!!

12

Hi,

CUDA can be installed with the apt tool.

$ sudo apt update
$ sudo apt install nvidia-cuda-dev

Do you meet any errors when running the above commands?
Thanks

13

Is this still an issue to support? Any result can be shared?

14

I got the solution thru Reddit, are you an automated agent?

15

Glad to know it’s working, could you share the solution to the community? Thanks

17

This topic was automatically closed 14 days after the last reply. New replies are no longer allowed.