Topics tagged llama3-8b-instruct

Topic	Replies	Views	Activity
How to set dtype for NVIDIA NIM 3-8b? Models nim , llama3-8b-instruct	2	33	November 20, 2025
Langserve problem in Assessment, "Building RAG agents with LLMs" Forum Feedback dli , llama3-8b-instruct , nv-embed-v1	4	459	September 8, 2025
Building RAG Agents with LLMs assessment problems NVIDIA Nemotron llama3-8b-instruct , nv-embed-v1	2	182	June 6, 2025
AI Chatbot - Docker workflow Guide issue Container nemollm-inference-microservice V100 32GB X8 Deep Learning (Training & Inference) nim , llama3-8b-instruct	1	123	May 12, 2025
NIM Llama3 8B Instruct - Running container with "CUDA_ERROR_NO_DEVICE" cuDNN docker , nim , llama3-8b-instruct	1	101	March 28, 2025
NIM - Llama3-8b-Instruct - GPU resource usage is very high Models nim , llama3-8b-instruct	0	80	March 12, 2025
Building RAG Agents with LLMs stack with final test NVIDIA Nemotron llama3-8b-instruct , nv-embed-v1	2	173	March 10, 2025
Digital Humans Blueprint NVIDIA Blueprints audio2face , nim , llama3-8b-instruct , nv-embedqa-e5-v5 , blueprints	0	146	February 10, 2025
Batch processing using NVIDIA NIM \| Docker \| Self-hosted Models python , nim , llama3-8b-instruct , llama-31-8b-instruct , llama	11	633	January 29, 2025
ChatNVIDIA: Exception: [403] Forbidden Invalid UAM response Models llama3-8b-instruct	8	699	January 16, 2025
Run nano_llm problem TensorRT jetson , llama3-8b-instruct , llama	0	53	January 1, 2025
Anyone else using meta/llama3-8b-instruct RUN ANYWHERE on Openshift? Models nim , llama3-8b-instruct	0	58	December 13, 2024
NIM with llama-3-8b models stuck without any error Models nim , llama3-8b-instruct , llama	0	205	November 15, 2024
Aunch NVIDIA NIM (llama3-8b-instruct) for LLMs locally Access/Accounts nim , llama3-8b-instruct	3	198	November 8, 2024
The intended usage of NIM_TENSOR_PARALLEL_SIZE Models nim , llama3-8b-instruct	2	140	October 30, 2024
LoRA swapping inference Llama-3.1-8b-instruct \| Exception: lora format could not be determined Models nim , llama3-8b-instruct , llama-31-8b-instruct , llama	4	263	October 22, 2024
Nemollm-inference-microservice failed to deploy Models nim , llama3-8b-instruct , llama	1	236	October 22, 2024
GPU REQUIRED FOR Meta/Llama3-8b-instruct Microsoft Azure Image llama3-8b-instruct	0	92	October 8, 2024
NVIDIA NIM Container with CUDA out of Memory Problem Docker and NVIDIA Docker cuda , ubuntu , docker , nim , llama3-8b-instruct	2	699	September 20, 2024
Problem with installation of Llama 3.1 8b NIM Models nim , llama3-8b-instruct , llama-31-8b-instruct , llama	1	652	September 4, 2024
Issues while starting NIM container in A10 VM Models nim , llama3-8b-instruct	4	236	September 4, 2024
Issue with genai-perf for muliti-lora on NIM Models nim , llama3-8b-instruct , llama	3	143	September 3, 2024
Multi-LoRA with LLAMA 3 NIM is not listed in API Models nim , llama3-8b-instruct , llama	2	162	August 21, 2024
Getting Started With NVIDIA NIM Tutorial Issues with NGC Registry Access/Accounts ubuntu , nim , llm , llama3-8b-instruct	7	1984	July 24, 2024