GitHub - sushanthr/RapidChat

Name		Name	Last commit message	Last commit date
Latest commit History 32 Commits
models		models
.gitignore		.gitignore
Llama Execute.txt		Llama Execute.txt
README.md		README.md
Send.svg		Send.svg
Style.css		Style.css
favicon.ico		favicon.ico
index.htm		index.htm
package-lock.json		package-lock.json
package.json		package.json
sampler.js		sampler.js

Repository files navigation

RapidChat

A quick prototype of client side inferencing in the browser. See https://sushanthr.github.io/RapidChat/

Model details

Original model - https://github.com/jzhang38/TinyLlama

This page however uses the quantized model from https://huggingface.co/shoibl/TinyLlama-Chat-v1.1-onnx_quantized.