ChatGPT AI chat model with Llama2, Workers AI Model, Hono.js and Wranger.

ChatGPT AI chat model with Llama2, Workers AI Model, Hono.js and Wranger.

This is a submission for the Cloudflare AI Challenge.

ChatGPT AI chat model with Llama2, Workers AI Model, Hono.js and Wranger.

What I Built

A ChatGPT app using llama-2-7b-chat-int8 model from Cloudflare. Implemented with Worker AI, Hono.js

Demo

Features:

History panel
Content Streaming
New Chat functionality

👉 Link to project

Link to the project

GitHub Code

Link to GitHub repo

Implementation

This app is built to function exactly like ChatGPT. You can ask questions and the app will generate a stream response. It has a history panel to track previous prompts, which is useful for tracking what you entered.

I used the following tools to accomplish this task.

**Llama A text generator language model

Hono.js: A web framework for Cloudflare Workers

Worker AI: To run machine learning models, on the Cloudflare network,

Leave a Reply

Your email address will not be published. Required fields are marked *