🤖 - Run LLMs on your laptop, entirely offline
👾 - Use models through the in-app Chat UI or an OpenAI compatible local server
📂 - Download any compatible model files from HuggingFace 🤗 repositories
🔠- Discover new & noteworthy LLMs in the app's home page
How is it going? I have playing with Llama (Meta's LLM) that supposedly has memory for conversations. Though, it doesn't know what time it is when asked. I haven't ported to run on Jetson Orin Nano yet, but that is the plan..
Going to download and have a play with this looks intresting.