Notes on running local AIs

edit

an AI category

AI Engineering ∞  Notes on AI Machine Learning ☀  Notes on Self Hosting AI ☀  Hitchhiker's Guide to Local LLMs ☀  Notes on AI hardware vendors ☀  Local LLM Python Streamlit UI ☀  Graph Generalization using Functional Networks (GGUF) ☀  Compiling Python ☀  Steps to Build a Dialog-Wise Running AI RAG System ☀ 

edit

an AI category

AI Engineering ∞  Notes on AI Machine Learning ☀  Notes on Self Hosting AI ☀  Hitchhiker's Guide to Local LLMs ☀  Notes on AI hardware vendors ☀  Local LLM Python Streamlit UI ☀  Graph Generalization using Functional Networks (GGUF) ☀  Compiling Python ☀  Steps to Build a Dialog-Wise Running AI RAG System ☀ 

YouTube

• https://www.youtube.com/watch?v=WxYC9-hBM_g

Seven Ways of Running LLMs Locally

• https://kleiber.me/blog/2024/01/07/six-ways-running-llm-locally/

Coding Models

Win10 WLS prompt
ollama run deepseek-coder
 
https://ollama.com/library/deepseek-coder