Local AI

Local RAG & Hardware Optimization

Running retrieval-augmented generation and quantized models entirely on a local Intel i9 / RTX 4070 Super workstation.

Role

Architecture, benchmarking and tuning

Stack

RAG · Model quantization · LM Studio · Open WebUI · AnythingLLM · Docker