Air-gapped LLM assistant for a defence organisation
A retrieval assistant over decades of technical manuals, trial reports and maintenance logs — running entirely on-premises with no egress, and refusing to answer where it cannot cite a source.
- 95k+ documents indexed
- 0 bytes leaving the network
- 212/218 evaluation set passed
- Llama 3.1 70B
- vLLM
- pgvector
- FastAPI
- On-prem GPU