llama.cpp

Setup llama.cpp

llama.cpp
├── compose.yaml
└── models
    └── sweep-next-edit-1.5b.q8_0.v2.gguf

The model can be downloaded from: https://huggingface.co/sweepai/sweep-next-edit-1.5B.