Setup llama.cpp

llama.cpp
├── compose.yaml
└── models
    └── sweep-next-edit-1.5b.q8_0.v2.gguf

The model can be downloaded from: https://huggingface.co/sweepai/sweep-next-edit-1.5B.

• Download Ubuntu ARM64 install image from https://cdimage.ubuntu.com/ubuntu/releases/.

• Install virt-manager and QEMU system for arm:

  sudo apt install virt-manager qemu-efi-aarch64 qemu-system-arm