- Build or install llama.cpp and start a local server.
- Test an HTTP request without relying on a graphical interface.
- Record the model, port, context, and parameters used.
Minimal server
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build --config Release ./build/bin/llama-server \ -m models/modelo.gguf \ --host 127.0.0.1 \ --port 8080 \ -c 4096
Test with curl
curl http://127.0.0.1:8080/v1/chat/completions \
-H "Content-Type: application/json" \
-d '{
"model": "local-gguf",
"messages": [
{"role": "user", "content": "Explain what a queue is in MLOps AI in 3 sentences"}
],
"temperature": 0.2
}'Service manifest
servicio: llama-server-local modelo: models/modelo.gguf hash_modelo: sha256:... host: 127.0.0.1 puerto: 8080 contexto: 4096 cuantizacion: Q4_K_M uso: local development fecha: 2026-07-03