Index index by Group index by Distribution index by Vendor index by creation date index by Name Mirrors Help

The search service can find package by either name (apache), provides(webserver), absolute file names (/usr/bin/apache), binaries (gprof) or shared libraries (libXm.so.2) in standard path. It does not support multiple arguments yet...

The System and Arch are optional added filters, for example System could be "redhat", "redhat-7.2", "mandrake" or "gnome", Arch could be "i386" or "src", etc. depending on your system.

System Arch

RPM resource llama-cpp-server

OpenAI API compatible server for llama-cpp. The server also serves an embedded web UI at http://HOST:PORT/ . Config: /etc/sysconfig/llama-server To test (wait until weights are loaded; /v1/chat/completions returns HTTP 503 {"error":{"message":"Loading model"}} until then — a 6–8B GGUF on GPU is typically ~1 minute): until curl -sf http://localhost:8080/health; do sleep 1; done curl http://localhost:8080/v1/chat/completions \ -H "Content-Type: application/json" \ -H "Authorization: Bearer $(grep ^API_KEY= /etc/sysconfig/llama-server 2>/dev/null |cut -d= -f2-)" \ -d '{"model":"any","messages":[{"role":"user","content":"Hello"}]}' Authorization must match API_KEY in /etc/sysconfig/llama-server (omit the header if API_KEY is unset). Apertus 1.0 (Instruct-2509) and Apertus 1.5 (swiss-ai/Apertus-v1.5-*) are both supported. 1.5 needs a matching mmproj GGUF for image/audio.

Found 1 sites for llama-cpp-server

Found 2 RPM for llama-cpp-server

PackageSummaryDistributionDownload
llama-cpp-server-b10549-1.aarch64.htmlOpenAI API compatible server for llama-cppOpenMandriva Cooker for aarch64llama-cpp-server-b10549-1.aarch64.rpm
llama-cpp-server-b10549-1.x86_64.htmlOpenAI API compatible server for llama-cppOpenMandriva Cooker for x86_64llama-cpp-server-b10549-1.x86_64.rpm

Generated by rpm2html 1.6

Fabrice Bellet