chore: add local Phi-4 LLM server launcher for TCP testing
authorSvjatoslav Agejenko <svjatoslav@svjatoslav.eu>
Sat, 16 May 2026 23:48:38 +0000 (02:48 +0300)
committerSvjatoslav Agejenko <svjatoslav@svjatoslav.eu>
Sat, 16 May 2026 23:48:38 +0000 (02:48 +0300)
commit8b1fcb8d3dcf2963df1694b77db875c91d44c03e
tree8d8be376f57feb9045b56fd4cb4a8b997f402d34
parent52859da52ee57624c7231d2352c42046643584aa
chore: add local Phi-4 LLM server launcher for TCP testing

Add tools/llama-server-phi-4 script to start a fast local llama.cpp server\nwith the Phi-4 model (Q4_K_M, ~8.3 GiB) on port 8081.\n\nIntended for gradual transition to using LLM over TCP in the project.\nRuns at low priority with single slot and 16K context.
tools/llama-server-phi-4 [new file with mode: 0755]