Similar to [this](https://github.com/abetlen/llama-cpp-python) repository for [llama-cpp](https://github.com/ggerganov/llama.cpp), is anyone aware of efforts to do the same for starcoder-cpp? More broadly, I'm looking for the best (and easiest) way to get starcoder-cpp to run with [Triton server](https://github.com/triton-inference-server/server). Thanks in advance!
Similar to this repository for llama-cpp, is anyone aware of efforts to do the same for starcoder-cpp?
More broadly, I'm looking for the best (and easiest) way to get starcoder-cpp to run with Triton server.
Thanks in advance!