llama.cpp-vulkan (LLM inference in C/C++)

Port of Facebook's LLaMA model in C/C++ with Vulkan GPU optimizations

The main goal of llama.cpp is to enable LLM inference with minimal

setup and state-of-the-art performance on a wide range of hardware

locally and in the cloud.

Home: https://github.com/ggml-org/llama.cpp