llama.cpp-vulkan (LLM inference in C/C++)

llama.cpp-vulkan:

Port of Facebook's LLaMA model in C/C++ with Vulkan GPU optimizations

llama.cpp-vulkan:

The main goal of llama.cpp is to enable LLM inference with minimal

setup and state-of-the-art performance on a wide range of hardware

locally and in the cloud.

llama.cpp-vulkan:

Home: https://github.com/ggml-org/llama.cpp

llama.cpp-vulkan:

llama.cpp-vulkan: