llama.cpp
A lightweight, performant C++ library for creating and manipulating linear algebra data structures, such as matrices and vectors.
don't have tea/gui yet? download here
Copy the tea one-liner above into your terminal to install llama.cpp. tea will interpret the documentation and take care of any dependencies.