| Name : llama-cpp-devel
| |
| Version : b2879
| Vendor : Fedora Project
|
| Release : 7.fc41
| Date : 2024-06-10 12:44:41
|
| Group : Unspecified
| Source RPM : llama-cpp-b2879-7.fc41.src.rpm
|
| Size : 0.22 MB
| |
| Packager : Fedora Project
| |
| Summary : Port of Facebook\'s LLaMA model in C/C++
|
Description :
The main goal of llama.cpp is to run the LLaMA model using 4-bit
integer quantization on a MacBook
* Plain C/C++ implementation without dependencies
* Apple silicon first-class citizen - optimized via ARM NEON, Accelerate
and Metal frameworks
* AVX, AVX2 and AVX512 support for x86 architectures
* Mixed F16 / F32 precision
* 2-bit, 3-bit, 4-bit, 5-bit, 6-bit and 8-bit integer quantization support
* CUDA, Metal and OpenCL GPU backend support
The original implementation of llama.cpp was hacked in an evening.
Since then, the project has improved significantly thanks to many
contributions. This project is mainly for educational purposes and
serves as the main playground for developing new features for the
ggml library.
|
RPM found in directory: /vol/rzm3/linux-fedora-buffet/fedora/linux/development/41/Everything/x86_64/os/Packages/l |
