Gentoo Portage Overlays - dev-cpp/llama-cpp

dev-cpp/llama-cpp

Port of Facebook's LLaMA model in C/C++

Screenshots

https://github.com/ggerganov/llama.cpp

llama-cpp-9999

~amd64

blas cublas lto tests tools rocm +amdgpu_targets_gfx906 +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx1030 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1100 amdgpu_targets_gfx1101 amdgpu_targets_gfx1102

View

Download

Browse License: MIT

Overlay: displacer

llama-cpp-0_pre4676

~amd64 ~x86 ~x86-macos ~x64-macos ~arm ~arm64 ~arm64-macos ~riscv ~loong

static lto test examples +server curl hbm android msvc +accelerate blas blis +llamafile cann musa cuda cuda_force_mmq cuda_force_cublas +cuda_unified_memory cuda_f16 cuda_no_peer_copy cuda_no_vmm cuda_fa_all_quants +cuda_graphs hip hip_graphs +hip_no_vmm hip_uma vulkan vulkan_check_results vulkan_debug vulkan_memory_debug vulkan_shader_debug_info vulkan_perf vulkan_validate vulkan_run_tests kompute +openmp rpc opencl opencl_profiling +opencl_embed_kernels +opencl_use_adreno_kernels metal metal_use_bf16 metal_ndebug metal_shader_debug +metal_embed_library +cpu cpu_native cpu_flags_x86_avx cpu_flags_x86_avx_vnni cpu_flags_x86_avx2 cpu_flags_x86_avx512 cpu_flags_x86_avx512_vbmi cpu_flags_x86_avx512_vnni cpu_flags_x86_avx512_bf16 cpu_flags_x86_fma cpu_flags_x86_f16c cpu_flags_x86_amx_tile cpu_flags_x86_amx_int8 cpu_flags_x86_amx_bf16 cpu_flags_x86_sse cpu_flags_x86_sse2 cpu_flags_x86_sse3 cpu_flags_x86_sse4 cpu_flags_x86_sse4a cpu_flags_x86_sse41 cpu_flags_x86_sse42 cpu_flags_x86_ssse3 cpu_flags_loong_lasx cpu_flags_loong_lsx cpu_flags_riscv_rvv abi_x86_32 abi_x86_64 abi_x86_x32 abi_mips_n32 abi_mips_n64 abi_mips_o32 abi_s390_32 abi_s390_64 +amdgpu_targets_gfx906 +amdgpu_targets_gfx908 +amdgpu_targets_gfx90a +amdgpu_targets_gfx942 +amdgpu_targets_gfx1030 +amdgpu_targets_gfx1100 amdgpu_targets_gfx803 amdgpu_targets_gfx900 amdgpu_targets_gfx940 amdgpu_targets_gfx941 amdgpu_targets_gfx1010 amdgpu_targets_gfx1011 amdgpu_targets_gfx1012 amdgpu_targets_gfx1031 amdgpu_targets_gfx1101 amdgpu_targets_gfx1102

View

Download

Browse License: MIT

Overlay: ex_repo

ChangeLog USE Flags Dependencies Reverse Deps Related Bugs

USE Flags

blas

Global: Adds support for the virtual/blas numerical library

cublas

* This flag is undocumented *

lto

Global: Add support for link-time optimizations (unsupported, use at your own risk).

tests

Global: Install test files

tools

Global: Create separate binary for script helper tools (currently only: versionsort); useful if they are called extremely often

rocm

* This flag is undocumented *

+amdgpu_targets_gfx906

* This flag is undocumented *

+amdgpu_targets_gfx908

* This flag is undocumented *

+amdgpu_targets_gfx90a

* This flag is undocumented *

+amdgpu_targets_gfx1030

* This flag is undocumented *

amdgpu_targets_gfx803

* This flag is undocumented *

amdgpu_targets_gfx900

* This flag is undocumented *

amdgpu_targets_gfx1010

* This flag is undocumented *

amdgpu_targets_gfx1011

* This flag is undocumented *

amdgpu_targets_gfx1012

* This flag is undocumented *

amdgpu_targets_gfx1031

* This flag is undocumented *

amdgpu_targets_gfx1100

* This flag is undocumented *

amdgpu_targets_gfx1101

* This flag is undocumented *

amdgpu_targets_gfx1102

* This flag is undocumented *

static

Global: !!do not set this during bootstrap!! Causes binaries to be statically linked instead of dynamically

test

Global: Workaround to pull in packages needed to run with FEATURES=test. Portage-2.1.2 handles this internally, so don't set it in make.conf/package.use anymore

examples

Global: Install examples, usually source code

+server

* This flag is undocumented *

curl

Global: Adds support for client-side URL transfer library

hbm

* This flag is undocumented *

android

* This flag is undocumented *

msvc

* This flag is undocumented *

+accelerate

* This flag is undocumented *

blis

* This flag is undocumented *

+llamafile

* This flag is undocumented *

cann

* This flag is undocumented *

musa

* This flag is undocumented *

cuda

Global: Build CUDA binaries.

cuda_force_mmq

* This flag is undocumented *

cuda_force_cublas

* This flag is undocumented *

+cuda_unified_memory

* This flag is undocumented *

cuda_f16

* This flag is undocumented *

cuda_no_peer_copy

* This flag is undocumented *

cuda_no_vmm

* This flag is undocumented *

cuda_fa_all_quants

* This flag is undocumented *

+cuda_graphs

* This flag is undocumented *

hip

* This flag is undocumented *

hip_graphs

* This flag is undocumented *

+hip_no_vmm

* This flag is undocumented *

hip_uma

* This flag is undocumented *

vulkan

* This flag is undocumented *

vulkan_check_results

* This flag is undocumented *

vulkan_debug

* This flag is undocumented *

vulkan_memory_debug

* This flag is undocumented *

vulkan_shader_debug_info

* This flag is undocumented *

vulkan_perf

* This flag is undocumented *

vulkan_validate

* This flag is undocumented *

vulkan_run_tests

* This flag is undocumented *

kompute

* This flag is undocumented *

+openmp

* This flag is undocumented *

rpc

Global: Enable quota interaction via RPC

opencl

Global: Build OpenCL binaries.

opencl_profiling

* This flag is undocumented *

+opencl_embed_kernels

* This flag is undocumented *

+opencl_use_adreno_kernels

* This flag is undocumented *

metal

* This flag is undocumented *

metal_use_bf16

* This flag is undocumented *

metal_ndebug

* This flag is undocumented *

metal_shader_debug

* This flag is undocumented *

+metal_embed_library

* This flag is undocumented *

+cpu

* This flag is undocumented *

cpu_native

* This flag is undocumented *

cpu_flags_x86_avx

* This flag is undocumented *

cpu_flags_x86_avx_vnni

* This flag is undocumented *

cpu_flags_x86_avx2

* This flag is undocumented *

cpu_flags_x86_avx512

* This flag is undocumented *

cpu_flags_x86_avx512_vbmi

* This flag is undocumented *

cpu_flags_x86_avx512_vnni

* This flag is undocumented *

cpu_flags_x86_avx512_bf16

* This flag is undocumented *

cpu_flags_x86_fma

* This flag is undocumented *

cpu_flags_x86_f16c

* This flag is undocumented *

cpu_flags_x86_amx_tile

* This flag is undocumented *

cpu_flags_x86_amx_int8

* This flag is undocumented *

cpu_flags_x86_amx_bf16

* This flag is undocumented *

cpu_flags_x86_sse

* This flag is undocumented *

cpu_flags_x86_sse2

* This flag is undocumented *

cpu_flags_x86_sse3

* This flag is undocumented *

cpu_flags_x86_sse4

* This flag is undocumented *

cpu_flags_x86_sse4a

* This flag is undocumented *

cpu_flags_x86_sse41

* This flag is undocumented *

cpu_flags_x86_sse42

* This flag is undocumented *

cpu_flags_x86_ssse3

* This flag is undocumented *

cpu_flags_loong_lasx

* This flag is undocumented *

cpu_flags_loong_lsx

* This flag is undocumented *

cpu_flags_riscv_rvv

* This flag is undocumented *

abi_x86_32

* This flag is undocumented *

abi_x86_64

* This flag is undocumented *

abi_x86_x32

* This flag is undocumented *

abi_mips_n32

* This flag is undocumented *

abi_mips_n64

* This flag is undocumented *

abi_mips_o32

* This flag is undocumented *

abi_s390_32

* This flag is undocumented *

abi_s390_64

* This flag is undocumented *

+amdgpu_targets_gfx942

* This flag is undocumented *

+amdgpu_targets_gfx1100

* This flag is undocumented *

amdgpu_targets_gfx940

* This flag is undocumented *

amdgpu_targets_gfx941

* This flag is undocumented *