examples · llama-cpp-bonsai · Tangled

llama-cpp-bonsai

llama.cpp fork for Ternary Bonsai 2 27B: MTP speculation, suffix cache reuse (SCR), q8 KV, two-slot fairness, fused DeltaNet kernels

llama-cpp-bonsai examples

30 folders · 12 files

bri-prism · speculative: stop plain drafter+target falling back to KV checkpoints (#173) · 1mo ago

libs : rename libcommon -> libllama-common (#21936)

examples : remove references to `make` in examples [no ci] (#15457)

convert-llama2c-to-ggml

fix: check gguf array type before reading (#27075)

common: fix missing exports in llama-common (#22340)

deprecation-warning

Fix locale-dependent float printing in GGUF metadata (#17331)

args: refactor mlock/mmap/directio into load-mode (#20834)

libs : rename libcommon -> libllama-common (#21936)

common: fix missing exports in llama-common (#22340)

server: add get_info tool (#26522)

Fix locale-dependent float printing in GGUF metadata (#17331)

build : fix xcframework + cmake clean-up (#27304)

libs : rename libcommon -> libllama-common (#21936)

llama-eval : fix crash when answer is None in HTML dump (#25435)

cmake : add install() for impl libraries + fix apple builds (#23511)

llama : deprecate llama_kv_self_ API (#14030)

libs : rename libcommon -> libllama-common (#21936)

llama : support multi-output backend sampling (#25532)

model-conversion

requirements: use stable torch packages on s390x (#26864)

libs : rename libcommon -> libllama-common (#21936)

libs : rename libcommon -> libllama-common (#21936)

libs : rename libcommon -> libllama-common (#21936)

metal: fix the im2col kernel/dispatch mismatch and add a wide-row set_rows (#118)

Fix locale-dependent float printing in GGUF metadata (#17331)

Fix locale-dependent float printing in GGUF metadata (#17331)

simple-cmake-pkg

examples : add missing code block end marker [no ci] (#17756)

llama : support multi-output backend sampling (#25532)

speculative-simple

speculative: stop plain drafter+target falling back to KV checkpoints (#173)

[SYCL] support OP OPT_STEP_ADAMW, OPT_STEP_SGD (#25268)

tests : replace personal home directory paths with generic placeholders (#27043)

args: refactor mlock/mmap/directio into load-mode (#20834)

metal: fix the im2col kernel/dispatch mismatch and add a wide-row set_rows (#118)

convert_legacy_llama.py

convert : minor fixes for numpy 2.x (#23571)

json_schema_pydantic_example.py

py : type-check all Python scripts with Pyright (#8341)

json_schema_to_grammar.py

common/json-schema-to-grammar : align spacing rules with parsers (#24835)

chore : correct typos [no ci] (#20041)

pydantic_models_to_grammar_examples.py

llama : move end-user examples to tools directory (#13249)

pydantic_models_to_grammar.py

ci : switch from pyright to ty (#20826)

scripts : make the shell scripts cross-platform (#14341)

regex_to_grammar.py

py : switch to snake_case (#8305)

llama : fix FA when KV cache is not used (i.e. embeddings) (#12825)

server-llama2-13B.sh

scripts : make the shell scripts cross-platform (#14341)

ts-type-to-grammar.sh

scripts : make the shell scripts cross-platform (#14341)