1. /
  2. channels
  3. /
  4. repo
  5. /
  6. llama-cpp-turboquant
repo
public
1
Kevin Keller Conda Channel
Package icon
llama-cpp-turboquant
v0.0.8659
llama.cpp with TurboQuant KV cache compression (turbo2/3/4)

Install with Pixi

pixi add llama-cpp-turboquant

Install with conda

conda install -c https://prefix.dev/repo llama-cpp-turboquant

Description

Download counts

Loading chart data...

Version

0.0.8659

License

Platforms

linux-64
linux-aarch64
osx-arm64

Last Published

a month ago