Skip to content
anyai.fyi

TensorFold

Parallel decoding for Apple Silicon and NVIDIA GPUs. OpenAI-compatible API.

What it does

Parallel LLM decoding for Apple Silicon and NVIDIA GPUs, with an OpenAI-compatible API. Skip to content TensorFold. Inceptionmember Run itSpeedBenchmarksMia's LabHow it works GitHub X Apple Silicon + NVIDIA CUDA Run LLMs,Fast. Parallel decoding for Apple Silicon and NVIDIA GPUs. OpenAI-compatible API. CURLmacOS · Linux $curl -fsSL https://tensorfold.dev/install.sh | shCopy Start a modelCopy .

Description: extracted from the tool's own website · reviewed by admin

Alternatives