Discover ANY AI to make more online for less.

select between over 22,900 AI Tool and 17,900 AI News Posts.


GitHub - vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs
GitHub - vllm-project/vllm: A high-throughput and memory-efficient inference and serving engine for LLMs

A high-throughput and memory-efficient inference and serving engine for LLMs - vllm-project/vllm

Rating

Innovation

Pricing

Technology

Usability

We have discovered similar tools to what you are looking for. Check out our suggestions for similar AI tools.

GitHub - EricLBuehler/mistral.rs: Blazingly fast LLM inference.
GitHub - EricLBuehler/mistral.rs: Blazingly fast LLM inference.

Blazingly fast LLM inference. Contribute to EricLBuehler/mistral.rs development by creating an account on GitHub. [...]

Match Score: 32.09

GitHub - ggerganov/llama.cpp: LLM inference in C/C++
GitHub - ggerganov/llama.cpp: LLM inference in C/C++

LLM inference in C/C++. Contribute to ggerganov/llama.cpp development by creating an account on GitHub. [...]

Match Score: 32.09

GitHub · Build and ship software on a single, collaborative platform · GitHub
GitHub · Build and ship software on a single, collaborative platform · Gi

GitHub is where people build software. More than 100 million people use GitHub to discover, fork, and contribute to over 420 million projects. [...]

Match Score: 28.04

GitHub · Build and ship software on a single, collaborative platform · GitHub
GitHub · Build and ship software on a single, collaborative platform · Gi

GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects. [...]

Match Score: 28.04

GitHub Copilot ? Your AI pair programmer ? GitHub
GitHub Copilot ? Your AI pair programmer ? GitHub

GitHub is where people build software. More than 100 million people use GitHub to discover, fork, and contribute to over 420 million projects. [...]

Match Score: 27.97

Page not found · GitHub · GitHub
Page not found · GitHub · GitHub

GitHub is where people build software. More than 150 million people use GitHub to discover, fork, and contribute to over 420 million projects. [...]

Match Score: 27.97

github
Site not found · GitHub Pages

"Discover why the GitHub Pages site at https://kosuket-dev.github.io is not found. Learn about potential issues and solutions to resolve missing GitHub Pages sites." [...]

Match Score: 27.97

GitHub - oobabooga/text-generation-webui: A Gradio web UI for Large Language Models with support for multiple inference backends.
GitHub - oobabooga/text-generation-webui: A Gradio web UI for Large Languag

A Gradio web UI for Large Language Models with support for multiple inference backends. - oobabooga/text-generation-webui [...]

Match Score: 26.51

GitHub - turboderp/exllama: A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights.
GitHub - turboderp/exllama: A more memory-efficient rewrite of the HF trans

A more memory-efficient rewrite of the HF transformers implementation of Llama for use with quantized weights. - turboderp/exllama [...]

Match Score: 26.12