AirLLM 70B inference with single 4GB GPU

🎒 Token-Oriented Object Notation (TOON) – Compact, human-readable, schema-aware JSON for LLM prompts. Spec, benchmarks, TypeScript SDK.

Manages Unified Access to Generative AI Services built on Envoy Gateway

gpt-oss-120b and gpt-oss-20b are two open-weight language models by OpenAI

Official MCP Servers for AWS

Continual Learning papers list, curated by ContinualAI

Cloud-native search engine for observability. An open-source alternative to Datadog, Elasticsearch, Loki, and Tempo.

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Monokai color scheme for Vim converted from Textmate theme

s1: Simple test-time scaling

Define infrastructure resources using programming constructs and provision them using HashiCorp Terraform

General-purpose web UI for Kubernetes clusters

CLI tool to generate terraform files from existing infrastructure (reverse Terraform). Infrastructure to Code

Open-Source Web UI for Apache Kafka Management

LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any hardware. No GPU required.

A list of papers, docs, codes about model quantization. This repo is aimed to provide the info for model quantization research, we are continuously improving the project. Welcome to PR the works (p…

A list of companies using Rust in production.

Source code accompanying O'Reilly book: Machine Learning Design Patterns

A list of awesome ESLint plugins, configs, etc.

The framework for Back-end and MLOps

A curated list of awesome HTML5 Canvas with examples, related articles and posts.

A list of awesome things related to FeathersJS

A machine learning-based video super resolution and frame interpolation framework. Est. Hack the Valley II, 2018.

The easiest way to serve AI apps and models - Build Model Inference APIs, Job queues, LLM apps, Multi-model pipelines, and more!

Go Version Manager

😎 A curated list of awesome MLOps tools

🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

A curated list of references for MLOps

📦 Collect some Asynchronous Federated Learning papers.