Serve, optimize and scale PyTorch models in production
User-friendly AI Interface
Run Local LLMs on Any Device. Open-source
A RWKV management and startup tool, full automation, only 8MB
Library for OCR-related tasks powered by Deep Learning
Library for serving Transformers models on Amazon SageMaker
A set of Docker images for training and serving models in TensorFlow
LLM.swift is a simple and readable library
Tensor search for humans
AI interface for tinkerers (Ollama, Haystack RAG, Python)
An easy-to-use LLMs quantization package with user-friendly apis
Openai style api for open large language models
On-device Speech Recognition for Apple Silicon
A high-performance ML model serving framework, offers dynamic batching
Lightweight Python library for adding real-time multi-object tracking
A graphical manager for ollama that can manage your LLMs
OpenFieldAI is an AI based Open Field Test Rodent Tracker
A real time inference engine for temporal logical specifications
Database system for building simpler and faster AI-powered application
A computer vision framework to create and deploy apps in minutes
Prem provides a unified environment to develop AI applications
Sequence-to-sequence framework, focused on Neural Machine Translation
Guide to deploying deep-learning inference networks
CPU/GPU inference server for Hugging Face transformer models