Repositories list

• kubeai

  Public
  AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

  kubernetesaik8s+ 10whisperautoscaleropenai-apillmvllmfaster-whisperollama+ 3

  Go

  •

  Apache License 2.0

  •98•1k•85•26•Updated Jul 21, 2025Jul 21, 2025

• blank-nextjs-project

  Public
  0•0•0•0•Updated May 16, 2025May 16, 2025

• test-go-api

  Public
  0•0•0•0•Updated Apr 30, 2025Apr 30, 2025

• vllm-docker

  Public
  Shell

  •

  Apache License 2.0

  •9•62•1•1•Updated Mar 28, 2025Mar 28, 2025

• vllm

  Public
  A high-throughput and memory-efficient inference and serving engine for LLMs

  Python

  •

  Apache License 2.0

  •8.9k•1•0•0•Updated Mar 26, 2025Mar 26, 2025

• sandboxai

  Public
  Run AI generated code in isolated sandboxes

  ai-agent-tools

  Go

  •6•89•3•1•Updated Feb 5, 2025Feb 5, 2025

• gengauge

  Public
  0•0•0•0•Updated Dec 9, 2024Dec 9, 2024

• stapi

  Public
  Sentence Transformers API: An OpenAI compatible embedding API server

  apiembeddingsvector-database+ 2sentence-transformersopenai-api

  HTML

  •

  Apache License 2.0

  •13•63•0•1•Updated Sep 4, 2024Sep 4, 2024

• runbooks

  Public archive
  Finetune LLMs on K8s by using Runbooks

  kuberneteskubernetes-operatormlops+ 5ml-platformllmopsllm-servingllm-trainingllm-inference

  Go

  •

  Other

  •14•169•62•1•Updated Aug 28, 2024Aug 28, 2024

• helm

  Public
  Smarty

  •

  Apache License 2.0

  •3•18•0•0•Updated Aug 19, 2024Aug 19, 2024

• verba-docker

  Public
  Simple versioned Docker images for Weaviate Verba

  Dockerfile

  •0•2•0•0•Updated May 8, 2024May 8, 2024

• silkchat

  Public
  Light-weight Chat UI for any OpenAI compatible backend (no dependencies)

  CSS

  •0•1•0•0•Updated Apr 28, 2024Apr 28, 2024

• aichat-ui

  Public
  Python

  •0•1•1•0•Updated Apr 25, 2024Apr 25, 2024

• substratusai.github.io

  Public
  Python

  •1•1•8•0•Updated Jan 16, 2024Jan 16, 2024

• batchelor

  Public
  Python

  •0•0•1•0•Updated Dec 16, 2023Dec 16, 2023

• images

  Public
  Official Substratus Container Images

  Jupyter Notebook

  •0•1•6•3•Updated Oct 30, 2023Oct 30, 2023

• the-stack-yaml-k8s

  Public
  Jupyter Notebook

  •1•5•0•0•Updated Oct 10, 2023Oct 10, 2023

• example-minimal-notebook

  Public
  Example Substratus Notebook

  Jupyter Notebook

  •0•0•0•0•Updated Aug 19, 2023Aug 19, 2023