Repositories list

• flashinfer

  Public
  FlashInfer: Kernel Library for LLM Serving

  gpucudajit+ 5pytorchnvidiaattentionllm-inferencelarge-large-models

  Cuda

  •

  Apache License 2.0

  •296•2.9k•106•14•Updated May 14, 2025May 14, 2025

• flashinfer-ai.github.io

  Public
  Project website of FlashInfer project

  SCSS

  •4•0•1•0•Updated May 7, 2025May 7, 2025

• cutlass-viz

  Public
  Python

  •

  Apache License 2.0

  •2•58•0•0•Updated Apr 26, 2025Apr 26, 2025

• tg4perfetto

  Public
  Simple python library for generating your own perfetto traces for your application. Can be used for both app instrumentation and custom trace generation (for your own purposes)

  Python

  •

  Apache License 2.0

  •6•1•0•0•Updated Apr 16, 2025Apr 16, 2025

• flashinfer-nightly

  Public
  FlashInfer Nightly

  MIT License

  •1•6•0•0•Updated Apr 9, 2025Apr 9, 2025

• whl

  Public
  Pre-built wheels for flashinfer python package.

  HTML

  •2•1•0•0•Updated Apr 7, 2025Apr 7, 2025

• performance-tracking

  Public
  Apache License 2.0

  •0•4•0•0•Updated Apr 2, 2025Apr 2, 2025

• web-data

  Public
  Apache License 2.0

  •0•0•0•0•Updated Mar 4, 2025Mar 4, 2025

• llm-based-compression

  Public
  Jupyter Notebook

  •0•2•0•0•Updated Jan 10, 2025Jan 10, 2025

• debug-print

  Public
  Debug print operator for cudagraph debugging

  Cuda

  •0•10•0•0•Updated Aug 2, 2024Aug 2, 2024

• llvm-project

  Public
  The LLVM Project is a collection of modular and reusable compiler and toolchain technologies.

  Other

  •13k•0•0•0•Updated Apr 21, 2024Apr 21, 2024

• candle

  Public
  Minimalist ML framework for Rust

  Rust

  •

  Apache License 2.0

  •1.1k•0•0•0•Updated Mar 7, 2024Mar 7, 2024