Open ABI and FFI for Machine Learning Systems

Unofficial description of the CUDA assembly (SASS) instruction sets.

H-Net: Hierarchical Network with Dynamic Chunking

CUDA Templates and Python DSLs for High-Performance Linear Algebra

Kimi K2 is the large language model series developed by Moonshot AI team

A high-performance library for compressed ndarrays, with a flexible computational engine

Development repository for the Triton language and compiler

FlashAttention (Metal Port)

Fast and memory-efficient exact attention

A PyTorch-based Speech Toolkit

OSLO: Open Source framework for Large-scale model Optimization

Machine learning metrics for distributed, scalable PyTorch applications.

Flexible Python configuration system. The last one you will ever need.

PyTorch Lightning + Hydra. A very user-friendly template for ML experimentation. ⚡🔥⚡

Constrained optimization toolkit for PyTorch

KErnel OPerationS, on CPUs and GPUs, with autodiff and without memory overflows

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

Emacs client/library for the Language Server Protocol

lsp-mode ❤️ Microsoft's python language server

Hydra is a framework for elegantly configuring complex applications

Research workflows made easy, locally and in the Cloud.

PyTorch Extension Library of Optimized Scatter Operations

Kernel Tuner

Debug PyTorch code using PySnooper

Pretrain, finetune ANY AI model of ANY size on 1 or 10,000+ GPUs with zero code changes.

pytorch-kaldi is a project for developing state-of-the-art DNN/RNN hybrid speech recognition systems. The DNN part is managed by pytorch, while feature extraction, label computation, and decoding a…

Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Jupyter notebook client in Emacs