NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

中文的C++ Template的教学指南。与知名书籍C++ Templates不同，该系列教程将C++ Templates作为一门图灵完备的语言来讲授，以求帮助读者对Meta-Programming融会贯通。(正在施工中)

Design Patterns In Modern C++ 中文版翻译

Sparse & quantized LLM training/inference/CPT/SFT/DPO

Yet Another Language Model: LLM inference in C++/CUDA, no libraries except for I/O

A collection of modern C++ libraries, include coro_http, coro_rpc, compile-time reflection, struct_pack, struct_json, struct_xml, struct_pb, easylog, async_simple etc.

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

AIInfra（AI 基础设施）指AI系统从底层芯片等硬件，到上层软件栈支持AI大模型训练和推理。

Machine Learning Engineering Open Book

This is a Chinese translation of the CUDA programming guide

📚 [译] ApacheCN C/C++ 译文集

2023年最新整理 c++后端开发，1000篇优秀博文，含内存，网络，架构设计，高性能，数据结构，基础组件，中间件，分布式相关

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

LLM training in simple, raw C/CUDA

Stable Diffusion web UI

Database connectivity API standard and libraries for Apache Arrow

HierarchicalKV is a part of NVIDIA Merlin and provides hierarchical key-value storage to meet RecSys requirements. The key capability of HierarchicalKV is to store key-value feature-embeddings on h…

Dataset, streaming, and file system extensions maintained by TensorFlow SIG-IO

Additional utils and helpers to extend TensorFlow when build recommendation systems, contributed and maintained by SIG Recommenders.

Additional utils and helpers to extend TensorFlow when build recommendation systems, contributed and maintained by SIG Recommenders.

CV-CUDA™ is an open-source, GPU accelerated library for cloud-scale image processing and computer vision.

opencv

paper implement

2021年最新整理， C++ 学习资料，含C++ 11 / 14 / 17 / 20 / 23 新特性、入门教程、推荐书籍、优质文章、学习笔记、教学视频等

C++ library based on tensorrt integration

Implementation of popular deep learning networks with TensorRT network definition API

An easy to use PyTorch to TensorRT converter

COLMAP - Structure-from-Motion and Multi-View Stereo