Skip to content

Trending

See what the GitHub community is most excited about this week.

Spoken Language: Any
Select a spoken language
Abkhazian Afar Afrikaans Akan Albanian Amharic Arabic Aragonese Armenian Assamese Avaric Avestan Aymara Azerbaijani Bambara Bashkir Basque Belarusian Bengali Bihari languages Bislama Bosnian Breton Bulgarian Burmese Catalan, Valencian Chamorro Chechen Chichewa, Chewa, Nyanja Chinese Chuvash Cornish Corsican Cree Croatian Czech Danish Divehi, Dhivehi, Maldivian Dutch, Flemish Dzongkha English Esperanto Estonian Ewe Faroese Fijian Finnish French Fulah Galician Georgian German Greek, Modern Guarani Gujarati Haitian, Haitian Creole Hausa Hebrew Herero Hindi Hiri Motu Hungarian Interlingua (International Auxil... Indonesian Interlingue, Occidental Irish Igbo Inupiaq Ido Icelandic Italian Inuktitut Japanese Javanese Kalaallisut, Greenlandic Kannada Kanuri Kashmiri Kazakh Central Khmer Kikuyu, Gikuyu Kinyarwanda Kirghiz, Kyrgyz Komi Kongo Korean Kurdish Kuanyama, Kwanyama Latin Luxembourgish, Letzeburgesch Ganda Limburgan, Limburger, Limburgish Lingala Lao Lithuanian Luba-Katanga Latvian Manx Macedonian Malagasy Malay Malayalam Maltese Maori Marathi Marshallese Mongolian Nauru Navajo, Navaho North Ndebele Nepali Ndonga Norwegian Bokmål Norwegian Nynorsk Norwegian Sichuan Yi, Nuosu South Ndebele Occitan Ojibwa Church Slavic, Old Slavonic, Chu... Oromo Oriya Ossetian, Ossetic Punjabi, Panjabi Pali Persian Polish Pashto, Pushto Portuguese Quechua Romansh Rundi Romanian, Moldavian, Moldovan Russian Sanskrit Sardinian Sindhi Northern Sami Samoan Sango Serbian Gaelic, Scottish Gaelic Shona Sinhala, Sinhalese Slovak Slovenian Somali Southern Sotho Spanish, Castilian Sundanese Swahili Swati Swedish Tamil Telugu Tajik Thai Tigrinya Tibetan Turkmen Tagalog Tswana Tonga (Tonga Islands) Turkish Tsonga Tatar Twi Tahitian Uighur, Uyghur Ukrainian Urdu Uzbek Venda Vietnamese Volapük Walloon Welsh Wolof Western Frisian Xhosa Yiddish Yoruba Zhuang, Chuang Zulu
Loading
Language: Cuda
Select a language
Clear language
Unknown languages 1C Enterprise 2-Dimensional Array 4D ABAP ABAP CDS ABNF ActionScript Ada Adblock Filter List Adobe Font Metrics Agda AGS Script AIDL AL Alloy Alpine Abuild Altium Designer AMPL AngelScript Answer Set Programming Ant Build System Antlers ANTLR ApacheConf Apex API Blueprint APL Apollo Guidance Computer AppleScript Arc AsciiDoc ASL ASN.1 Classic ASP ASP.NET AspectJ Assembly Astro Asymptote ATS Augeas AutoHotkey AutoIt Avro IDL Awk B4X Ballerina BASIC Batchfile Beef Befunge Berry BibTeX BibTeX Style Bicep Bikeshed Bison BitBake Blade BlitzBasic BlitzMax Bluespec Bluespec BH Boo Boogie BQN Brainfuck BrighterScript Brightscript Zeek Browserslist C C# C++ C-ObjDump C2hs Haskell Cabal Config Caddyfile Cadence Cairo Cairo Zero CameLIGO CAP CDS Cap'n Proto Carbon CartoCSS Ceylon Chapel Charity Checksums ChucK CIL Circom Cirru Clarion Clarity Classic ASP Clean Click CLIPS Clojure Closure Templates Cloud Firestore Security Rules CMake COBOL CODEOWNERS CodeQL CoffeeScript ColdFusion ColdFusion CFC COLLADA Common Lisp Common Workflow Language Component Pascal CoNLL-U Cool Coq Cpp-ObjDump Creole crontab Crystal CSON Csound Csound Document Csound Score CSS CSV Cuda CUE Cue Sheet cURL Config Curry CWeb Cycript Cylc Cypher Cython D D-ObjDump D2 Dafny Darcs Patch Dart DataWeave Debian Package Control File DenizenScript desktop Dhall Diff DIGITAL Command Language dircolors DirectX 3D File DM DNS Zone Dockerfile Dogescript Dotenv DTrace Dune Dylan E E-mail Eagle Earthly Easybuild EBNF eC Ecere Projects ECL ECLiPSe Ecmarkup Edge EdgeQL EditorConfig Edje Data Collection edn Eiffel EJS Elixir Elm Elvish Elvish Transcript Emacs Lisp EmberScript E-mail EQ Erlang Euphoria F# F* Factor Fancy Fantom Faust Fennel FIGlet Font Filebench WML Filterscript FIRRTL fish Fluent FLUX Formatted Forth Fortran Fortran Free Form FreeBASIC FreeMarker Frege Futhark G-code Game Maker Language GAML GAMS GAP GCC Machine Description GDB GDScript GEDCOM Gemfile.lock Gemini Genero 4gl Genero per Genie Genshi Gentoo Ebuild Gentoo Eclass Gerber Image Gettext Catalog Gherkin Git Attributes Git Config Git Revision List Gleam Glimmer JS Glimmer TS GLSL Glyph Glyph Bitmap Distribution Format GN Gnuplot Go Go Checksums Go Module Go Workspace Godot Resource Golo Gosu Grace Gradle Gradle Kotlin DSL Grammatical Framework Graph Modeling Language GraphQL Graphviz (DOT) Groovy Groovy Server Pages GSC Hack Haml Handlebars HAProxy Harbour Hare Haskell Haxe HCL HiveQL HLSL HOCON HolyC hoon Hosts File HTML Jinja HTML+ECR HTML+EEX HTML+ERB HTML+PHP HTML+Razor HTTP HXML Hy HyPhy iCalendar IDL Idris Ignore List IGOR Pro ImageJ Macro Imba Inform 7 INI Ink Inno Setup Io Ioke IRC log Isabelle Isabelle ROOT ISPC J Jai Janet JAR Manifest Jasmin Java Java Properties Java Server Pages Java Template Engine JavaScript JavaScript+ERB JCL Jest Snapshot JetBrains MPS JFlex Jinja Jison Jison Lex Jolie jq JSON JSON with Comments JSON5 JSONiq JSONLD Jsonnet Julia Julia REPL Jupyter Notebook Just Kaitai Struct KakouneScript KDL KerboScript KiCad Layout KiCad Legacy Layout KiCad Schematic Kickstart Kit Kotlin KRL Kusto kvlang LabVIEW Lark Lasso Latte Lean Lean 4 Less Lex LFE LigoLANG LilyPond Limbo Linear Programming Linker Script Linux Kernel Module Liquid Literate Agda Literate CoffeeScript Literate Haskell LiveCode Script LiveScript LLVM Logos Logtalk LOLCODE LookML LoomScript LSL LTspice Symbol Lua Luau M M4 M4Sugar Macaulay2 Makefile Mako Markdown Marko Mask Mathematica MATLAB Maven POM Max MAXScript mcfunction mdsvex MDX Wikitext Mercury Mermaid Meson Metal Microsoft Developer Studio Project Microsoft Visual Studio Solution MiniD MiniYAML MiniZinc MiniZinc Data Mint Mirah mIRC Script MLIR Modelica Modula-2 Modula-3 Module Management System Mojo Monkey Monkey C Moocode MoonBit MoonScript Motoko Motorola 68K Assembly Move MQL4 MQL5 MTML MUF mupad Muse Mustache Myghty nanorc Nasal NASL NCL Nearley Nemerle NEON nesC NetLinx NetLinx+ERB NetLogo NewLisp Nextflow Nginx Nim Ninja Nit Nix NL NMODL Noir NPM Config NSIS Nu NumPy Nunjucks Nushell NWScript OASv2-json OASv2-yaml OASv3-json OASv3-yaml Oberon ObjDump Object Data Instance Notation Objective-C Objective-C++ Objective-J ObjectScript OCaml Odin Omgrofl OMNeT++ MSG OMNeT++ NED OMNeT++ MSG OMNeT++ NED ooc Opa Opal Open Policy Agent OpenAPI Specification v2 OpenAPI Specification v3 OpenCL OpenEdge ABL OpenQASM OpenRC runscript OpenSCAD OpenStep Property List OpenType Feature File Option List Org OverpassQL Ox Oxygene Oz P4 Pact Pan Papyrus Parrot Parrot Assembly Parrot Internal Representation Pascal Pawn PDDL PEG.js Pep8 Perl PHP Pic Pickle PicoLisp PigLatin Pike Pip Requirements Pkl PlantUML PLpgSQL PLSQL Pod Pod 6 PogoScript Polar Pony Portugol PostCSS PostScript POV-Ray SDL PowerBuilder PowerShell Praat Prisma Processing Procfile Proguard Prolog Promela Propeller Spin Protocol Buffer Protocol Buffer Text Format Public Key Pug Puppet Pure Data PureBasic PureScript Pyret Python Python console Python traceback q Q# QMake QML Qt Script Quake QuickBASIC R Racket Ragel Raku RAML Rascal Raw token data RBS RDoc Readline Config REALbasic Reason ReasonLIGO Rebol Record Jar Red Redcode Redirect Rules Regular Expression Ren'Py RenderScript ReScript reStructuredText REXX Rez Rich Text Format Ring Riot RMarkdown RobotFramework robots.txt Roc Roff Roff Manpage RON Rouge RouterOS Script RPC RPGLE RPM Spec Ruby RUNOFF Rust Sage SaltStack SAS Sass Scala Scaml Scenic Scheme Scilab SCSS sed Self SELinux Policy ShaderLab Shell ShellCheck Config ShellSession Shen Sieve Simple File Verification Singularity Slang Slash Slice Slim Slint Smali Smalltalk Smarty Smithy SmPL SMT Snakemake Solidity Soong SourcePawn SPARQL Spline Font Database SQF SQL SQLPL Squirrel SRecode Template SSH Config Stan Standard ML STAR Starlark Stata STL STON StringTemplate Stylus SubRip Text SugarSS SuperCollider Svelte SVG Sway Sweave Swift SWIG SystemVerilog Tact Talon Tcl Tcsh Tea templ Terra Terraform Template TeX Texinfo Text TextGrid Textile TextMate Properties Thrift TI Program TL-Verilog TLA Toit TOML Tree-sitter Query TSPLIB data TSQL TSV TSX Turing Turtle Twig TXL Type Language TypeScript TypeSpec Typst Unified Parallel C Unity3D Asset Unix Assembly Uno UnrealScript UrWeb V Vala Valve Data Format VBA VBScript vCard VCL Velocity Template Language Verilog VHDL Vim Help File Vim Script Vim Snippet Visual Basic .NET Visual Basic .NET Visual Basic 6.0 Volt Vue Vyper Wavefront Material Wavefront Object WDL Web Ontology Language WebAssembly WebAssembly Interface Type WebIDL WebVTT Wget Config WGSL Whiley Wikitext Win32 Message File Windows Registry Entries wisp Witcher Script Wollok World of Warcraft Addon Data Wren X BitMap X Font Directory Index X PixMap X10 xBase XC XCompose Xmake XML XML Property List Xojo Xonsh XPages XProc XQuery XS XSLT Xtend Yacc YAML YANG YARA YASnippet Yul ZAP Zeek ZenScript Zephir Zig ZIL Zimpl
Loading
Date range: This week
Adjust time span
Today This week This month
Star

thu-ml / SageAttention

Quantized Attention that achieves speedups of 2.1-3.1x and 2.7-5.1x compared to FlashAttention2 and xformers, respectively, without lossing end-to-end metrics across various models.

Cuda 1,248 86 Built by @jt-zhang @jason-huang03 @DefTruth @Panchovix 26 stars this week
Star

Liu-xiandong / How_to_optimize_in_GPU

This is a series of GPU optimization topics. Here we will introduce how to optimize the CUDA kernel in detail. I will introduce several basic kernel optimizations, including: elementwise, reduce, sgemv, sgemm, etc. The performance of these kernels is basically at or near the theoretical limit.

Cuda 978 152 Built by @Liu-xiandong @ZhangGe6 11 stars this week