Discussions

• 2 You must be logged in to vote

  🙏

  nvfp4 support for Spark DGX

  vidavakil asked Nov 2, 2025 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  SM120 Support

  JamesDConley asked Oct 29, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  When are you going to release the new version

  lorenzosciuto asked Sep 17, 2025 in Q&A · Answered

  

  

  1
• 2 You must be logged in to vote

  🙏

  How to calibrate weights of models after apply Accelerating a Hugging Face Llama 3 models with Transformer Engine

  xuanvinh1997 asked May 4, 2025 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  Support for aarch64

  nrxszvo asked Jan 28, 2025 in Q&A · Unanswered

  

  

  3
• 1 You must be logged in to vote

  🙏

  verification of fp8 precision

  kraza8 asked Dec 12, 2024 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  Is the delayed scaling computation overlapped with another computation?

  avizon-aws asked Oct 8, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  🙏

  te.Embedding layer?

  sopotc asked Feb 13, 2024 in Q&A · Unanswered

  

  

  

  

  2
• 1 You must be logged in to vote

  🙏

  Clarification for the precision part in fp8_primer

  YangFei1990 asked May 4, 2024 in Q&A · Answered

  

  

  3
• 2 You must be logged in to vote

  💬

  Official example for multi-GPU training didn't work on 4090

  QIU-Shuo started Aug 18, 2023 in General

  

  

  1
• 1 You must be logged in to vote

  💬

  Could you share any papers/books that provide underlying explanations for this project?

  nicks64 started Apr 24, 2024 in General

  

  

  

  

  4
• 1 You must be logged in to vote

  🙏

  Can this module be used for training on an Ada GPU?

  scissorstail asked Apr 11, 2024 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  [Pytorch] Is the fwd_amx_history of first module is used before required allreduce communication

  mst9009 started Mar 18, 2024 in General

  

  

  0
• 1 You must be logged in to vote

  🙏

  FP8 format

  stella-jxu asked Jun 8, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  Enabling sequence_parallel slows down training with fp16

  cavdard asked Apr 27, 2023 in Q&A · Answered

  

  

  

  

  8
• 1 You must be logged in to vote

  🙏

  [Question] What is the memory footprint of te.Linear() weights ?

  vince62s asked May 16, 2023 in Q&A · Answered

  

  

  1
• 0 You must be logged in to vote

  🙏

  Latency/Energy Calculation

  krishnateja95 asked May 17, 2023 in Q&A · Unanswered

  

  

  0
• 2 You must be logged in to vote

  🙏

  How does TransformerEngine interact with TensorRT/Onnx?

  tylerweitzman asked May 10, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  How to run LLaMa inference?

  SinanAkkoyun asked May 9, 2023 in Q&A · Unanswered

  

  

  1
• 1 You must be logged in to vote

  🙏

  FP8 questions...

  vgoklani asked Apr 4, 2023 in Q&A · Answered

  

  

  3