Discussions

• 1 You must be logged in to vote

  💬

  SGD LR for hidden weights

  AllanYangZhou started Jun 3, 2023 in General

  

  

  0
• 2 You must be logged in to vote

  🙏

  muP over depth

  AlaaKhaddaj asked Jun 2, 2023 in Q&A · Unanswered

  

  

  0
• 1 You must be logged in to vote

  💬

  muP and Deep Double Descent

  mathbloodprince started Apr 26, 2023 in General

  

  

  1
• 1 You must be logged in to vote

  💬

  Question about the abc parametrization across the two papers

  thomasdulacatos started Jan 10, 2023 in General

  

  

  1
• 1 You must be logged in to vote

  🙏

  What's an example where two different tensors would have different values of width_mult?

  davisyoshida asked Mar 20, 2022 in Q&A · Answered

  

  

  2