Tensors in .NET #98323

Goal: Provide a type for use as both exchange and interop that represents multi-dimensional data if a single primitive Type. Implement arithmetic and linear algebra operations so that the type can serve as a sufficient basis for data preparation and as an input and output to neural networks.

• Explore memory layouts and how they play into interop
• Explore high-level Tensor design
  • Abstract? Type heirarchy? Construction patterns.
  • Dense vs sparse
  • Slices
  • Dimension order
  • Expected outcome: design document draft in dotnet/designs
• Explore Tensor arithmetic design
• Explore Tensor construction design
• Explore Tensor loading and saving
• TODO: Further break down Tensor implementation into smaller chunks
• Tensor API proposal
  • Expected outcome: API review
• Tensor core types implementation
  • Expected outcome: PR
• TODO: Further break down Tensor implementation into smaller chunks
• Performance tests
• Interop with OnnxRuntime
• Interop with TorchSharp
• Expose in ML.NET