Home

Welcome to the TensorType wiki!

For now a collection of useful resources:

Strided tensor representation

• as_strided and sum are all you need
• Demystifying Pytorch's Strides Format
• You could have invented CuTe hierarchical layout
• Categorical Foundations for CuTe Layouts

Misc

• PyTorch internals
• Einstein summation in numpy
• How to Think About GPUs
• XLA architecture
• How to draw high-dimensional tensors
• Slicing Is All You Need: Towards A Universal One-Sided Algorithm for Distributed Matrix Multiplication