covariant

By clecam, 15 May, 2025

Understanding Tensors in AI: A Journey Through Physics and Mathematics

When exploring the world of Artificial Intelligence, one frequently encounters the term tensor. In practice, a tensor is often treated as just a multi-dimensional array — a generalization of scalars, vectors, and matrices. However, this modern usage is a far cry from its deeper mathematical and physical origins. To understand what a tensor really is, it’s helpful to trace its meaning through physics and mathematics before returning to AI.