Featured News

Select a news year: 2025 2024 2023 2022 2021 2020 2019 2017 2016 2015 2013 2012 2009 2008

April 2025
Alex Wein on Tensor Decomposition

An excerpt from the 2024 Department Newsletter research article...

A tensor is a multi-way array of numbers. An order-1 tensor is just a vector u ∈ ℝn. An order-2 tensor is a matrix M ∈ ℝn1× n2 . An order-3 tensor is a 3-way array T ∈ ℝn1× n2× n3 , and so on. [...]

Tensors have a bunch of applications in statistics and data science. For instance, certain datasets might naturally be represented as a 3-wayarray encoding 3-way interactions between 3 different variables. Another key example in statistics is the method of moments: given many samples of an n-dimensional random vector, it may be useful to compute the moments. The first moment is the mean (expected value), which is an n dimensional vector; the second moment is the n × n covariance matrix; the third moment is an n × n × n tensor; and so on. We are used to performing various primitive computations on matrices: eigenvalues and eigenvectors, singular value decomposition (SVD), low-rank approximation, and so on. For tensors of order 3 and above, the analogous operations tend to be much more difficult to compute, or even ill-defined.

For the full article, check out our 2024 Department Newsletter! This article starts on page 8.