In other words, only the elements on the main diagonal (where $i = j$) can be non-zero. Such a matrix is called a diagonal matrix.
A general diagonal matrix $A$ of size $n \times n$ would look like this:
$$
A = \begin{bmatrix}
a_{11} & 0 & 0 & \cdots & 0 \\
Show more…