• Home
  • Textbooks
  • Linear Algebra in Action
  • Triangular factorization and positive definite matrices

Linear Algebra in Action

Harry Dym

Chapter 12

Triangular factorization and positive definite matrices - all with Video Answers

Educators


Chapter Questions

Problem 1

Prove Theorem 12.2.

Check back soon!
06:52

Problem 2

Let $P_k=\operatorname{diag}\left\{I_k, O_{(n-k) \times(n-k)}\right\}$. Show that (a) $A \in \mathbb{C}^{n \times n}$ is upper triangular if and only if $A P_k=P_k A P_k$ for $k=$ $1, \ldots, n$.
(b) $A \in \mathbb{C}^{n \times n}$ is lower triangular if and only if $P_k A=P_k A P_k$ for $k=$ $1, \ldots, n$.

Anthony Ramos
Anthony Ramos
Numerade Educator
04:38

Problem 3

Show that if $L \in \mathbb{C}^{n \times n}$ is lower triangular, $U \in \mathbb{C}^{n \times n}$ is upper triangular and $D \in \mathbb{C}^{n \times n}$ is diagonal, then
(12.6) $(L D U)_{[1, k]}=L_{[1, k]} D_{[1, k]} U_{[1, k]} \quad$ and $\quad(U D L)_{[k, n]}=U_{[k, n]} D_{[k, n]} L_{[k, n]}$ for $k=1, \ldots, n$.

Victor Salazar
Victor Salazar
Numerade Educator
01:42

Problem 4

Let $A \in \mathbb{C}^{n \times n}$. Show that if $A \succeq O$, then
$A \succ O \Longleftrightarrow$ all the eigenvalues of $A$ are positive $\Longleftrightarrow \operatorname{det} A>0$.

Kratika Bhadauria
Kratika Bhadauria
Numerade Educator

Problem 5

Show that if $V \in \mathbb{C}^{n \times n}$ is invertible, then
$$
A \succ O \Longleftrightarrow V^H A V \succ O .
$$

Check back soon!

Problem 6

Show that if $V \in \mathbb{C}^{n \times k}$ and $\operatorname{rank} V=k$, then
$$
A \succ O \Longrightarrow V^H A V \succ O \text {, }
$$
but the converse implication is not true if $k<n$.

Check back soon!

Problem 7

Show that if the $n \times n$ matrix $A=\left[a_{i j}\right], i, j=1, \ldots, n$, is positive semidefinite over $\mathbb{C}^n$, then $\left|a_{i j}\right|^2 \leq a_{i i} a_{j j}$.

Check back soon!

Problem 8

Show that if $A \in \mathbb{C}^{n \times n}, n=p+q$ and
$$
A=\left[\begin{array}{ll}
A_{11} & A_{12} \\
A_{21} & A_{22}
\end{array}\right],
$$
where $A_{11} \in \mathbb{C}^{p \times p}, A_{22} \in \mathbb{C}^{q \times q}$, then
$$
A \succ O \Longleftrightarrow A_{11} \succ O, \quad A_{21}=A_{12}^H \quad \text { and } \quad A_{22}-A_{21} A_{11}^{-1} A_{12} \succ O .
$$

Check back soon!

Problem 9

Show that if $A \in \mathbb{C}^{p \times q}$, then
$$
\|A\| \leq 1 \Longleftrightarrow I_q-A^H A \succeq O \Longleftrightarrow I_p-A A^H \succeq O .
$$

Check back soon!
01:02

Problem 10

Show that if $A \in \mathbb{C}^{n \times n}$ and $A=A^H$, then
$$
\left[\begin{array}{cc}
A^2 & A \\
A & I_n
\end{array}\right] \succeq O .
$$

Victor Salazar
Victor Salazar
Numerade Educator

Problem 11

Show that if $A \in \mathbb{C}^{n \times n}$ and $A \succeq O$, then
$$
\left[\begin{array}{ll}
A & A \\
A & A
\end{array}\right] \succeq O .
$$

Check back soon!

Problem 12

Let $U \in \mathbb{C}^{n \times n}$ be unitary and let $A \in \mathbb{C}^{n \times n}$. Show that if $A \succ O$ and $A U \succ O$, then $U=I_n$.

Check back soon!
05:14

Problem 13

Verify the implication $(6) \Longrightarrow(7)$ in Theorem 12.4.

Donald Albin
Donald Albin
Numerade Educator
06:07

Problem 14

Let $A \in \mathbb{C}^{n \times n}$ and let $D_A=\operatorname{diag}\left\{a_{11} \ldots, a_{n n}\right\}$ denote the $n \times n$ diagonal matrix with diagonal entries equal to the diagonal entries of $A$. Show that $D_A$ is multiplicative on upper triangular matrices in the sense that if $A$ and $B$ are both $n \times n$ upper triangular matrices, then $D_{A B}=$ $D_A D_B$ and thus, if $A$ is invertible, $D_{A^{-1}}=\left(D_A\right)^{-1}$.

Jacquelyn Trost
Jacquelyn Trost
Numerade Educator

Problem 15

Show that if $A \in \mathbb{C}^{3 \times 3}$ and $A \succ O$, then there exists a lower triangular matrix $E$ with ones on the diagonal such that $E A$ is upper triangular.

Check back soon!

Problem 16

Show that if $A \in \mathbb{C}^{3 \times 3}$ and $A \succ O$, then there exists an upper triangular matrix $F$ with ones on the diagonal such that $F A$ is lower triangular.

Check back soon!

Problem 17

Let $A=\left[\begin{array}{ll}A_1 & A_2\end{array}\right]$, where $A_1 \in \mathbb{C}^{n \times s}, A_2 \in \mathbb{C}^{n \times t}$ and $s+t=r$. Show that if rank $A=r$, then the matrices $A^H A, A_1^H A_1, A_2^H A_2$ and $A_2^H A_2-A_2^H A_1\left(A_1^H A_1\right)^{-1} A_1^H A_2$ are all positive definite (over complex spaces of appropriate sizes).

Check back soon!
07:12

Problem 18

Show that if $x \in \mathbb{R}$, then the matrix $\left[\begin{array}{lll}3 & 2 & x \\ 2 & 2 & 1 \\ x & 1 & 1\end{array}\right]$ will be positive definite over $\mathbb{C}^3$ if and only if $(x-1)^2<1 / 2$.

Chris Trentman
Chris Trentman
Numerade Educator

Problem 19

Complete the proof of Lemma 12.6.

Check back soon!
View

Problem 20

Let $A \in \mathbb{C}^{n \times n}$ and assume that $A \succ O$. Evaluate
$$
\min _{x_1, \ldots, x_{n-1}}\left\langle A\left(\mathbf{e}_n-\sum_{j=1}^{n-1} x_j \mathbf{e}_j\right), \mathbf{e}_n-\sum_{j=1}^{n-1} x_j \mathbf{e}_j\right\rangle
$$
in terms of the entries in $A$ and the entries in $A^{-1}$.

Victor Salazar
Victor Salazar
Numerade Educator
06:06

Problem 21

Verify the identity (12.13) in the setting of Theorem 12.7.

Amany Waheeb
Amany Waheeb
Numerade Educator

Problem 22

Show that if $T_n \succ O$, then $\Gamma_n$ admits the triangular factorization
$$
\Gamma_n=L_n D_n L_n^H,
$$
where
(12.19)
$$
L_n=\left[\begin{array}{cccc}
\gamma_{00}^{(n)} & O & \cdots & O \\
\gamma_{10}^{(n)} & \gamma_{00}^{(n-1)} & \cdots & O \\
\vdots & & \ddots & \vdots \\
\gamma_{n 0}^{(n)} & \gamma_{n-1,0}^{(n-1)} & \cdots & \gamma_{00}^{(0)}
\end{array}\right], \quad L_n^H=\left[\begin{array}{cccc}
\gamma_{00}^{(n)} & \gamma_{01}^{(n)} & \cdots & \gamma_{0 n}^{(n)} \\
O & \gamma_{00}^{(n-1)} & \cdots & \gamma_{0, n-1}^{(n-1)} \\
\vdots & & \ddots & \vdots \\
O & O & \cdots & \gamma_{00}^{(0)}
\end{array}\right]
$$
and
$$
D_n=\operatorname{diag}\left\{\left\{\gamma_{00}^{(n)}\right\}^{-1},\left\{\gamma_{00}^{(n-1)}\right\}^{-1}, \ldots,\left\{\gamma_{00}^{(0)}\right\}^{-1}\right\} .
$$

Check back soon!

Problem 23

Find formulas in terms of $\gamma_{i j}^{(k)}$ analogous to those given in the preceding exercise for the factors in a triangular factorization of the form
$$
\Gamma_n=U_n D_n U_n^H,
$$
where $T_n \succ O, U_n$ is an upper triangular matrix and $D_n$ is a diagonal matrix.
Positive definite Toeplitz matrices play a significant role in the theory of prediction of stationary stochastic sequences, which, when recast in the language of trigonometric approximation, focuses on evaluations of the following sort:
$$
\min \left\{\frac{1}{2 \pi} \int_0^{2 \pi}\left|e^{i n \theta}-\sum_{j=0}^{n-1} c_j e^{i j \theta}\right|^2 f\left(e^{i \theta}\right) d \theta: c_0, \ldots, c_{n-1} \in \mathbb{C}\right\}=\left\{\gamma_{n n}^{(n)}\right\}^{-1}
$$
and
(12.23)
$$
\min \left\{\frac{1}{2 \pi} \int_0^{2 \pi}\left|1-\sum_{j=1}^n c_j e^{i j \theta}\right|^2 f\left(e^{i \theta}\right) d \theta: c_1, \ldots, c_n \in \mathbb{C}\right\}=\left\{\gamma_{00}^{(n)}\right\}^{-1},
$$
where, for ease of exposition, we assume that $f\left(e^{i \theta}\right)$ is a continuous function of $\theta$ on the interval $0 \leq \theta \leq 2 \pi$ such that $f\left(e^{i \theta}\right)>0$ on this interval. Let $T_n=T_n(f)$ denote the Toeplitz matrix with entries
$$
t_j=\frac{1}{2 \pi} \int_0^{2 \pi} f\left(e^{i \theta}\right) e^{-i j \theta} d \theta \quad \text { for } \quad j=0, \pm 1, \pm 2, \ldots .
$$

Check back soon!

Problem 24

Show that
(12.25) if $\mathbf{b}=\left[\begin{array}{c}b_0 \\ \vdots \\ b_n\end{array}\right]$, then $\frac{1}{2 \pi} \int_0^{2 \pi}\left|\sum_{j=0}^n b_j e^{i j \theta}\right|^2 f\left(e^{i \theta}\right) d \theta=\mathbf{b}^H T_n \mathbf{b}$.

Check back soon!

Problem 25

Show that if $T_n \succ O$ and $\mathbf{u}^H=\left[\begin{array}{lll}t_n & \cdots & t_1\end{array}\right]$, then
$$
T_n=\left[\begin{array}{cc}
I_n & 0 \\
\mathbf{u}^H T_{n-1}^{-1} & 1
\end{array}\right]\left[\begin{array}{cc}
T_{n-1} & 0 \\
0^H & \left\{\gamma_{n n}^{(n)}\right\}^{-1}
\end{array}\right]\left[\begin{array}{cc}
I_n & T_{n-1}^{-1} \mathbf{u} \\
0^H & 1
\end{array}\right] .
$$

Check back soon!

Problem 26

Show that if $T_n \succ O$ and $\mathbf{v}^H=\left[\begin{array}{lll}t_1 & \cdots & t_n\end{array}\right]$, then
$$
T_n=\left[\begin{array}{cc}
1 & \mathbf{v}^H T_{n-1}^{-1} \\
\mathbf{0} & 1
\end{array}\right]\left[\begin{array}{cc}
\left\{\gamma_{00}^{(n)}\right\}^{-1} & \mathbf{0}^H \\
\mathbf{0} & T_{n-1}
\end{array}\right]\left[\begin{array}{cc}
1 & \mathbf{0}^H \\
T_{n-1}^{-1} \mathbf{v} & I_n
\end{array}\right] .
$$

Check back soon!

Problem 27

Show that if $T_n \succ O$, then
$$
\begin{aligned}
& \operatorname{det} T_n=\left\{\gamma_{00}^{(n)}\right\}^{-1}\left\{\gamma_{00}^{(n-1)}\right\}^{-1} \cdots\left\{\gamma_{00}^{(0)}\right\}^{-1} \\
& =\left\{\gamma_{n n}^{(n)}\right\}^{-1}\left\{\gamma_{n-1, n-1}^{(n-1)}\right\}^{-1} \cdots\left\{\gamma_{00}^{(0)}\right\}^{-1} . \\
&
\end{aligned}
$$

Check back soon!
06:06

Problem 28

Verify formula (12.22).

Amany Waheeb
Amany Waheeb
Numerade Educator
06:06

Problem 29

Verify formula (12.23).

Amany Waheeb
Amany Waheeb
Numerade Educator

Problem 30

Use the formulas in Lemma 8.15 for calculating orthogonal projections to verify (12.22) and (12.23) another way.

Check back soon!

Problem 31

Show that if $T_n \succ O$, then $\gamma_{00}^{(n)}=\gamma_{n n}^{(n)}$ and
$$
\gamma_{00}^{(n-1)} \geq \gamma_{00}^{(n)} \text {. }
$$

Check back soon!

Problem 32

Show that if $T_n \succ O$, then the polynomials
$$
q_k(\lambda)=\sum_{j=0}^k \gamma_{j k}^{(k)} \lambda^j \quad \text { for } \quad k=0, \ldots, n
$$
are orthogonal with respect to the inner product
$\left\langle q_j, q_k\right\rangle_f=\frac{1}{2 \pi} \int_0^{2 \pi} \overline{q_k\left(e^{i \theta}\right)} f\left(e^{i \theta}\right) q_j\left(e^{i \theta}\right) d \theta, \quad$ and $\quad\left\langle q_k, q_k\right\rangle_f=\gamma_{k k}^{(k)}$

Check back soon!
01:02

Problem 33

Use the orthogonal polynomials defined by formula (12.30) to give a new proof of formula (12.22). [HINT: Write $\zeta^n=\sum_{j=0}^n c_j q_j(\zeta)$.]

Raj Bala
Raj Bala
Numerade Educator

Problem 34

Let $f\left(e^{i \theta}\right)=\mid h\left(\left.e^{i \theta}\right|^2\right.$, where $h(\zeta)=\sum_{j=0}^{\infty} h_j \zeta^j, \sum_{j=0}^{\infty}\left|h_j\right|<$ $\infty$ and $|h(\zeta)|>0$ for $|\zeta| \leq 1$. Granting that $1 / h$ has the same properties as $h$ (which follows from a theorem of Norbert Wiener), show that
$$
\lim _{n \uparrow \infty}\left\{\gamma_{n n}^{(n)}\right\}^{-1}=\left|h_0\right|^2 .
$$

Check back soon!

Problem 35

Show that in the setting of Lemma 12.9,
$$
\operatorname{det} \gamma_{00}^{(n)}=\operatorname{det} \gamma_{n n}^{(n)} \text {. }
$$

Check back soon!

Problem 36

Verify Lemma 12.15 if $n=7$ and $k=3$.

Check back soon!

Problem 37

Verify items (3) and (5) of Lemma 12.19.

Check back soon!
02:30

Problem 38

Let
$$
A=\left[\begin{array}{ll}
a & b \\
b & c
\end{array}\right] \quad \text { and } \quad B=\left[\begin{array}{ll}
c & b \\
b & a
\end{array}\right] .
$$

Show that if $a>b>c>0$ and $a c>b^2$, then:
(1) The matrices $A$ and $B$ are both positive definite over $\mathbb{C}^2$.
(2) The matrix $A B$ is not positive definite over $\mathbb{C}^2$.
(3) The matrix $A B+B A$ is not positive definite over $\mathbb{C}^2$.

Chris Trentman
Chris Trentman
Numerade Educator
04:35

Problem 39

Show that the matrix $A B$ considered in Exercise 12.38 is not positive definite over $\mathbb{R}^2$.

Priyanka Sadarangani
Priyanka Sadarangani
Numerade Educator

Problem 40

Let $A \in \mathbb{C}^{n \times n}$ and $B \in \mathbb{C}^{n \times n}$ both be positive semidefinite over $\mathbb{C}^n$. Show that $A^2 B^2+B^2 A^2$ need not be positive semidefinite over $\mathbb{C}^n$.

Check back soon!

Problem 41

Let $A \in \mathbb{C}^{n \times n}$ be expressed in block form as
$$
A=\left[\begin{array}{ll}
A_{11} & A_{12} \\
A_{21} & A_{22}
\end{array}\right]
$$
with square blocks $A_{11}$ and $A_{22}$ and suppose that $A \succeq O$. Show that:
(1) There exists a matrix $K \in \mathbb{C}^{p \times q}$ such that $A_{12}=A_{11} K$.
(2) $A=\left[\begin{array}{cc}I_p & O \\ K^H & I_q\end{array}\right]\left[\begin{array}{cc}A_{11} & O \\ O & A_{22}-K^H A_{11} K\end{array}\right]\left[\begin{array}{ll}I_p & K \\ O & I_q\end{array}\right]$.
(3) $K^H A_{11} K=A_{21} A_{11}^{\dagger} A_{12}$.

Check back soon!
01:00

Problem 42

Show that in the setting of Exercise 12.41
(1) There exists a matrix $K \in \mathbb{C}^{q \times p}$ such that $A_{21}=A_{22} K$.
(2) $A=\left[\begin{array}{cc}I_p & K^H \\ O & I_q\end{array}\right]\left[\begin{array}{cc}A_{11}-K A_{22} K^H & O \\ O & A_{22}\end{array}\right]\left[\begin{array}{ll}I_p & O \\ K & I_q\end{array}\right]$.
(3) $K A_{22} K^H=A_{12} A_{22}^{\dagger} A_{21}$.

Raj Bala
Raj Bala
Numerade Educator
01:12

Problem 43

Let $A=B B^H$, where $B \in \mathbb{C}^{n \times k}$ and rank $B=k$; let $\mathbf{u}_1, \ldots, \mathbf{u}_k$ be an orthonormal basis for $\mathcal{R}_{B^H}$; and let $A_{\ell}=\sum_{j=1}^{\ell} B \mathbf{u}_j \mathbf{u}_j^H B^H$ for $\ell=1, \ldots, k$. Show that $A=A_k$ and that $A-A_{\ell}$ is a positive semidefinite matrix of rank $k-\ell$ for $\ell=1, \ldots, k-1$.

Victor Salazar
Victor Salazar
Numerade Educator

Problem 44

Show that if $A \in \mathbb{C}^{n \times n}$, then
(12.59) $\quad A \succeq O \Longrightarrow A=A^H$ and $\operatorname{det} A_{[1, k]} \geq 0$ for $k=1, \ldots, n$, but the converse implication is false.

Check back soon!
01:00

Problem 45

Let $A \in \mathbb{C}^{n \times n}$. Show that $A=A^H \quad$ and $\quad \sigma(A) \subset[0, \infty) \Longleftrightarrow A \succeq O$.

Nick Johnson
Nick Johnson
Numerade Educator

Problem 46

Show that if $A, B \in \mathbb{C}^{n \times n}$ and if $A \succ O$ and $B=B^H$, then there exists a matrix $V \in \mathbb{C}^{n \times n}$ such that
$$
V^H A V=I_n \quad \text { and } \quad V^H B V=D=\operatorname{diag}\left\{\lambda_1, \ldots, \lambda_n\right\} .
$$

Check back soon!
05:35

Problem 47

Show that if $A, B \in \mathbb{C}^{n \times n}$ and $A \succeq B \succ O$, then $B^{-1} \succeq$ $A^{-1} \succ O$. [HINT: $A-B \succ O \Longrightarrow A^{-1 / 2} B A^{-1 / 2} \prec I_n$.]

Sirat Shah
Sirat Shah
Numerade Educator
07:32

Problem 48

Show that if $A, B \in \mathbb{C}^{n \times n}$ and if $A \succeq O$ and $B \succeq O$, then trace $A B \geq 0$ (even if $A B \nsucceq O$ ).

Christopher Stanley
Christopher Stanley
Numerade Educator

Problem 49

Complete the proof of assertion (1) in Theorem 12.22.

Check back soon!

Problem 50

Verify assertion (2) in Theorem 12.22 .

Check back soon!
02:13

Problem 51

Show that if $U U^H=V V^H$ for a pair of matrices $U, V \in$ $\mathbb{C}^{n \times d}$ with $\operatorname{rank} U=\operatorname{rank} V=d$, then $U=V K$ for some unitary matrix $K \in \mathbb{C}^{d \times d}$.

Victor Salazar
Victor Salazar
Numerade Educator
04:26

Problem 52

Find an isometric matrix $V_1$ and a matrix $P_1 \succ O$ such that $\left[\begin{array}{ll}1 & 0 \\ 1 & 1 \\ 0 & 1\end{array}\right]=V_1 P_1$.

Chris Trentman
Chris Trentman
Numerade Educator

Problem 53

Show that if $K \in \mathbb{C}^{r \times p}$ and $\widetilde{K} \in \mathbb{C}^{r \times p}$ both meet the two conditions in (12.62), then $K=\widetilde{K}$ and hence that $K$ is uniquely specified in terms of the Moore-Penrose inverse $F^{\dagger}$ of $F$ by the formula $K=G F F^{\dagger}$.

Check back soon!
02:30

Problem 54

Let $A=\left[\begin{array}{ll}2 & 1 \\ 1 & 1\end{array}\right]$ and $B=\left[\begin{array}{ll}1 & 0 \\ 0 & 0\end{array}\right]$. Show that $A-B \succ O$, but $A^2-B^2$ has one positive eigenvalue and one negative eigenvalue.

Srilakshmi E K
Srilakshmi E K
Numerade Educator

Problem 55

Complete the proof of Corollary 12.27.

Check back soon!
02:13

Problem 56

Show that if $U, V \in \mathbb{C}^{n \times d}$ and $\operatorname{rank} U=\operatorname{rank} V=d$, then $U U^H=V V^H \Longleftrightarrow U=V K$ for some unitary matrix $K \in \mathbb{C}^{d \times d}$.

Victor Salazar
Victor Salazar
Numerade Educator

Problem 57

Show that if $A \in \mathbb{C}^{n \times n}$ and $O \preceq A \preceq I_n$, then a vector $\mathbf{x} \in \mathcal{R}_{\left(I_n-A\right)}$ if and only if
$$
\lim _{\delta \uparrow 1}\left\langle\left(I_n-\delta A\right)^{-1} \mathbf{x}, \mathbf{x}\right\rangle<\infty .
$$

Check back soon!

Problem 58

Show that if $A, B \in \mathbb{C}^{n \times n}$ and if $A \succ O$ and $B \succ O$, then
$$
\sqrt{\operatorname{det} A \operatorname{det} B} \leq \operatorname{det} \frac{A+B}{2} \text {. }
$$

Check back soon!
01:21

Problem 59

Show that if $A, B \in \mathbb{C}^{n \times n}$ and if $A B=O$ but $A+B \succ O$, then there exists a unitary matrix $U \in \mathbb{C}^{n \times n}$ such that
$$
U^H A U=\left[\begin{array}{cc}
A_{11} & O \\
O & O
\end{array}\right] \quad \text { and } \quad U^H B U=\left[\begin{array}{cc}
O & O \\
O & B_{22}
\end{array}\right] \text {, }
$$
where $A_{11} \succ O$ and $B_{22} \succ O$.

Eleanor Johnson
Eleanor Johnson
Numerade Educator