Question

Let $A$ be an $n \times n$ matrix with singular value vector $\sigma=\left(\sigma_1, \ldots, \sigma_r\right)$. Prove that (a) $\|\boldsymbol{\sigma}\|_{\infty}=\|A\|_2 ;$ (b) $\|\sigma\|_2=\|A\|_F$, the Frobenius norm of Exercise 3.3.51. Remark. The 1 norm of the singular value vector $\|\boldsymbol{\sigma}\|_1$ also defines a useful matrix norm, known as the $K y$ Fan norm. $$ \sum_{i=1}^r \sigma_i^2=\sum_{i=1}^m \sum_{j=1}^n a_{i j}^2 $$ 8.7.32. Let $A$ be a nonsingular square matrix. Prove the following formulas for its condition number: (a) $\kappa(A)=\frac{\max \{\|A \mathbf{u}\| \mid\|\mathbf{u}\|=1\}}{\min \{\|A \mathbf{u}\| \mid\|\mathbf{u}\|=1\}}$, (b) $\kappa(A)=\|A\|_2\left\|A^{-1}\right\|_2$. 8.7.33. Find the pseudoinverse of the following matrices: (a) $\left(\begin{array}{rr}1 & -1 \\ -3 & 3\end{array}\right)$ (b) $\left(\begin{array}{rr}1 & -2 \\ 2 & 1\end{array}\right)$, (c) $\left(\begin{array}{rr}2 & 0 \\ 0 & -1 \\ 0 & 0\end{array}\right)$, (d) $\left(\begin{array}{rrr}0 & 0 & 1 \\ 0 & -1 & 0 \\ 0 & 0 & 0\end{array}\right)$, (e) $\left(\begin{array}{rrr}1 & -1 & 1 \\ -2 & 2 & -2\end{array}\right)$, (f) $\left(\begin{array}{ll}1 & 3 \\ 2 & 6 \\ 3 & 9\end{array}\right)$, (g) $\left(\begin{array}{rrr}1 & 2 & 0 \\ 0 & 1 & 1 \\ 1 & 1 & -1\end{array}\right)$.

    Let $A$ be an $n \times n$ matrix with singular value vector $\sigma=\left(\sigma_1, \ldots, \sigma_r\right)$. Prove that
(a) $\|\boldsymbol{\sigma}\|_{\infty}=\|A\|_2 ;$ (b) $\|\sigma\|_2=\|A\|_F$, the Frobenius norm of Exercise 3.3.51.
Remark. The 1 norm of the singular value vector $\|\boldsymbol{\sigma}\|_1$ also defines a useful matrix norm, known as the $K y$ Fan norm.

$$
\sum_{i=1}^r \sigma_i^2=\sum_{i=1}^m \sum_{j=1}^n a_{i j}^2
$$
8.7.32. Let $A$ be a nonsingular square matrix. Prove the following formulas for its condition number:
(a) $\kappa(A)=\frac{\max \{\|A \mathbf{u}\| \mid\|\mathbf{u}\|=1\}}{\min \{\|A \mathbf{u}\| \mid\|\mathbf{u}\|=1\}}$,
(b) $\kappa(A)=\|A\|_2\left\|A^{-1}\right\|_2$.
8.7.33. Find the pseudoinverse of the following matrices:
(a) $\left(\begin{array}{rr}1 & -1 \\ -3 & 3\end{array}\right)$
(b) $\left(\begin{array}{rr}1 & -2 \\ 2 & 1\end{array}\right)$,
(c) $\left(\begin{array}{rr}2 & 0 \\ 0 & -1 \\ 0 & 0\end{array}\right)$,
(d) $\left(\begin{array}{rrr}0 & 0 & 1 \\ 0 & -1 & 0 \\ 0 & 0 & 0\end{array}\right)$,
(e) $\left(\begin{array}{rrr}1 & -1 & 1 \\ -2 & 2 & -2\end{array}\right)$,
(f) $\left(\begin{array}{ll}1 & 3 \\ 2 & 6 \\ 3 & 9\end{array}\right)$,
(g) $\left(\begin{array}{rrr}1 & 2 & 0 \\ 0 & 1 & 1 \\ 1 & 1 & -1\end{array}\right)$.
Show more…
Applied Linear Algebra (Undergraduate Texts in Mathematics)
Applied Linear Algebra (Undergraduate Texts in Mathematics)
Peter J. Olver,… 2nd Edition
Chapter 8, Problem 30 ↓

Instant Answer

verified

Step 1

### Part (a) $\|\boldsymbol{\sigma}\|_{\infty}=\|A\|_2$ **  Show more…

Show all steps

lock
AceChat toggle button
Close icon
Ace pointing down

Please give Ace some feedback

Your feedback will help us improve your experience

Thumb up icon Thumb down icon
Thanks for your feedback!
Profile picture
Let $A$ be an $n \times n$ matrix with singular value vector $\sigma=\left(\sigma_1, \ldots, \sigma_r\right)$. Prove that (a) $\|\boldsymbol{\sigma}\|_{\infty}=\|A\|_2 ;$ (b) $\|\sigma\|_2=\|A\|_F$, the Frobenius norm of Exercise 3.3.51. Remark. The 1 norm of the singular value vector $\|\boldsymbol{\sigma}\|_1$ also defines a useful matrix norm, known as the $K y$ Fan norm. $$ \sum_{i=1}^r \sigma_i^2=\sum_{i=1}^m \sum_{j=1}^n a_{i j}^2 $$ 8.7.32. Let $A$ be a nonsingular square matrix. Prove the following formulas for its condition number: (a) $\kappa(A)=\frac{\max \{\|A \mathbf{u}\| \mid\|\mathbf{u}\|=1\}}{\min \{\|A \mathbf{u}\| \mid\|\mathbf{u}\|=1\}}$, (b) $\kappa(A)=\|A\|_2\left\|A^{-1}\right\|_2$. 8.7.33. Find the pseudoinverse of the following matrices: (a) $\left(\begin{array}{rr}1 & -1 \\ -3 & 3\end{array}\right)$ (b) $\left(\begin{array}{rr}1 & -2 \\ 2 & 1\end{array}\right)$, (c) $\left(\begin{array}{rr}2 & 0 \\ 0 & -1 \\ 0 & 0\end{array}\right)$, (d) $\left(\begin{array}{rrr}0 & 0 & 1 \\ 0 & -1 & 0 \\ 0 & 0 & 0\end{array}\right)$, (e) $\left(\begin{array}{rrr}1 & -1 & 1 \\ -2 & 2 & -2\end{array}\right)$, (f) $\left(\begin{array}{ll}1 & 3 \\ 2 & 6 \\ 3 & 9\end{array}\right)$, (g) $\left(\begin{array}{rrr}1 & 2 & 0 \\ 0 & 1 & 1 \\ 1 & 1 & -1\end{array}\right)$.
Close icon
Play audio
Feedback
Powered by NumerAI
*

Labs

-

Want to see this concept in action?

NEW

Explore this concept interactively to see how it behaves as you change inputs.

View Labs

*

Key Concepts

-
Pseudoinverse
The pseudoinverse, often referred to as the Moore-Penrose pseudoinverse, generalizes the notion of an inverse to non-square or singular matrices. It is computed via singular value decomposition and is particularly useful in the context of least-squares solutions and handling over- or under-determined systems, ensuring a best-fit solution even when a unique solution does not exist.
Singular Value Decomposition
The singular value decomposition (SVD) is a fundamental factorization of a matrix into three components where the diagonal matrix contains the singular values. These singular values provide key insights into the properties of the matrix, including its norm, rank, and stability characteristics, and are essential in connecting various matrix norms through their relationships.
Matrix Norms
Matrix norms measure the size or magnitude of a matrix. Notably, the operator (or spectral) norm equals the largest singular value, while the Frobenius norm is the square root of the sum of the squares of all singular values, which is equivalent to the square root of the sum of the squares of all the entries in the matrix. These norms are crucial in analyzing the behavior and sensitivity of matrices.
Condition Number
The condition number quantifies the sensitivity of a matrix to perturbations and errors in numerical computations. It is commonly defined as the ratio of the maximum to the minimum singular values, or equivalently, as the product of the operator norm of the matrix and that of its inverse. A high condition number indicates potential numerical instability in solving systems involving the matrix.

*

Recommended Videos

-
q1_-let-a-be-an-n-x-n-matrix-and-denote-by-ilallf-the-frobenius-norm-of-a-recall-that-the-frobenius-norm-has-the-following-equivalent-definition-iai-laijl-traceat-a-show-that-ilail-iiuallf-f-05138

Let A be an n x n matrix and denote by ||A||F the Frobenius norm of A. Recall that the Frobenius norm has the following equivalent definition: ||A||F^2 = ̱∑(i,j) |aij|^2 = trace(A^T A) a) Show that ||A||F = ||UA||F for any orthogonal n x n matrix U. b) Show that ||A||F = ||AV||F for any orthogonal n x n matrix V. Q2. For the following questions, use the results from (Q1.). a) Conclude that ||A||F = √(∑(i=1 to n) ̱̱σi^2), where σ1 ≥ σ2 ≥ ... ≥ σn ≥ 0 are the singular values of A. b) Using what we know about the SVD of A^-1 given the SVD of A, find κF(A), the condition number for A in Frobenius norm, in terms of the singular values of A. (It will be a nasty-looking expression. Don't be scared. It cannot be simplified.)

Need help? Use Ace
Ace is your personal tutor. It breaks down any question with clear steps so you can learn.
Start Using Ace
Ace is your personal tutor for learning
Step-by-step explanations
Instant summaries
Summarize YouTube videos
Understand textbook images or PDFs
Study tools like quizzes and flashcards
Listen to your notes as a podcast
Continue solving this problem
Create a free account to:
  • View full step-by-step solution
  • Ask follow-up questions with Ace AI
  • Save progress and study later
Continue Free
Numerade

Get step-by-step video solution
from top educators

Continue with Clever
or



By creating an account, you agree to the Terms of Service and Privacy Policy
Already have an account? Log In

A free answer
just for you

Watch the video solution with this free unlock.

Numerade

Log in to watch this video
...and 100,000,000 more!


EMAIL

PASSWORD

OR
Continue with Clever