let-aleftbeginarrayrr3-4-2-1-3-4endarrayright-mathbfbleftbeginarrayr11-9-5endarrayright-mathbfuleftb

Question

Let $A=\left[\begin{array}{rr}{3} & {4} \ {-2} & {1} \ {3} & {4}\end{array}ight], \mathbf{b}=\left[\begin{array}{r}{11} \ {-9} \ {5}\end{array}ight], \mathbf{u}=\left[\begin{array}{r}{5} \ {-1}\end{array}ight],$ and $\mathbf{v}=$ $\left[\begin{array}{r}{5} \ {-2}\end{array}ight] .$ Compute $A \mathbf{u}$ and $A \mathbf{v},$ and compare them with $\mathbf{b}$ . Could $\mathbf{u}$ possibly be a least-squares solution of $A \mathbf{x}=\mathbf{b} ?$ (Answer this without computing a least-squares solution.)

Angelo Rendina · Accepted Answer

were given A and B and also the vectors U and we and were asked to compute first a U and U V and then decide whether either of them could be one of the least square solutions to a X equal. Be so we begin by computing a u do the multiplication you get Ah 382 and their will to do a V and he becomes 7 to 8. Now we compute the distance from me so a U minus b is minus till four minus two and the baby is mine. It was meant to be is to minus two and four now. Hey, you would be Ali Square Solutions to x equal be if a human is being so the vector in the bottom left where our focus now to the columns of a But we can immediately check that it is not so that factor minus 24 months, too. It&#x27;s not orthogonal to the columns of a so we know that a you cannot be Ali square solution. Similarly, the vector two months to four So a B minus B. He&#x27;s no door for go now to the columns of a either and That means that a bee cannot be one of the least square solutions to the system a X equal be

Angelo Rendina · Answer

we are given the cue are the composition of a I want to find the least choir solution to a X equal Be so we first started computing que transposed being you do the multiplication and turns out to be 17 house and nine hours. And now since we have the cure the composition, we can find the least square solution By solving the system, Our ex hat is equal to you. Transpose be now our ease up square two by two metrics So we can just all way by inverting are so x hot is equal to well, the inverse of our turns out to be 1/10 off five months 302 That multiplies u transpose being so 17 house and nine house So 1/10 off we do the multiplication So we&#x27;re left with 29 9 So the solution for X hat he&#x27;s the vector 2.90 point nine And this is the least square solutions

Angelo Rendina · Answer

we want to find the least square solutions off the system a x equal be. And we know that to do so, we need to solve the system. A transpose a X hat equals a transpose. Be so we have our medics say, which is 131 minus 111 We right, it&#x27;s transposed and she&#x27;s real that we will have to use a transpose a and a transpose be. Let&#x27;s start by computing those mattresses. So a transpose a after doing the multiplication turns out to be 333 11 and then a transpose be is 6 14 Now we want to solve the equation. A transpose a x hot is equal to a transpose me and scenes. A transpose a is a two by two matrix and is in veritable weaken. Just solve the system by multiplying from the left by the transports off a transpose. A. So accept is a transpose. A inverse times eight ounce will be, and now we have all the ingredients because in red that we have the verse of a transpose a so won over determinant, which is 24 times 11 3 minus three minutes three and then a transpose bees 6 14 because we computed there already. Now we can just multiply the mattresses. So we get one over 24 that multiplies the metrics 24 24. And so after dividing, we just We&#x27;re just left with the solution for X hat, which is 11

Ryan Sander · Answer

Hello Today we&#x27;ll be talking about least squares and using normal equation. So in general, the least squares framework aims to solve the problem of a X equals beef and solving for an optimal X uh, which we did note with a hat to indicate that it&#x27;s a no approximation. So the normal equations aim to solve this by adding an a transpose to each side&#x27;s. We have a transpose a X equals a transposed B and then a transpose a. This is what&#x27;s known as some ah positive semi definite Ah, symmetric positive, semi definite actually. And what this means is that it&#x27;s always in vertebral because it it&#x27;s Eigen values. Will all these be greater than zero? So what this allows us to dio is actually take the inverse of this and weaken dio moving this here weaken dio a transpose a inverse a trends Sorry mess that up a transpose a inverse a transpose a X equals a transpose a in verse a transposed Be these cancel and we&#x27;re left with X hat is equal to a transpose a inverse, a transposed Be So now Ah, let&#x27;s so for this estimator of X when this is what&#x27;s called is the OLS estimator. Now we&#x27;re ready. Toe sulphur This and so are in this case, we have a equals negative 12 to negative three. I could have won three and b is equal to for one to And so we could first will sell for a transpose a a transpose a is equal to I think it if 1 to 2 you negative three will Negative Sorry. Negative 13 transposed times. Negative one to to to give three of 13 and this is going to be equal. Teoh Well, dio in this case, we will do. Let&#x27;s write this as you have borne Teoh negative to negative 33 And then this is negative for two to negative three negative 13 And so this is a two by three and this is a three by two. The inter dimensions match and the dimensions of the new matrix will be to buy toothy outer dimensions and this will be equal to it will be row by column. So, Toby, negative one times negative one plus negative to just two squared plus negative one squared, which is one plus four plus one is six Ah, and then that&#x27;s first row by second column, which is going to be negative to negative war. Negative one times two, two times negative. Three negative one times three. That&#x27;s going to give us negative too minus six minus three. That&#x27;s negative. 11. And then similarly, the ah diagonals. Will I? I&#x27;m sorry. The off diagonal elements will match each other because a transpose a all right, there&#x27;s appear a transpose a transpose equals a transposed a. So the it&#x27;s the same thing, which means that often I got the elements will be the same. And then, for the last one, it will be, Ah, the second row temps. The second column, which is two times two plus negative three times negative three plus three times three, which is for two squared plus negative. Three squared Plus three squared, which is four plus nine plus nine, which is 22. So this is a transpose a and now we have to invert this so well, right? A transpose a inverted will be offer to buy two elements. This is one over the determinant of a transposed a times. Um see, I think it&#x27;s yes, it&#x27;s a suit to do this will take the determinant of a trans purpose A and then swap. Ah, dear. Negative. Be negative. C and a where these are the four elements of these are the fortunate elements of a tree. It&#x27;s was a And this will give us Ah, the determinant of this of a transpose a This is going to be equal. Teoh Um a D minus B C, which is six times 22 minus negative, 11 times negative 11 which is going to be 1 30 to minus. Um negative 11 squared. So minus 1 21 which is going to give us 11. Yes, 11. And then this will be 1/11 times. Ah, 22 11 11 and six. So this is, uh, a transpose a inverted. We could see that it indeed is in vertebral. And that again is because the Matrix is symmetric positive, semi definite. So now let&#x27;s back up for just a second. We have a transpose a in verse just equal to one over 11. 20 to 11 11 6. And then now we just need a transposed Be well so for this here. So we have again that Ah, this is going to be negative one to negative one and just taking the transposed to actually and then to negative 33 and be our column. Vector is going to be 412 Ah, and here the dimensions are again to buy three and through by one. So now, in this case, the resulting dimensions will be the outer dimensions to buy one. So this will be equal to the first row times the column times the secondary times that column. So, first year of times, the only column we have here is negative. One times for plus two times 12 plus negative one times two and that&#x27;s going to give us negative four. And then, um, the second element of this to buy one column vector is two times for which is eight plus negative. Three times negative types, one which is negative three plus three times to which is six. That&#x27;s going to give us 11 smell for you. Go down here now back up one more time If you recall our estimator is given by a transpose a inverse, a transposed be. And as we found, we now have ah explicit formula for this. This is given by 1/11 22 11 11 6. This is a two by two matrix and then a trans pose B is given by negative four and 11 Akane Vector of negative four and 11. So now we have a two by two by two by one inner dimensions match or good outer dimensions again will be it to buy one, which is actually what we&#x27;d expect because the least scores estimators should match the dimensionality. Um, of thea of the column space of A. This is given by 1/11. Ah, we do the first row by the column and then the second row by the column. So this is given by 22 times negative four plus 11 times, 11 in the first column and then 11 times negative for plus six times 11. The second element and, ah, we can actually just divide everything out by 11 beforehand. So this will be two times negative for, ah cancelling out that 22 11 1/11 and then plus one times 11 just cancelling out one of the 11 and then similarly below we cancel out the 1st 11. We get one times negative for Waas six times 11/11 which is just six times one. And this gives us our final answer for X hat. The least squares estimator, which is negative. Eight plus 11. And the first element, which is equal to three. And then negative four plus six, which is equal to two. And that is our least squares solution. Using the normal equations A calm victor of three. The first element to in the second Thank you.

Angelo Rendina · Answer

we observed that the columns of a roo for you know, therefore, we can easily compute their fucking a projection on be on the span of the columns of a So they&#x27;re throwing a projection of me. The hat is just the projection on tow. The first column of a off me bluff. The projection onto the second column of a off B and this is just an easy computation. We get 95 by three. The first column, a one bluff Delacroix efficient is 12 the water by 24 times the second column away and putting all this together, we see that be hat is four minus 14 Now, to find the least square solution, we would need to solve the system a X hat, equal be hat. But we see immediately from the from the formula here what the interest of acts at our because these proficient here 9 91 every three and these other condition tear 12 year, October 24 are dentists of Accent. So immediately we see that exact is given by well $90.33 and 12 divided by 24 which is 1/2 and at the least, choir solution

Problem

Let $A=\left[\begin{array}{rr}{2} & {1} \\ {-3} &…

Problem 13 Easy Difficulty

Answer

u cannot be a least squares solution of $A \mathbf{x}=\mathbf{b}$

Related Courses

Linear Algebra and Its Applications

Related Topics

Discussion

Top Calculus 3 Educators

Catherine R.

Caleb E.

Kristen K.

Samuel H.

Calculus 3 Courses

Vectors Intro

Vector Basics - Example 1

Recommended Videos

Watch More Solved Questions in Chapter 6

Video Transcript

David C. Lay, Steven R. Lay, Judi J. McDonald

Linear Algebra and Its Applications

Catherine R.

Caleb E.

Kristen K.

Samuel H.

Vectors Intro

Vector Basics - Example 1

What do you need help with?

Textbooks

Ask a question

Courses

AI Tutor

u cannot be a least squares solution of $A \mathbf{x}=\mathbf{b}$

Linear Algebra and Its Applications

Catherine R.

Caleb E.

Kristen K.

Samuel H.

Vectors Intro

Vector Basics - Example 1

David C. Lay, Steven R. Lay, Judi J. McDonaldLinear Algebra and Its Applications

Catherine R.

Caleb E.

Kristen K.

Samuel H.

David C. Lay, Steven R. Lay, Judi J. McDonald

Linear Algebra and Its Applications