How to find projection matrix of the singular matrix onto fundamental subspaces?
$begingroup$
begin{align}
A & =begin{bmatrix}2&3\6&9end{bmatrix}
end{align}
I found four fundamental subspaces of A which are
begin{align}
C(A) & =begin{bmatrix}2\6end{bmatrix} , dimension = 1
end{align}
begin{align}
C(A^T) & =begin{bmatrix}2\3end{bmatrix} , dimension = 1
end{align}
begin{align}
N(A) & =begin{bmatrix}-3\2end{bmatrix} , dimension = 1
end{align}
begin{align}
N(A^T) & =begin{bmatrix}3\-1end{bmatrix} , dimension = 1
end{align}
The first question is that "Find the projection matrices onto each of the fundamental subspaces"
and I used the formula that the projection matrix on to C(A) is
begin{align}
P & = A(A^TA)^{-1}A^T
end{align}
However, how to find the projection matrix if
begin{align}
det(A^TA) = 0 ?
end{align}
I thought I couldn't find the projection matrix onto C(A) and even other subspaces because A^TA is singular matrix.
So, please let me know what is projection matrix onto each of the fundamental subsapces and how to find them.
Next question is that "Write the vector b = (2,2) as a linear combination of a vector in C(A) and N(A^T)
I thought this question was asking to solve
begin{align}
a & begin{bmatrix}2\6end{bmatrix} + bbegin{bmatrix}3\-1end{bmatrix} = begin{bmatrix}2\2end{bmatrix}
end{align}
using vectors from C(A) and N(A^T) we found in previous problem.
so, I got a = 2/5 and b = 2/5 from the above equation I made.
Please let me know how to write vector b as a linear combination of a vector in column space and left null space.
linear-algebra vector-spaces vectors projection-matrices
$endgroup$
add a comment |
$begingroup$
begin{align}
A & =begin{bmatrix}2&3\6&9end{bmatrix}
end{align}
I found four fundamental subspaces of A which are
begin{align}
C(A) & =begin{bmatrix}2\6end{bmatrix} , dimension = 1
end{align}
begin{align}
C(A^T) & =begin{bmatrix}2\3end{bmatrix} , dimension = 1
end{align}
begin{align}
N(A) & =begin{bmatrix}-3\2end{bmatrix} , dimension = 1
end{align}
begin{align}
N(A^T) & =begin{bmatrix}3\-1end{bmatrix} , dimension = 1
end{align}
The first question is that "Find the projection matrices onto each of the fundamental subspaces"
and I used the formula that the projection matrix on to C(A) is
begin{align}
P & = A(A^TA)^{-1}A^T
end{align}
However, how to find the projection matrix if
begin{align}
det(A^TA) = 0 ?
end{align}
I thought I couldn't find the projection matrix onto C(A) and even other subspaces because A^TA is singular matrix.
So, please let me know what is projection matrix onto each of the fundamental subsapces and how to find them.
Next question is that "Write the vector b = (2,2) as a linear combination of a vector in C(A) and N(A^T)
I thought this question was asking to solve
begin{align}
a & begin{bmatrix}2\6end{bmatrix} + bbegin{bmatrix}3\-1end{bmatrix} = begin{bmatrix}2\2end{bmatrix}
end{align}
using vectors from C(A) and N(A^T) we found in previous problem.
so, I got a = 2/5 and b = 2/5 from the above equation I made.
Please let me know how to write vector b as a linear combination of a vector in column space and left null space.
linear-algebra vector-spaces vectors projection-matrices
$endgroup$
$begingroup$
That formula only applies when $A$ has full rank. Otherwise, as you’ve discovered, $A^TA$ is not invertible.
$endgroup$
– amd
Dec 8 '18 at 7:05
add a comment |
$begingroup$
begin{align}
A & =begin{bmatrix}2&3\6&9end{bmatrix}
end{align}
I found four fundamental subspaces of A which are
begin{align}
C(A) & =begin{bmatrix}2\6end{bmatrix} , dimension = 1
end{align}
begin{align}
C(A^T) & =begin{bmatrix}2\3end{bmatrix} , dimension = 1
end{align}
begin{align}
N(A) & =begin{bmatrix}-3\2end{bmatrix} , dimension = 1
end{align}
begin{align}
N(A^T) & =begin{bmatrix}3\-1end{bmatrix} , dimension = 1
end{align}
The first question is that "Find the projection matrices onto each of the fundamental subspaces"
and I used the formula that the projection matrix on to C(A) is
begin{align}
P & = A(A^TA)^{-1}A^T
end{align}
However, how to find the projection matrix if
begin{align}
det(A^TA) = 0 ?
end{align}
I thought I couldn't find the projection matrix onto C(A) and even other subspaces because A^TA is singular matrix.
So, please let me know what is projection matrix onto each of the fundamental subsapces and how to find them.
Next question is that "Write the vector b = (2,2) as a linear combination of a vector in C(A) and N(A^T)
I thought this question was asking to solve
begin{align}
a & begin{bmatrix}2\6end{bmatrix} + bbegin{bmatrix}3\-1end{bmatrix} = begin{bmatrix}2\2end{bmatrix}
end{align}
using vectors from C(A) and N(A^T) we found in previous problem.
so, I got a = 2/5 and b = 2/5 from the above equation I made.
Please let me know how to write vector b as a linear combination of a vector in column space and left null space.
linear-algebra vector-spaces vectors projection-matrices
$endgroup$
begin{align}
A & =begin{bmatrix}2&3\6&9end{bmatrix}
end{align}
I found four fundamental subspaces of A which are
begin{align}
C(A) & =begin{bmatrix}2\6end{bmatrix} , dimension = 1
end{align}
begin{align}
C(A^T) & =begin{bmatrix}2\3end{bmatrix} , dimension = 1
end{align}
begin{align}
N(A) & =begin{bmatrix}-3\2end{bmatrix} , dimension = 1
end{align}
begin{align}
N(A^T) & =begin{bmatrix}3\-1end{bmatrix} , dimension = 1
end{align}
The first question is that "Find the projection matrices onto each of the fundamental subspaces"
and I used the formula that the projection matrix on to C(A) is
begin{align}
P & = A(A^TA)^{-1}A^T
end{align}
However, how to find the projection matrix if
begin{align}
det(A^TA) = 0 ?
end{align}
I thought I couldn't find the projection matrix onto C(A) and even other subspaces because A^TA is singular matrix.
So, please let me know what is projection matrix onto each of the fundamental subsapces and how to find them.
Next question is that "Write the vector b = (2,2) as a linear combination of a vector in C(A) and N(A^T)
I thought this question was asking to solve
begin{align}
a & begin{bmatrix}2\6end{bmatrix} + bbegin{bmatrix}3\-1end{bmatrix} = begin{bmatrix}2\2end{bmatrix}
end{align}
using vectors from C(A) and N(A^T) we found in previous problem.
so, I got a = 2/5 and b = 2/5 from the above equation I made.
Please let me know how to write vector b as a linear combination of a vector in column space and left null space.
linear-algebra vector-spaces vectors projection-matrices
linear-algebra vector-spaces vectors projection-matrices
asked Dec 8 '18 at 2:01
Rudy1996Rudy1996
32
32
$begingroup$
That formula only applies when $A$ has full rank. Otherwise, as you’ve discovered, $A^TA$ is not invertible.
$endgroup$
– amd
Dec 8 '18 at 7:05
add a comment |
$begingroup$
That formula only applies when $A$ has full rank. Otherwise, as you’ve discovered, $A^TA$ is not invertible.
$endgroup$
– amd
Dec 8 '18 at 7:05
$begingroup$
That formula only applies when $A$ has full rank. Otherwise, as you’ve discovered, $A^TA$ is not invertible.
$endgroup$
– amd
Dec 8 '18 at 7:05
$begingroup$
That formula only applies when $A$ has full rank. Otherwise, as you’ve discovered, $A^TA$ is not invertible.
$endgroup$
– amd
Dec 8 '18 at 7:05
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
Projection of a vector $bf{u}$ along the vector $bf{v}$ is given by $textbf{proj}_{bf{v}}bf{u}=left(frac{bf{u} cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v}$. So to get the projection matrix we can see what happens to the standard basis vectors $bf{e}_1$ and $bf{e}_2$, i.e.
$$textbf{proj}_{bf{v}}bf{e_1}=left(frac{bf{e}_1 cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v} qquad textbf{proj}_{bf{v}}bf{e_2}=left(frac{bf{e}_2 cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v}$$
Suppose we want the projection matrix for the fundamental space $C(A^T)$ so $bf{v}=begin{bmatrix}2\3end{bmatrix}$. Then,
$$textbf{proj}_{bf{v}}bf{e_1}=left(mathrm{frac{2}{13}}right)bf{v} qquad textbf{proj}_{bf{v}}bf{e_2}=left(mathrm{frac{3}{13}}right)bf{v}.$$
The projection matrix is given by
$$P=begin{bmatrix}uparrow & uparrow\ textbf{proj}_{bf{v}}bf{e_1} & textbf{proj}_{bf{v}}bf{e_2}\ downarrow & downarrow end{bmatrix}=begin{bmatrix}frac{4}{13} & frac{6}{13}\frac{6}{13} & frac{9}{13}end{bmatrix}$$
Now you can compute other projection matrices as well.
$endgroup$
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3030619%2fhow-to-find-projection-matrix-of-the-singular-matrix-onto-fundamental-subspaces%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
Projection of a vector $bf{u}$ along the vector $bf{v}$ is given by $textbf{proj}_{bf{v}}bf{u}=left(frac{bf{u} cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v}$. So to get the projection matrix we can see what happens to the standard basis vectors $bf{e}_1$ and $bf{e}_2$, i.e.
$$textbf{proj}_{bf{v}}bf{e_1}=left(frac{bf{e}_1 cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v} qquad textbf{proj}_{bf{v}}bf{e_2}=left(frac{bf{e}_2 cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v}$$
Suppose we want the projection matrix for the fundamental space $C(A^T)$ so $bf{v}=begin{bmatrix}2\3end{bmatrix}$. Then,
$$textbf{proj}_{bf{v}}bf{e_1}=left(mathrm{frac{2}{13}}right)bf{v} qquad textbf{proj}_{bf{v}}bf{e_2}=left(mathrm{frac{3}{13}}right)bf{v}.$$
The projection matrix is given by
$$P=begin{bmatrix}uparrow & uparrow\ textbf{proj}_{bf{v}}bf{e_1} & textbf{proj}_{bf{v}}bf{e_2}\ downarrow & downarrow end{bmatrix}=begin{bmatrix}frac{4}{13} & frac{6}{13}\frac{6}{13} & frac{9}{13}end{bmatrix}$$
Now you can compute other projection matrices as well.
$endgroup$
add a comment |
$begingroup$
Projection of a vector $bf{u}$ along the vector $bf{v}$ is given by $textbf{proj}_{bf{v}}bf{u}=left(frac{bf{u} cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v}$. So to get the projection matrix we can see what happens to the standard basis vectors $bf{e}_1$ and $bf{e}_2$, i.e.
$$textbf{proj}_{bf{v}}bf{e_1}=left(frac{bf{e}_1 cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v} qquad textbf{proj}_{bf{v}}bf{e_2}=left(frac{bf{e}_2 cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v}$$
Suppose we want the projection matrix for the fundamental space $C(A^T)$ so $bf{v}=begin{bmatrix}2\3end{bmatrix}$. Then,
$$textbf{proj}_{bf{v}}bf{e_1}=left(mathrm{frac{2}{13}}right)bf{v} qquad textbf{proj}_{bf{v}}bf{e_2}=left(mathrm{frac{3}{13}}right)bf{v}.$$
The projection matrix is given by
$$P=begin{bmatrix}uparrow & uparrow\ textbf{proj}_{bf{v}}bf{e_1} & textbf{proj}_{bf{v}}bf{e_2}\ downarrow & downarrow end{bmatrix}=begin{bmatrix}frac{4}{13} & frac{6}{13}\frac{6}{13} & frac{9}{13}end{bmatrix}$$
Now you can compute other projection matrices as well.
$endgroup$
add a comment |
$begingroup$
Projection of a vector $bf{u}$ along the vector $bf{v}$ is given by $textbf{proj}_{bf{v}}bf{u}=left(frac{bf{u} cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v}$. So to get the projection matrix we can see what happens to the standard basis vectors $bf{e}_1$ and $bf{e}_2$, i.e.
$$textbf{proj}_{bf{v}}bf{e_1}=left(frac{bf{e}_1 cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v} qquad textbf{proj}_{bf{v}}bf{e_2}=left(frac{bf{e}_2 cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v}$$
Suppose we want the projection matrix for the fundamental space $C(A^T)$ so $bf{v}=begin{bmatrix}2\3end{bmatrix}$. Then,
$$textbf{proj}_{bf{v}}bf{e_1}=left(mathrm{frac{2}{13}}right)bf{v} qquad textbf{proj}_{bf{v}}bf{e_2}=left(mathrm{frac{3}{13}}right)bf{v}.$$
The projection matrix is given by
$$P=begin{bmatrix}uparrow & uparrow\ textbf{proj}_{bf{v}}bf{e_1} & textbf{proj}_{bf{v}}bf{e_2}\ downarrow & downarrow end{bmatrix}=begin{bmatrix}frac{4}{13} & frac{6}{13}\frac{6}{13} & frac{9}{13}end{bmatrix}$$
Now you can compute other projection matrices as well.
$endgroup$
Projection of a vector $bf{u}$ along the vector $bf{v}$ is given by $textbf{proj}_{bf{v}}bf{u}=left(frac{bf{u} cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v}$. So to get the projection matrix we can see what happens to the standard basis vectors $bf{e}_1$ and $bf{e}_2$, i.e.
$$textbf{proj}_{bf{v}}bf{e_1}=left(frac{bf{e}_1 cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v} qquad textbf{proj}_{bf{v}}bf{e_2}=left(frac{bf{e}_2 cdot bf{v}}{bf{v} cdot bf{v}}right)bf{v}$$
Suppose we want the projection matrix for the fundamental space $C(A^T)$ so $bf{v}=begin{bmatrix}2\3end{bmatrix}$. Then,
$$textbf{proj}_{bf{v}}bf{e_1}=left(mathrm{frac{2}{13}}right)bf{v} qquad textbf{proj}_{bf{v}}bf{e_2}=left(mathrm{frac{3}{13}}right)bf{v}.$$
The projection matrix is given by
$$P=begin{bmatrix}uparrow & uparrow\ textbf{proj}_{bf{v}}bf{e_1} & textbf{proj}_{bf{v}}bf{e_2}\ downarrow & downarrow end{bmatrix}=begin{bmatrix}frac{4}{13} & frac{6}{13}\frac{6}{13} & frac{9}{13}end{bmatrix}$$
Now you can compute other projection matrices as well.
answered Dec 8 '18 at 2:16
Anurag AAnurag A
25.9k12249
25.9k12249
add a comment |
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3030619%2fhow-to-find-projection-matrix-of-the-singular-matrix-onto-fundamental-subspaces%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
That formula only applies when $A$ has full rank. Otherwise, as you’ve discovered, $A^TA$ is not invertible.
$endgroup$
– amd
Dec 8 '18 at 7:05