Range space $mathcal{R}(textbf{A})$ the same as $mathcal{R}(textbf{AA}^H)$?
$begingroup$
I'm working on a problem as follows:
Given $textbf{A}inmathbb{C}^{Mtimes N}$, show that $mathcal{R}(textbf{A})=mathcal{R}(textbf{AA}^H)$
where $mathcal{R}()$ denotes the range space of a matrix/transformation and $*^H$ denotes the conjugate transpose of a matrix.
I'm trying to show this by using SVD, but I get stuck relating $textbf{A}$ to $textbf{AA}^H$. So far, I have:
$textbf{A}=textbf{U}Sigmatextbf{V}^H$
$textbf{AA}^H=textbf{U}Sigmatextbf{V}^Htextbf{A}^H$
$textbf{AA}^H=textbf{U}textbf{U}^HSigmaSigma^Htextbf{V}^Htextbf{V}$
Note that $textbf{U}$ is the unitary $mtimes m$ matrix in SVD, $textbf{V}^H$ is the unitary $ntimes n$, and $Sigma$ is the matrix of singular values.
I know that the columns of $textbf{U}$ form a basis for $mathcal{R}(textbf{A})$, but when I use the SVD of A to try to do SVD on AA^H, I get to $textbf{UU}^H$, which is just the identity matrix and thus can't be a basis for a complex space?
Am I going about this all wrong, or is there some misstep I've made that's preventing me from solving the problem?
linear-algebra svd
$endgroup$
add a comment |
$begingroup$
I'm working on a problem as follows:
Given $textbf{A}inmathbb{C}^{Mtimes N}$, show that $mathcal{R}(textbf{A})=mathcal{R}(textbf{AA}^H)$
where $mathcal{R}()$ denotes the range space of a matrix/transformation and $*^H$ denotes the conjugate transpose of a matrix.
I'm trying to show this by using SVD, but I get stuck relating $textbf{A}$ to $textbf{AA}^H$. So far, I have:
$textbf{A}=textbf{U}Sigmatextbf{V}^H$
$textbf{AA}^H=textbf{U}Sigmatextbf{V}^Htextbf{A}^H$
$textbf{AA}^H=textbf{U}textbf{U}^HSigmaSigma^Htextbf{V}^Htextbf{V}$
Note that $textbf{U}$ is the unitary $mtimes m$ matrix in SVD, $textbf{V}^H$ is the unitary $ntimes n$, and $Sigma$ is the matrix of singular values.
I know that the columns of $textbf{U}$ form a basis for $mathcal{R}(textbf{A})$, but when I use the SVD of A to try to do SVD on AA^H, I get to $textbf{UU}^H$, which is just the identity matrix and thus can't be a basis for a complex space?
Am I going about this all wrong, or is there some misstep I've made that's preventing me from solving the problem?
linear-algebra svd
$endgroup$
$begingroup$
Is there something that breaks down in this arguement for complex? math.stackexchange.com/q/349742 (sorry I got the wrong link initially)
$endgroup$
– TrostAft
Dec 5 '18 at 20:17
$begingroup$
Also shouldnt $AA^H = U Sigma V^H V Sigma U^H = U Sigma^2 U^H$? Then using this it's clear that they have the same rank.
$endgroup$
– TrostAft
Dec 5 '18 at 20:20
$begingroup$
Ah, the first resource was very helpful, I forgot to search for the question using transpose instead of conjugate transpose (to include real vector spaces and find an analog). Your second answer I think is what I was looking for - sometimes I miss the obvious. Thank you so much!
$endgroup$
– W. MacTurk
Dec 5 '18 at 20:26
1
$begingroup$
@TrostAft In fact $ Sigma^2$ corresponds to $Sigma Sigma^H$. $Sigma$ is not a square matrix. I agree this notation is often used, but can be misleading in some occasions. In particular, we don't get the same $Sigma^2$ when calculating $AA^H$ or $A^HA$
$endgroup$
– Damien
Dec 5 '18 at 20:42
add a comment |
$begingroup$
I'm working on a problem as follows:
Given $textbf{A}inmathbb{C}^{Mtimes N}$, show that $mathcal{R}(textbf{A})=mathcal{R}(textbf{AA}^H)$
where $mathcal{R}()$ denotes the range space of a matrix/transformation and $*^H$ denotes the conjugate transpose of a matrix.
I'm trying to show this by using SVD, but I get stuck relating $textbf{A}$ to $textbf{AA}^H$. So far, I have:
$textbf{A}=textbf{U}Sigmatextbf{V}^H$
$textbf{AA}^H=textbf{U}Sigmatextbf{V}^Htextbf{A}^H$
$textbf{AA}^H=textbf{U}textbf{U}^HSigmaSigma^Htextbf{V}^Htextbf{V}$
Note that $textbf{U}$ is the unitary $mtimes m$ matrix in SVD, $textbf{V}^H$ is the unitary $ntimes n$, and $Sigma$ is the matrix of singular values.
I know that the columns of $textbf{U}$ form a basis for $mathcal{R}(textbf{A})$, but when I use the SVD of A to try to do SVD on AA^H, I get to $textbf{UU}^H$, which is just the identity matrix and thus can't be a basis for a complex space?
Am I going about this all wrong, or is there some misstep I've made that's preventing me from solving the problem?
linear-algebra svd
$endgroup$
I'm working on a problem as follows:
Given $textbf{A}inmathbb{C}^{Mtimes N}$, show that $mathcal{R}(textbf{A})=mathcal{R}(textbf{AA}^H)$
where $mathcal{R}()$ denotes the range space of a matrix/transformation and $*^H$ denotes the conjugate transpose of a matrix.
I'm trying to show this by using SVD, but I get stuck relating $textbf{A}$ to $textbf{AA}^H$. So far, I have:
$textbf{A}=textbf{U}Sigmatextbf{V}^H$
$textbf{AA}^H=textbf{U}Sigmatextbf{V}^Htextbf{A}^H$
$textbf{AA}^H=textbf{U}textbf{U}^HSigmaSigma^Htextbf{V}^Htextbf{V}$
Note that $textbf{U}$ is the unitary $mtimes m$ matrix in SVD, $textbf{V}^H$ is the unitary $ntimes n$, and $Sigma$ is the matrix of singular values.
I know that the columns of $textbf{U}$ form a basis for $mathcal{R}(textbf{A})$, but when I use the SVD of A to try to do SVD on AA^H, I get to $textbf{UU}^H$, which is just the identity matrix and thus can't be a basis for a complex space?
Am I going about this all wrong, or is there some misstep I've made that's preventing me from solving the problem?
linear-algebra svd
linear-algebra svd
edited Dec 5 '18 at 20:17
gangrene
905514
905514
asked Dec 5 '18 at 20:12
W. MacTurkW. MacTurk
105
105
$begingroup$
Is there something that breaks down in this arguement for complex? math.stackexchange.com/q/349742 (sorry I got the wrong link initially)
$endgroup$
– TrostAft
Dec 5 '18 at 20:17
$begingroup$
Also shouldnt $AA^H = U Sigma V^H V Sigma U^H = U Sigma^2 U^H$? Then using this it's clear that they have the same rank.
$endgroup$
– TrostAft
Dec 5 '18 at 20:20
$begingroup$
Ah, the first resource was very helpful, I forgot to search for the question using transpose instead of conjugate transpose (to include real vector spaces and find an analog). Your second answer I think is what I was looking for - sometimes I miss the obvious. Thank you so much!
$endgroup$
– W. MacTurk
Dec 5 '18 at 20:26
1
$begingroup$
@TrostAft In fact $ Sigma^2$ corresponds to $Sigma Sigma^H$. $Sigma$ is not a square matrix. I agree this notation is often used, but can be misleading in some occasions. In particular, we don't get the same $Sigma^2$ when calculating $AA^H$ or $A^HA$
$endgroup$
– Damien
Dec 5 '18 at 20:42
add a comment |
$begingroup$
Is there something that breaks down in this arguement for complex? math.stackexchange.com/q/349742 (sorry I got the wrong link initially)
$endgroup$
– TrostAft
Dec 5 '18 at 20:17
$begingroup$
Also shouldnt $AA^H = U Sigma V^H V Sigma U^H = U Sigma^2 U^H$? Then using this it's clear that they have the same rank.
$endgroup$
– TrostAft
Dec 5 '18 at 20:20
$begingroup$
Ah, the first resource was very helpful, I forgot to search for the question using transpose instead of conjugate transpose (to include real vector spaces and find an analog). Your second answer I think is what I was looking for - sometimes I miss the obvious. Thank you so much!
$endgroup$
– W. MacTurk
Dec 5 '18 at 20:26
1
$begingroup$
@TrostAft In fact $ Sigma^2$ corresponds to $Sigma Sigma^H$. $Sigma$ is not a square matrix. I agree this notation is often used, but can be misleading in some occasions. In particular, we don't get the same $Sigma^2$ when calculating $AA^H$ or $A^HA$
$endgroup$
– Damien
Dec 5 '18 at 20:42
$begingroup$
Is there something that breaks down in this arguement for complex? math.stackexchange.com/q/349742 (sorry I got the wrong link initially)
$endgroup$
– TrostAft
Dec 5 '18 at 20:17
$begingroup$
Is there something that breaks down in this arguement for complex? math.stackexchange.com/q/349742 (sorry I got the wrong link initially)
$endgroup$
– TrostAft
Dec 5 '18 at 20:17
$begingroup$
Also shouldnt $AA^H = U Sigma V^H V Sigma U^H = U Sigma^2 U^H$? Then using this it's clear that they have the same rank.
$endgroup$
– TrostAft
Dec 5 '18 at 20:20
$begingroup$
Also shouldnt $AA^H = U Sigma V^H V Sigma U^H = U Sigma^2 U^H$? Then using this it's clear that they have the same rank.
$endgroup$
– TrostAft
Dec 5 '18 at 20:20
$begingroup$
Ah, the first resource was very helpful, I forgot to search for the question using transpose instead of conjugate transpose (to include real vector spaces and find an analog). Your second answer I think is what I was looking for - sometimes I miss the obvious. Thank you so much!
$endgroup$
– W. MacTurk
Dec 5 '18 at 20:26
$begingroup$
Ah, the first resource was very helpful, I forgot to search for the question using transpose instead of conjugate transpose (to include real vector spaces and find an analog). Your second answer I think is what I was looking for - sometimes I miss the obvious. Thank you so much!
$endgroup$
– W. MacTurk
Dec 5 '18 at 20:26
1
1
$begingroup$
@TrostAft In fact $ Sigma^2$ corresponds to $Sigma Sigma^H$. $Sigma$ is not a square matrix. I agree this notation is often used, but can be misleading in some occasions. In particular, we don't get the same $Sigma^2$ when calculating $AA^H$ or $A^HA$
$endgroup$
– Damien
Dec 5 '18 at 20:42
$begingroup$
@TrostAft In fact $ Sigma^2$ corresponds to $Sigma Sigma^H$. $Sigma$ is not a square matrix. I agree this notation is often used, but can be misleading in some occasions. In particular, we don't get the same $Sigma^2$ when calculating $AA^H$ or $A^HA$
$endgroup$
– Damien
Dec 5 '18 at 20:42
add a comment |
1 Answer
1
active
oldest
votes
$begingroup$
For this kind of problem, it is convenient to use the following form of SVD:
$$A = sum_{i=1}^{rank} lambda_i u_i v^H_i$$
Where the $lambda_i > 0$
Then,
$$ AA^H = sum_{i=1}^{rank} lambda^2_i u_i u^H_i$$
It follows immediately that $A$ and $AA^H$ have the same rank
$endgroup$
$begingroup$
But does having the same rank here indicate that A and AA^H have the same range space?
$endgroup$
– W. MacTurk
Dec 5 '18 at 20:29
$begingroup$
Yes: the set generated by the $u_i$ for which the $lambda_i$ are greater than 0
$endgroup$
– Damien
Dec 5 '18 at 20:32
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3027585%2frange-space-mathcalr-textbfa-the-same-as-mathcalr-textbfaah%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
$begingroup$
For this kind of problem, it is convenient to use the following form of SVD:
$$A = sum_{i=1}^{rank} lambda_i u_i v^H_i$$
Where the $lambda_i > 0$
Then,
$$ AA^H = sum_{i=1}^{rank} lambda^2_i u_i u^H_i$$
It follows immediately that $A$ and $AA^H$ have the same rank
$endgroup$
$begingroup$
But does having the same rank here indicate that A and AA^H have the same range space?
$endgroup$
– W. MacTurk
Dec 5 '18 at 20:29
$begingroup$
Yes: the set generated by the $u_i$ for which the $lambda_i$ are greater than 0
$endgroup$
– Damien
Dec 5 '18 at 20:32
add a comment |
$begingroup$
For this kind of problem, it is convenient to use the following form of SVD:
$$A = sum_{i=1}^{rank} lambda_i u_i v^H_i$$
Where the $lambda_i > 0$
Then,
$$ AA^H = sum_{i=1}^{rank} lambda^2_i u_i u^H_i$$
It follows immediately that $A$ and $AA^H$ have the same rank
$endgroup$
$begingroup$
But does having the same rank here indicate that A and AA^H have the same range space?
$endgroup$
– W. MacTurk
Dec 5 '18 at 20:29
$begingroup$
Yes: the set generated by the $u_i$ for which the $lambda_i$ are greater than 0
$endgroup$
– Damien
Dec 5 '18 at 20:32
add a comment |
$begingroup$
For this kind of problem, it is convenient to use the following form of SVD:
$$A = sum_{i=1}^{rank} lambda_i u_i v^H_i$$
Where the $lambda_i > 0$
Then,
$$ AA^H = sum_{i=1}^{rank} lambda^2_i u_i u^H_i$$
It follows immediately that $A$ and $AA^H$ have the same rank
$endgroup$
For this kind of problem, it is convenient to use the following form of SVD:
$$A = sum_{i=1}^{rank} lambda_i u_i v^H_i$$
Where the $lambda_i > 0$
Then,
$$ AA^H = sum_{i=1}^{rank} lambda^2_i u_i u^H_i$$
It follows immediately that $A$ and $AA^H$ have the same rank
answered Dec 5 '18 at 20:25
DamienDamien
58214
58214
$begingroup$
But does having the same rank here indicate that A and AA^H have the same range space?
$endgroup$
– W. MacTurk
Dec 5 '18 at 20:29
$begingroup$
Yes: the set generated by the $u_i$ for which the $lambda_i$ are greater than 0
$endgroup$
– Damien
Dec 5 '18 at 20:32
add a comment |
$begingroup$
But does having the same rank here indicate that A and AA^H have the same range space?
$endgroup$
– W. MacTurk
Dec 5 '18 at 20:29
$begingroup$
Yes: the set generated by the $u_i$ for which the $lambda_i$ are greater than 0
$endgroup$
– Damien
Dec 5 '18 at 20:32
$begingroup$
But does having the same rank here indicate that A and AA^H have the same range space?
$endgroup$
– W. MacTurk
Dec 5 '18 at 20:29
$begingroup$
But does having the same rank here indicate that A and AA^H have the same range space?
$endgroup$
– W. MacTurk
Dec 5 '18 at 20:29
$begingroup$
Yes: the set generated by the $u_i$ for which the $lambda_i$ are greater than 0
$endgroup$
– Damien
Dec 5 '18 at 20:32
$begingroup$
Yes: the set generated by the $u_i$ for which the $lambda_i$ are greater than 0
$endgroup$
– Damien
Dec 5 '18 at 20:32
add a comment |
Thanks for contributing an answer to Mathematics Stack Exchange!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
Use MathJax to format equations. MathJax reference.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3027585%2frange-space-mathcalr-textbfa-the-same-as-mathcalr-textbfaah%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
$begingroup$
Is there something that breaks down in this arguement for complex? math.stackexchange.com/q/349742 (sorry I got the wrong link initially)
$endgroup$
– TrostAft
Dec 5 '18 at 20:17
$begingroup$
Also shouldnt $AA^H = U Sigma V^H V Sigma U^H = U Sigma^2 U^H$? Then using this it's clear that they have the same rank.
$endgroup$
– TrostAft
Dec 5 '18 at 20:20
$begingroup$
Ah, the first resource was very helpful, I forgot to search for the question using transpose instead of conjugate transpose (to include real vector spaces and find an analog). Your second answer I think is what I was looking for - sometimes I miss the obvious. Thank you so much!
$endgroup$
– W. MacTurk
Dec 5 '18 at 20:26
1
$begingroup$
@TrostAft In fact $ Sigma^2$ corresponds to $Sigma Sigma^H$. $Sigma$ is not a square matrix. I agree this notation is often used, but can be misleading in some occasions. In particular, we don't get the same $Sigma^2$ when calculating $AA^H$ or $A^HA$
$endgroup$
– Damien
Dec 5 '18 at 20:42