How to transform an expression into a form involving the trace of a product of two matrices












3












$begingroup$


In page 594 of Bishop's PRML, the following equation is implied:



$$
-frac{1}{2}sum(mathbf{x}_n-mathbf{bar{x}})^Tmathbf{C}^{-1}(mathbf{x}_n-mathbf{bar{x}}) = -frac{N}{2}mathrm{Tr}(mathbf{C}^{-1}mathbf{S})
$$



where



$$
mathbf{S} = frac{1}{N}sum(mathbf{x}_n-mathbf{bar{x}})(mathbf{x}_n-mathbf{bar{x}})^T
$$
,$mathbf{C}$ is a symmetric matrix and $mathbf{bar{x}} = frac{sum_{n=1}^Nmathbf{x}_n}{N}$.



I want to derive this equation myself. But I'm not sure how to do it. Could someone show why the equation holds?






linear-algebra







share|cite|improve this question











$endgroup$












  • $begingroup$
    I have taken the liberty to modify your title which was "uninformative".
    $endgroup$
    – Jean Marie
    Dec 31 '18 at 19:48
















3












$begingroup$


In page 594 of Bishop's PRML, the following equation is implied:



$$
-frac{1}{2}sum(mathbf{x}_n-mathbf{bar{x}})^Tmathbf{C}^{-1}(mathbf{x}_n-mathbf{bar{x}}) = -frac{N}{2}mathrm{Tr}(mathbf{C}^{-1}mathbf{S})
$$



where



$$
mathbf{S} = frac{1}{N}sum(mathbf{x}_n-mathbf{bar{x}})(mathbf{x}_n-mathbf{bar{x}})^T
$$
,$mathbf{C}$ is a symmetric matrix and $mathbf{bar{x}} = frac{sum_{n=1}^Nmathbf{x}_n}{N}$.



I want to derive this equation myself. But I'm not sure how to do it. Could someone show why the equation holds?






linear-algebra







share|cite|improve this question











$endgroup$












  • $begingroup$
    I have taken the liberty to modify your title which was "uninformative".
    $endgroup$
    – Jean Marie
    Dec 31 '18 at 19:48














3












3








3





$begingroup$


In page 594 of Bishop's PRML, the following equation is implied:



$$
-frac{1}{2}sum(mathbf{x}_n-mathbf{bar{x}})^Tmathbf{C}^{-1}(mathbf{x}_n-mathbf{bar{x}}) = -frac{N}{2}mathrm{Tr}(mathbf{C}^{-1}mathbf{S})
$$



where



$$
mathbf{S} = frac{1}{N}sum(mathbf{x}_n-mathbf{bar{x}})(mathbf{x}_n-mathbf{bar{x}})^T
$$
,$mathbf{C}$ is a symmetric matrix and $mathbf{bar{x}} = frac{sum_{n=1}^Nmathbf{x}_n}{N}$.



I want to derive this equation myself. But I'm not sure how to do it. Could someone show why the equation holds?






linear-algebra







share|cite|improve this question











$endgroup$




In page 594 of Bishop's PRML, the following equation is implied:



$$
-frac{1}{2}sum(mathbf{x}_n-mathbf{bar{x}})^Tmathbf{C}^{-1}(mathbf{x}_n-mathbf{bar{x}}) = -frac{N}{2}mathrm{Tr}(mathbf{C}^{-1}mathbf{S})
$$



where



$$
mathbf{S} = frac{1}{N}sum(mathbf{x}_n-mathbf{bar{x}})(mathbf{x}_n-mathbf{bar{x}})^T
$$
,$mathbf{C}$ is a symmetric matrix and $mathbf{bar{x}} = frac{sum_{n=1}^Nmathbf{x}_n}{N}$.



I want to derive this equation myself. But I'm not sure how to do it. Could someone show why the equation holds?






linear-algebra




linear-algebra






share|cite|improve this question















share|cite|improve this question













share|cite|improve this question




share|cite|improve this question








edited Dec 31 '18 at 19:46









Jean Marie

31k42255




31k42255










asked Dec 31 '18 at 12:16









SandiSandi

262112




262112












  • $begingroup$
    I have taken the liberty to modify your title which was "uninformative".
    $endgroup$
    – Jean Marie
    Dec 31 '18 at 19:48


















  • $begingroup$
    I have taken the liberty to modify your title which was "uninformative".
    $endgroup$
    – Jean Marie
    Dec 31 '18 at 19:48
















$begingroup$
I have taken the liberty to modify your title which was "uninformative".
$endgroup$
– Jean Marie
Dec 31 '18 at 19:48




$begingroup$
I have taken the liberty to modify your title which was "uninformative".
$endgroup$
– Jean Marie
Dec 31 '18 at 19:48










2 Answers
2






active

oldest

votes


















4












$begingroup$

Guide:



Notice that $(x_n - bar{x})^TC^{-1}(x_n - bar{x})$ is a scalar,



hence $$(x_n - bar{x})^TC^{-1}(x_n - bar{x})= operatorname{Tr}left[(x_n - bar{x})^TC^{-1}(x_n - bar{x})right]=operatorname{Tr}left[C^{-1}(x_n - bar{x})(x_n - bar{x})^Tright]$$



since $operatorname{Tr}(AB)=operatorname{Tr}(BA)$.
Hopefully you can take it from here.






share|cite|improve this answer











$endgroup$





















    4












    $begingroup$

    With the help of Siong Thye Goh, I did the following:



    begin{align}
    -frac{1}{2}sum_{n=1}^N(mathbf{x}_n - mathbf{bar{x}})^Tmathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}}) &= -frac{1}{2}sum_{n=1}^Nmathrm{Tr}[(mathbf{x}_n - mathbf{bar{x}})^Tmathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})]\
    &= -frac{1}{2}sum_{n=1}^Nmathrm{Tr}[mathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
    &= -frac{1}{2}mathrm{Tr}[sum^N_{n=1}mathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
    &= -frac{1}{2}mathrm{Tr}[mathbf{C}^{-1}sum_{n=1}^N(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
    &= -frac{1}{2}mathrm{Tr}[mathbf{C}^{-1}Nmathbf{S}] = -frac{N}{2}mathrm{Tr}[mathbf{C}^{-1}mathbf{S}]
    end{align}






    share|cite|improve this answer











    $endgroup$













    • $begingroup$
      +1 great job! just a minor careless step at the very beginning, there's a negative there. ;)
      $endgroup$
      – Siong Thye Goh
      Dec 31 '18 at 13:00











    Your Answer





    StackExchange.ifUsing("editor", function () {
    return StackExchange.using("mathjaxEditing", function () {
    StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
    StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
    });
    });
    }, "mathjax-editing");

    StackExchange.ready(function() {
    var channelOptions = {
    tags: "".split(" "),
    id: "69"
    };
    initTagRenderer("".split(" "), "".split(" "), channelOptions);

    StackExchange.using("externalEditor", function() {
    // Have to fire editor after snippets, if snippets enabled
    if (StackExchange.settings.snippets.snippetsEnabled) {
    StackExchange.using("snippets", function() {
    createEditor();
    });
    }
    else {
    createEditor();
    }
    });

    function createEditor() {
    StackExchange.prepareEditor({
    heartbeatType: 'answer',
    autoActivateHeartbeat: false,
    convertImagesToLinks: true,
    noModals: true,
    showLowRepImageUploadWarning: true,
    reputationToPostImages: 10,
    bindNavPrevention: true,
    postfix: "",
    imageUploader: {
    brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
    contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
    allowUrls: true
    },
    noCode: true, onDemand: true,
    discardSelector: ".discard-answer"
    ,immediatelyShowMarkdownHelp:true
    });


    }
    });














    draft saved

    draft discarded


















    StackExchange.ready(
    function () {
    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3057651%2fhow-to-transform-an-expression-into-a-form-involving-the-trace-of-a-product-of-t%23new-answer', 'question_page');
    }
    );

    Post as a guest















    Required, but never shown

























    2 Answers
    2






    active

    oldest

    votes








    2 Answers
    2






    active

    oldest

    votes









    active

    oldest

    votes






    active

    oldest

    votes









    4












    $begingroup$

    Guide:



    Notice that $(x_n - bar{x})^TC^{-1}(x_n - bar{x})$ is a scalar,



    hence $$(x_n - bar{x})^TC^{-1}(x_n - bar{x})= operatorname{Tr}left[(x_n - bar{x})^TC^{-1}(x_n - bar{x})right]=operatorname{Tr}left[C^{-1}(x_n - bar{x})(x_n - bar{x})^Tright]$$



    since $operatorname{Tr}(AB)=operatorname{Tr}(BA)$.
    Hopefully you can take it from here.






    share|cite|improve this answer











    $endgroup$


















      4












      $begingroup$

      Guide:



      Notice that $(x_n - bar{x})^TC^{-1}(x_n - bar{x})$ is a scalar,



      hence $$(x_n - bar{x})^TC^{-1}(x_n - bar{x})= operatorname{Tr}left[(x_n - bar{x})^TC^{-1}(x_n - bar{x})right]=operatorname{Tr}left[C^{-1}(x_n - bar{x})(x_n - bar{x})^Tright]$$



      since $operatorname{Tr}(AB)=operatorname{Tr}(BA)$.
      Hopefully you can take it from here.






      share|cite|improve this answer











      $endgroup$
















        4












        4








        4





        $begingroup$

        Guide:



        Notice that $(x_n - bar{x})^TC^{-1}(x_n - bar{x})$ is a scalar,



        hence $$(x_n - bar{x})^TC^{-1}(x_n - bar{x})= operatorname{Tr}left[(x_n - bar{x})^TC^{-1}(x_n - bar{x})right]=operatorname{Tr}left[C^{-1}(x_n - bar{x})(x_n - bar{x})^Tright]$$



        since $operatorname{Tr}(AB)=operatorname{Tr}(BA)$.
        Hopefully you can take it from here.






        share|cite|improve this answer











        $endgroup$



        Guide:



        Notice that $(x_n - bar{x})^TC^{-1}(x_n - bar{x})$ is a scalar,



        hence $$(x_n - bar{x})^TC^{-1}(x_n - bar{x})= operatorname{Tr}left[(x_n - bar{x})^TC^{-1}(x_n - bar{x})right]=operatorname{Tr}left[C^{-1}(x_n - bar{x})(x_n - bar{x})^Tright]$$



        since $operatorname{Tr}(AB)=operatorname{Tr}(BA)$.
        Hopefully you can take it from here.







        share|cite|improve this answer














        share|cite|improve this answer



        share|cite|improve this answer








        edited Dec 31 '18 at 12:28









        Bernard

        123k741117




        123k741117










        answered Dec 31 '18 at 12:19









        Siong Thye GohSiong Thye Goh

        103k1468119




        103k1468119























            4












            $begingroup$

            With the help of Siong Thye Goh, I did the following:



            begin{align}
            -frac{1}{2}sum_{n=1}^N(mathbf{x}_n - mathbf{bar{x}})^Tmathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}}) &= -frac{1}{2}sum_{n=1}^Nmathrm{Tr}[(mathbf{x}_n - mathbf{bar{x}})^Tmathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})]\
            &= -frac{1}{2}sum_{n=1}^Nmathrm{Tr}[mathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
            &= -frac{1}{2}mathrm{Tr}[sum^N_{n=1}mathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
            &= -frac{1}{2}mathrm{Tr}[mathbf{C}^{-1}sum_{n=1}^N(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
            &= -frac{1}{2}mathrm{Tr}[mathbf{C}^{-1}Nmathbf{S}] = -frac{N}{2}mathrm{Tr}[mathbf{C}^{-1}mathbf{S}]
            end{align}






            share|cite|improve this answer











            $endgroup$













            • $begingroup$
              +1 great job! just a minor careless step at the very beginning, there's a negative there. ;)
              $endgroup$
              – Siong Thye Goh
              Dec 31 '18 at 13:00
















            4












            $begingroup$

            With the help of Siong Thye Goh, I did the following:



            begin{align}
            -frac{1}{2}sum_{n=1}^N(mathbf{x}_n - mathbf{bar{x}})^Tmathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}}) &= -frac{1}{2}sum_{n=1}^Nmathrm{Tr}[(mathbf{x}_n - mathbf{bar{x}})^Tmathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})]\
            &= -frac{1}{2}sum_{n=1}^Nmathrm{Tr}[mathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
            &= -frac{1}{2}mathrm{Tr}[sum^N_{n=1}mathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
            &= -frac{1}{2}mathrm{Tr}[mathbf{C}^{-1}sum_{n=1}^N(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
            &= -frac{1}{2}mathrm{Tr}[mathbf{C}^{-1}Nmathbf{S}] = -frac{N}{2}mathrm{Tr}[mathbf{C}^{-1}mathbf{S}]
            end{align}






            share|cite|improve this answer











            $endgroup$













            • $begingroup$
              +1 great job! just a minor careless step at the very beginning, there's a negative there. ;)
              $endgroup$
              – Siong Thye Goh
              Dec 31 '18 at 13:00














            4












            4








            4





            $begingroup$

            With the help of Siong Thye Goh, I did the following:



            begin{align}
            -frac{1}{2}sum_{n=1}^N(mathbf{x}_n - mathbf{bar{x}})^Tmathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}}) &= -frac{1}{2}sum_{n=1}^Nmathrm{Tr}[(mathbf{x}_n - mathbf{bar{x}})^Tmathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})]\
            &= -frac{1}{2}sum_{n=1}^Nmathrm{Tr}[mathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
            &= -frac{1}{2}mathrm{Tr}[sum^N_{n=1}mathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
            &= -frac{1}{2}mathrm{Tr}[mathbf{C}^{-1}sum_{n=1}^N(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
            &= -frac{1}{2}mathrm{Tr}[mathbf{C}^{-1}Nmathbf{S}] = -frac{N}{2}mathrm{Tr}[mathbf{C}^{-1}mathbf{S}]
            end{align}






            share|cite|improve this answer











            $endgroup$



            With the help of Siong Thye Goh, I did the following:



            begin{align}
            -frac{1}{2}sum_{n=1}^N(mathbf{x}_n - mathbf{bar{x}})^Tmathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}}) &= -frac{1}{2}sum_{n=1}^Nmathrm{Tr}[(mathbf{x}_n - mathbf{bar{x}})^Tmathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})]\
            &= -frac{1}{2}sum_{n=1}^Nmathrm{Tr}[mathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
            &= -frac{1}{2}mathrm{Tr}[sum^N_{n=1}mathbf{C}^{-1}(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
            &= -frac{1}{2}mathrm{Tr}[mathbf{C}^{-1}sum_{n=1}^N(mathbf{x}_n - mathbf{bar{x}})(mathbf{x}_n - mathbf{bar{x}})^T]\
            &= -frac{1}{2}mathrm{Tr}[mathbf{C}^{-1}Nmathbf{S}] = -frac{N}{2}mathrm{Tr}[mathbf{C}^{-1}mathbf{S}]
            end{align}







            share|cite|improve this answer














            share|cite|improve this answer



            share|cite|improve this answer








            edited Jan 1 at 14:34

























            answered Dec 31 '18 at 12:43









            SandiSandi

            262112




            262112












            • $begingroup$
              +1 great job! just a minor careless step at the very beginning, there's a negative there. ;)
              $endgroup$
              – Siong Thye Goh
              Dec 31 '18 at 13:00


















            • $begingroup$
              +1 great job! just a minor careless step at the very beginning, there's a negative there. ;)
              $endgroup$
              – Siong Thye Goh
              Dec 31 '18 at 13:00
















            $begingroup$
            +1 great job! just a minor careless step at the very beginning, there's a negative there. ;)
            $endgroup$
            – Siong Thye Goh
            Dec 31 '18 at 13:00




            $begingroup$
            +1 great job! just a minor careless step at the very beginning, there's a negative there. ;)
            $endgroup$
            – Siong Thye Goh
            Dec 31 '18 at 13:00


















            draft saved

            draft discarded




















































            Thanks for contributing an answer to Mathematics Stack Exchange!


            • Please be sure to answer the question. Provide details and share your research!

            But avoid …



            • Asking for help, clarification, or responding to other answers.

            • Making statements based on opinion; back them up with references or personal experience.


            Use MathJax to format equations. MathJax reference.


            To learn more, see our tips on writing great answers.




            draft saved


            draft discarded














            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3057651%2fhow-to-transform-an-expression-into-a-form-involving-the-trace-of-a-product-of-t%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown





















































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown

































            Required, but never shown














            Required, but never shown












            Required, but never shown







            Required, but never shown







            -

            Popular posts from this blog

            To store a contact into the json file from server.js file using a class in NodeJS

            Image
            0 I have created three files -contactPresentation.js, contactService.js, contacts.json. I will run the contactService.js file. And it will navigate to contactPresentation.js file that will only choose an option to either add or display a file. If add(), then add the data into add of service file.And the data will be added to the contacts.json file . And if display(), then display the display() of service file. And the display will take the data from contacts.json file. However, i know my code is flawed. Please correct it . I am also getting an error - this.contacts.push(new ContactService(userName, contactNumber, emailId)); ^ TypeError: Cannot read property 'push' of undefined at ContactService.add (e:NodeJSProjectcontactManager2contactService.js:57:23) at new C
            Read more

            Marschland

            Image
            Kilometerweite Marsch in den Vier- und Marschlanden am Elbdeich Die Wedeler Marschlandschaft in Schleswig-Holstein Der Hadelner Kanal zur Entwässerung der Marsch Die tief gelegene Marsch und ein Entwässerungskanal Das Schöpfwerk Otterndorf im Land Hadeln zur Entwässerung der Medem verfügte damals bereits über die größte Kreiselpumpe Europas. Das Schöpfwerk in Neuhaus für die Aue und des Neuhaus-Bülkauer Kanals Als Marsch(land) (v. niederdt., altsächs. mersc ) – auch Masch , Mersch oder Schwemmland genannt – bezeichnet man eine nacheiszeitlich entstandene geomorphologische Landform im Gebiet der nordwestdeutschen Küsten und Flüsse sowie vergleichbare Landformen weltweit. Inhaltsverzeichnis 1 Landschaft 2 Entstehung 3 Marschböden 4 Nutzung 5 Marschgebiete in Deutschland 6 Siehe auch 7 Literatur 8 Weblinks 9 Einzelnachweise Landschaft | Marschen sind generell flache Landstriche ohne natürliche Erhebungen. Si
            Read more

            Redirect URL with Chrome Remote Debugging Android Devices

            Image
            1 How can i redirect an URL with Chrome Remote Debugging Android Devices? like Requestly Chrome extension on desktop. google-chrome debugging url redirect testing share | improve this question edited Nov 24 '18 at 8:16 sachinjain024 14.7k 23 73 129 asked Nov 23 '18 at 16:09 Momen Momen 91 10
            Read more