Does mean centering reduces covariance?












1












$begingroup$


It might be a very naive question, but assuming I have two non-independent random variables and I want to reduce covariance between them as much as possible without loosing too much "signal". Does mean centering help? I read somewhere that mean centering reduces correlation by a significant factor, so thinking it should do the same for covariance.






correlation covariance random-vector







share|cite|improve this question









$endgroup$

















    1












    $begingroup$


    It might be a very naive question, but assuming I have two non-independent random variables and I want to reduce covariance between them as much as possible without loosing too much "signal". Does mean centering help? I read somewhere that mean centering reduces correlation by a significant factor, so thinking it should do the same for covariance.






    correlation covariance random-vector







    share|cite|improve this question









    $endgroup$















      1












      1








      1





      $begingroup$


      It might be a very naive question, but assuming I have two non-independent random variables and I want to reduce covariance between them as much as possible without loosing too much "signal". Does mean centering help? I read somewhere that mean centering reduces correlation by a significant factor, so thinking it should do the same for covariance.






      correlation covariance random-vector







      share|cite|improve this question









      $endgroup$




      It might be a very naive question, but assuming I have two non-independent random variables and I want to reduce covariance between them as much as possible without loosing too much "signal". Does mean centering help? I read somewhere that mean centering reduces correlation by a significant factor, so thinking it should do the same for covariance.






      correlation covariance random-vector




      correlation covariance random-vector






      share|cite|improve this question













      share|cite|improve this question











      share|cite|improve this question




      share|cite|improve this question










      asked 52 mins ago









      lvdplvdp

      63




      63






















          1 Answer
          1






          active

          oldest

          votes


















          2












          $begingroup$

          If $X$ and $Y$ are random variables and $a$ and $b$ are constants, then
          $$
          begin{aligned}
          operatorname{Cov}(X + a, Y + b)
          &= E[(X + a - E[X + a])(Y + b - E[Y + b])] \
          &= E[(X + a - E[X] - E[a])(Y + b - E[Y] - E[b])] \
          &= E[(X + a - E[X] - a)(Y + b - E[Y] - b)] \
          &= E[(X - E[X])(Y - E[Y])] \
          &= operatorname{Cov}(X, Y).
          end{aligned}
          $$
          Centering is the special case $a = -E[X]$ and $b = -E[Y]$, so centering does not affect covariance.




          Also, since correlation is defined as
          $$
          operatorname{Corr}(X, Y)
          = frac{operatorname{Cov}(X, Y)}{sqrt{operatorname{Var}(X) operatorname{Var}(Y)}},
          $$
          we can see that
          $$
          begin{aligned}
          operatorname{Corr}(X + a, Y + b)
          &= frac{operatorname{Cov}(X + a, Y + b)}{sqrt{operatorname{Var}(X + a) operatorname{Var}(Y + b)}} \
          &= frac{operatorname{Cov}(X, Y)}{sqrt{operatorname{Var}(X) operatorname{Var}(Y)}},
          end{aligned}
          $$
          so in particular, correlation isn't affected by centering either.




          That was the population version of the story. The sample version is the same: If we use
          $$
          widehat{operatorname{Cov}}(X, Y)
          = frac{1}{n} sum_{i=1}^n left(X_i - frac{1}{n}sum_{j=1}^n X_jright)left(Y_i - frac{1}{n}sum_{j=1}^n Y_jright)
          $$
          as our estimate of covariance between $X$ and $Y$ from a paired sample $(X_1,Y_1), ldots, (X_n,Y_n)$, then
          $$
          begin{aligned}
          widehat{operatorname{Cov}}(X + a, Y + b)
          &= frac{1}{n} sum_{i=1}^n left(X_i + a - frac{1}{n}sum_{j=1}^n (X_j + a)right)left(Y_i + b - frac{1}{n}sum_{j=1}^n (Y_j + b)right) \
          &= frac{1}{n} sum_{i=1}^n left(X_i + a - frac{1}{n}sum_{j=1}^n X_j + frac{n}{n} aright)left(Y_i + b - frac{1}{n}sum_{j=1}^n Y_j + frac{n}{n} bright) \
          &= frac{1}{n} sum_{i=1}^n left(X_i - frac{1}{n}sum_{j=1}^n X_jright)left(Y_i - frac{1}{n}sum_{j=1}^n Y_jright) \
          &= widehat{operatorname{Cov}}(X, Y)
          end{aligned}
          $$
          for any $a$ and $b$.






          share|cite|improve this answer











          $endgroup$













            Your Answer





            StackExchange.ifUsing("editor", function () {
            return StackExchange.using("mathjaxEditing", function () {
            StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
            StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
            });
            });
            }, "mathjax-editing");

            StackExchange.ready(function() {
            var channelOptions = {
            tags: "".split(" "),
            id: "65"
            };
            initTagRenderer("".split(" "), "".split(" "), channelOptions);

            StackExchange.using("externalEditor", function() {
            // Have to fire editor after snippets, if snippets enabled
            if (StackExchange.settings.snippets.snippetsEnabled) {
            StackExchange.using("snippets", function() {
            createEditor();
            });
            }
            else {
            createEditor();
            }
            });

            function createEditor() {
            StackExchange.prepareEditor({
            heartbeatType: 'answer',
            autoActivateHeartbeat: false,
            convertImagesToLinks: false,
            noModals: true,
            showLowRepImageUploadWarning: true,
            reputationToPostImages: null,
            bindNavPrevention: true,
            postfix: "",
            imageUploader: {
            brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
            contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
            allowUrls: true
            },
            onDemand: true,
            discardSelector: ".discard-answer"
            ,immediatelyShowMarkdownHelp:true
            });


            }
            });














            draft saved

            draft discarded


















            StackExchange.ready(
            function () {
            StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f391838%2fdoes-mean-centering-reduces-covariance%23new-answer', 'question_page');
            }
            );

            Post as a guest















            Required, but never shown

























            1 Answer
            1






            active

            oldest

            votes








            1 Answer
            1






            active

            oldest

            votes









            active

            oldest

            votes






            active

            oldest

            votes









            2












            $begingroup$

            If $X$ and $Y$ are random variables and $a$ and $b$ are constants, then
            $$
            begin{aligned}
            operatorname{Cov}(X + a, Y + b)
            &= E[(X + a - E[X + a])(Y + b - E[Y + b])] \
            &= E[(X + a - E[X] - E[a])(Y + b - E[Y] - E[b])] \
            &= E[(X + a - E[X] - a)(Y + b - E[Y] - b)] \
            &= E[(X - E[X])(Y - E[Y])] \
            &= operatorname{Cov}(X, Y).
            end{aligned}
            $$
            Centering is the special case $a = -E[X]$ and $b = -E[Y]$, so centering does not affect covariance.




            Also, since correlation is defined as
            $$
            operatorname{Corr}(X, Y)
            = frac{operatorname{Cov}(X, Y)}{sqrt{operatorname{Var}(X) operatorname{Var}(Y)}},
            $$
            we can see that
            $$
            begin{aligned}
            operatorname{Corr}(X + a, Y + b)
            &= frac{operatorname{Cov}(X + a, Y + b)}{sqrt{operatorname{Var}(X + a) operatorname{Var}(Y + b)}} \
            &= frac{operatorname{Cov}(X, Y)}{sqrt{operatorname{Var}(X) operatorname{Var}(Y)}},
            end{aligned}
            $$
            so in particular, correlation isn't affected by centering either.




            That was the population version of the story. The sample version is the same: If we use
            $$
            widehat{operatorname{Cov}}(X, Y)
            = frac{1}{n} sum_{i=1}^n left(X_i - frac{1}{n}sum_{j=1}^n X_jright)left(Y_i - frac{1}{n}sum_{j=1}^n Y_jright)
            $$
            as our estimate of covariance between $X$ and $Y$ from a paired sample $(X_1,Y_1), ldots, (X_n,Y_n)$, then
            $$
            begin{aligned}
            widehat{operatorname{Cov}}(X + a, Y + b)
            &= frac{1}{n} sum_{i=1}^n left(X_i + a - frac{1}{n}sum_{j=1}^n (X_j + a)right)left(Y_i + b - frac{1}{n}sum_{j=1}^n (Y_j + b)right) \
            &= frac{1}{n} sum_{i=1}^n left(X_i + a - frac{1}{n}sum_{j=1}^n X_j + frac{n}{n} aright)left(Y_i + b - frac{1}{n}sum_{j=1}^n Y_j + frac{n}{n} bright) \
            &= frac{1}{n} sum_{i=1}^n left(X_i - frac{1}{n}sum_{j=1}^n X_jright)left(Y_i - frac{1}{n}sum_{j=1}^n Y_jright) \
            &= widehat{operatorname{Cov}}(X, Y)
            end{aligned}
            $$
            for any $a$ and $b$.






            share|cite|improve this answer











            $endgroup$


















              2












              $begingroup$

              If $X$ and $Y$ are random variables and $a$ and $b$ are constants, then
              $$
              begin{aligned}
              operatorname{Cov}(X + a, Y + b)
              &= E[(X + a - E[X + a])(Y + b - E[Y + b])] \
              &= E[(X + a - E[X] - E[a])(Y + b - E[Y] - E[b])] \
              &= E[(X + a - E[X] - a)(Y + b - E[Y] - b)] \
              &= E[(X - E[X])(Y - E[Y])] \
              &= operatorname{Cov}(X, Y).
              end{aligned}
              $$
              Centering is the special case $a = -E[X]$ and $b = -E[Y]$, so centering does not affect covariance.




              Also, since correlation is defined as
              $$
              operatorname{Corr}(X, Y)
              = frac{operatorname{Cov}(X, Y)}{sqrt{operatorname{Var}(X) operatorname{Var}(Y)}},
              $$
              we can see that
              $$
              begin{aligned}
              operatorname{Corr}(X + a, Y + b)
              &= frac{operatorname{Cov}(X + a, Y + b)}{sqrt{operatorname{Var}(X + a) operatorname{Var}(Y + b)}} \
              &= frac{operatorname{Cov}(X, Y)}{sqrt{operatorname{Var}(X) operatorname{Var}(Y)}},
              end{aligned}
              $$
              so in particular, correlation isn't affected by centering either.




              That was the population version of the story. The sample version is the same: If we use
              $$
              widehat{operatorname{Cov}}(X, Y)
              = frac{1}{n} sum_{i=1}^n left(X_i - frac{1}{n}sum_{j=1}^n X_jright)left(Y_i - frac{1}{n}sum_{j=1}^n Y_jright)
              $$
              as our estimate of covariance between $X$ and $Y$ from a paired sample $(X_1,Y_1), ldots, (X_n,Y_n)$, then
              $$
              begin{aligned}
              widehat{operatorname{Cov}}(X + a, Y + b)
              &= frac{1}{n} sum_{i=1}^n left(X_i + a - frac{1}{n}sum_{j=1}^n (X_j + a)right)left(Y_i + b - frac{1}{n}sum_{j=1}^n (Y_j + b)right) \
              &= frac{1}{n} sum_{i=1}^n left(X_i + a - frac{1}{n}sum_{j=1}^n X_j + frac{n}{n} aright)left(Y_i + b - frac{1}{n}sum_{j=1}^n Y_j + frac{n}{n} bright) \
              &= frac{1}{n} sum_{i=1}^n left(X_i - frac{1}{n}sum_{j=1}^n X_jright)left(Y_i - frac{1}{n}sum_{j=1}^n Y_jright) \
              &= widehat{operatorname{Cov}}(X, Y)
              end{aligned}
              $$
              for any $a$ and $b$.






              share|cite|improve this answer











              $endgroup$
















                2












                2








                2





                $begingroup$

                If $X$ and $Y$ are random variables and $a$ and $b$ are constants, then
                $$
                begin{aligned}
                operatorname{Cov}(X + a, Y + b)
                &= E[(X + a - E[X + a])(Y + b - E[Y + b])] \
                &= E[(X + a - E[X] - E[a])(Y + b - E[Y] - E[b])] \
                &= E[(X + a - E[X] - a)(Y + b - E[Y] - b)] \
                &= E[(X - E[X])(Y - E[Y])] \
                &= operatorname{Cov}(X, Y).
                end{aligned}
                $$
                Centering is the special case $a = -E[X]$ and $b = -E[Y]$, so centering does not affect covariance.




                Also, since correlation is defined as
                $$
                operatorname{Corr}(X, Y)
                = frac{operatorname{Cov}(X, Y)}{sqrt{operatorname{Var}(X) operatorname{Var}(Y)}},
                $$
                we can see that
                $$
                begin{aligned}
                operatorname{Corr}(X + a, Y + b)
                &= frac{operatorname{Cov}(X + a, Y + b)}{sqrt{operatorname{Var}(X + a) operatorname{Var}(Y + b)}} \
                &= frac{operatorname{Cov}(X, Y)}{sqrt{operatorname{Var}(X) operatorname{Var}(Y)}},
                end{aligned}
                $$
                so in particular, correlation isn't affected by centering either.




                That was the population version of the story. The sample version is the same: If we use
                $$
                widehat{operatorname{Cov}}(X, Y)
                = frac{1}{n} sum_{i=1}^n left(X_i - frac{1}{n}sum_{j=1}^n X_jright)left(Y_i - frac{1}{n}sum_{j=1}^n Y_jright)
                $$
                as our estimate of covariance between $X$ and $Y$ from a paired sample $(X_1,Y_1), ldots, (X_n,Y_n)$, then
                $$
                begin{aligned}
                widehat{operatorname{Cov}}(X + a, Y + b)
                &= frac{1}{n} sum_{i=1}^n left(X_i + a - frac{1}{n}sum_{j=1}^n (X_j + a)right)left(Y_i + b - frac{1}{n}sum_{j=1}^n (Y_j + b)right) \
                &= frac{1}{n} sum_{i=1}^n left(X_i + a - frac{1}{n}sum_{j=1}^n X_j + frac{n}{n} aright)left(Y_i + b - frac{1}{n}sum_{j=1}^n Y_j + frac{n}{n} bright) \
                &= frac{1}{n} sum_{i=1}^n left(X_i - frac{1}{n}sum_{j=1}^n X_jright)left(Y_i - frac{1}{n}sum_{j=1}^n Y_jright) \
                &= widehat{operatorname{Cov}}(X, Y)
                end{aligned}
                $$
                for any $a$ and $b$.






                share|cite|improve this answer











                $endgroup$



                If $X$ and $Y$ are random variables and $a$ and $b$ are constants, then
                $$
                begin{aligned}
                operatorname{Cov}(X + a, Y + b)
                &= E[(X + a - E[X + a])(Y + b - E[Y + b])] \
                &= E[(X + a - E[X] - E[a])(Y + b - E[Y] - E[b])] \
                &= E[(X + a - E[X] - a)(Y + b - E[Y] - b)] \
                &= E[(X - E[X])(Y - E[Y])] \
                &= operatorname{Cov}(X, Y).
                end{aligned}
                $$
                Centering is the special case $a = -E[X]$ and $b = -E[Y]$, so centering does not affect covariance.




                Also, since correlation is defined as
                $$
                operatorname{Corr}(X, Y)
                = frac{operatorname{Cov}(X, Y)}{sqrt{operatorname{Var}(X) operatorname{Var}(Y)}},
                $$
                we can see that
                $$
                begin{aligned}
                operatorname{Corr}(X + a, Y + b)
                &= frac{operatorname{Cov}(X + a, Y + b)}{sqrt{operatorname{Var}(X + a) operatorname{Var}(Y + b)}} \
                &= frac{operatorname{Cov}(X, Y)}{sqrt{operatorname{Var}(X) operatorname{Var}(Y)}},
                end{aligned}
                $$
                so in particular, correlation isn't affected by centering either.




                That was the population version of the story. The sample version is the same: If we use
                $$
                widehat{operatorname{Cov}}(X, Y)
                = frac{1}{n} sum_{i=1}^n left(X_i - frac{1}{n}sum_{j=1}^n X_jright)left(Y_i - frac{1}{n}sum_{j=1}^n Y_jright)
                $$
                as our estimate of covariance between $X$ and $Y$ from a paired sample $(X_1,Y_1), ldots, (X_n,Y_n)$, then
                $$
                begin{aligned}
                widehat{operatorname{Cov}}(X + a, Y + b)
                &= frac{1}{n} sum_{i=1}^n left(X_i + a - frac{1}{n}sum_{j=1}^n (X_j + a)right)left(Y_i + b - frac{1}{n}sum_{j=1}^n (Y_j + b)right) \
                &= frac{1}{n} sum_{i=1}^n left(X_i + a - frac{1}{n}sum_{j=1}^n X_j + frac{n}{n} aright)left(Y_i + b - frac{1}{n}sum_{j=1}^n Y_j + frac{n}{n} bright) \
                &= frac{1}{n} sum_{i=1}^n left(X_i - frac{1}{n}sum_{j=1}^n X_jright)left(Y_i - frac{1}{n}sum_{j=1}^n Y_jright) \
                &= widehat{operatorname{Cov}}(X, Y)
                end{aligned}
                $$
                for any $a$ and $b$.







                share|cite|improve this answer














                share|cite|improve this answer



                share|cite|improve this answer








                edited 14 mins ago

























                answered 27 mins ago









                Artem MavrinArtem Mavrin

                33516




                33516






























                    draft saved

                    draft discarded




















































                    Thanks for contributing an answer to Cross Validated!


                    • Please be sure to answer the question. Provide details and share your research!

                    But avoid …



                    • Asking for help, clarification, or responding to other answers.

                    • Making statements based on opinion; back them up with references or personal experience.


                    Use MathJax to format equations. MathJax reference.


                    To learn more, see our tips on writing great answers.




                    draft saved


                    draft discarded














                    StackExchange.ready(
                    function () {
                    StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstats.stackexchange.com%2fquestions%2f391838%2fdoes-mean-centering-reduces-covariance%23new-answer', 'question_page');
                    }
                    );

                    Post as a guest















                    Required, but never shown





















































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown

































                    Required, but never shown














                    Required, but never shown












                    Required, but never shown







                    Required, but never shown







                    -

                    Popular posts from this blog

                    Усть-Каменогорск

                    Image
                    У этого термина существуют и другие значения, см. Усть-Каменогорск. Город Усть-Каменогорск каз. Өскемен Флаг Герб 49°57′ с. ш. 82°37′ в. д. H G Я O L Страна Казахстан   Казахстан Статус областной центр Область Восточно-Казахстанская Аким Жаксылык Омар [1] История и география Основан 1720 Город с 1868 Площадь 303,15 [2] км² Высота центра 283 ± 1 м Тип климата резко-континентальный Часовой пояс UTC+6 Население Население 329 090 [3]  человек ( 2018 ) Национальности русские 53,56 % казахи 42,99 % немцы 0,82 % украинцы 0,57 % татары 0,79 % белорусы 0,14 % азербайджанцы 0,23 % корейцы 0,20 % прочие 1,08 % -1 шт [4] Этнохороним усть-каменогорцы, усть-каменогорец Цифровые идентификаторы Телефонный код +7 (7232) Почтовый индекс F0***** [5] Автомобильный код 16 (ранее F) oskemen.kz Усть-Каменогорск Усть-Каменогорск ...
                    Read more

                    Халкинская богословская школа

                    Image
                    Халкинская богословская школа тур. Rum Ortodoks Ruhban Okulu греч. Ιερά Θεολογική Σχολή της Χάλκης Главное здание Халкинской школы Международное название Theological School of Halki Год основания 1844 Конфессия православие Церковь Константинопольская Ректор Елпидифор (Ламбриниадис) Расположение о. Хейбелиада, Турция Юридический адрес Ümit tepesi No 5, 34973 Heybeliada, Istanbul, Turkey Сайт www.greece.org  [[commons:Category:Halki seminary|Халкинская богословская школа тур. Rum Ortodoks Ruhban Okulu греч. Ιερά Θεολογική Σχολή της Χάλκης на Викискладе]] Ха́лкинская богосло́вская шко́ла (или Духовная семинария на Халки , тур. Rum Ortodoks Ruhban Okulu , греч. Ιερά Θεολογική Σχολή της Χάλκης ) — недействующее среднее специальное учебное заведение Константинопольской православной церкви, расположенное на территории Свято-Троицкого мужского монастыря на вершине холма Надежды (тур. Ümit Tepesi ) острова Хейбелиада, в Турции....
                    Read more

                    Высокополье (Харьковская область)

                    Image
                    У этого термина существуют и другие значения, см. Высокополье. Село Высокополье укр. Високопілля Герб 49°55′07″ с. ш. 35°25′13″ в. д. H G Я O L Страна Украина   Украина Область Харьковская Район Валковский Сельский совет Высокопольский История и география Основан 1670 Прежние названия Хмелевое Площадь 55,56 км² Часовой пояс UTC+2, летом UTC+3 Население Население 1957 человек ( 2001 ) Плотность 35,220 чел./км² Цифровые идентификаторы Телефонный код +380 5753 Почтовый индекс 63020 Автомобильный код AX, КХ / 21 КОАТУУ 6321281501 Высокополье Высокополье Высокополье  Аудио, фото и видео на Викискладе Высокопо́лье (укр. Високопілля ) — село, Высокопольский сельский совет, Валковский район, Харьковская область, Украина. Код КОАТУУ — 6321281501. Население по переписи 2001 г. составляет 1957 (866/1091 м/ж) человек. Является административным центр...
                    Read more