What is the stationary distribution of the following Markov chain?












0












$begingroup$




Consider a chain with state space ${1,2, cdots }.$ If you are at $1$ go to state $j$ with probability $p_j$ $($$ j=1,2,cdots$ $) ,$ where these are non-negative numbers adding to $1$. If you are in a state $i>1 ,$ then go just one step back$,$ that is$,$ to $i-1.$ Discuss the nature of the states and nature of the stationary distribution$.$





Assuming that all $p_j$'s are positive I found that the Markov chain is irreducible with all it's states recurrent$.$ So there is no transient state and hence inessential state in the above Markov chain$.$ While calculating stationary distribution I found a problem$.$ Here it is $:$



Suppose $pi = (pi_1 , pi_2 , cdots )$ be the stationary distribution of the above Markov chain$.$ Then I found that $pi_2 = (1-p_1) pi_1, pi_3 = (1-p_1-p_2) pi_1, cdots$
Since $sumlimits_{i=1}^{infty} pi_i = 1$ so $pi_1 {1 + (1-p_1) + (1-p_1 -p_2) + (1-p_1 -p_2 - p_3) + cdots }= 1.$ Now how do I find the sum



$$1 + sum_{k=1}^{infty} (1-p_1-p_2 -p_3 - cdots - p_k) ?$$



Or in other words



$$sumlimits_{k=1}^{infty} sumlimits_{j=k}^{infty} p_j ?$$



This gives us $pi_1$ and consequently all the $pi_i$'s$.$ where



$$pi_i = frac {sumlimits_{k=i}^{infty} p_k} {sumlimits_{k=1}^{infty} sumlimits_{j=k}^{infty} p_j}.$$



for $i=1,2,cdots.$



Please help me in this regard. Thank you very much.






probability stochastic-processes markov-chains







share|cite|improve this question











$endgroup$












  • $begingroup$
    I get $sum_{j=1}^infty{jp_j}$ The value of this will depend on the $p_j$ of course. I think you've solved the problem already.
    $endgroup$
    – saulspatz
    Dec 5 '18 at 15:02










  • $begingroup$
    Whose value is $sum_{j=1}^{infty} jp_j$?
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:12










  • $begingroup$
    $1+(1-p_1)+(1-p_1-p_2)+(1-p_1-p_2-p_3)+dots=sum_{j=1}^{infty} jp_j$
    $endgroup$
    – saulspatz
    Dec 5 '18 at 15:17










  • $begingroup$
    How? I got $$sumlimits_{k=1}^{infty} sumlimits_{j=k}^{infty} p_j.$$ You may check. How do you get your expression? Would you please share @saulspatz?
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:29










  • $begingroup$
    Yeah I have understood. Anyway same expression. Actually I love multiple sums.😀
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:30


















0












$begingroup$




Consider a chain with state space ${1,2, cdots }.$ If you are at $1$ go to state $j$ with probability $p_j$ $($$ j=1,2,cdots$ $) ,$ where these are non-negative numbers adding to $1$. If you are in a state $i>1 ,$ then go just one step back$,$ that is$,$ to $i-1.$ Discuss the nature of the states and nature of the stationary distribution$.$





Assuming that all $p_j$'s are positive I found that the Markov chain is irreducible with all it's states recurrent$.$ So there is no transient state and hence inessential state in the above Markov chain$.$ While calculating stationary distribution I found a problem$.$ Here it is $:$



Suppose $pi = (pi_1 , pi_2 , cdots )$ be the stationary distribution of the above Markov chain$.$ Then I found that $pi_2 = (1-p_1) pi_1, pi_3 = (1-p_1-p_2) pi_1, cdots$
Since $sumlimits_{i=1}^{infty} pi_i = 1$ so $pi_1 {1 + (1-p_1) + (1-p_1 -p_2) + (1-p_1 -p_2 - p_3) + cdots }= 1.$ Now how do I find the sum



$$1 + sum_{k=1}^{infty} (1-p_1-p_2 -p_3 - cdots - p_k) ?$$



Or in other words



$$sumlimits_{k=1}^{infty} sumlimits_{j=k}^{infty} p_j ?$$



This gives us $pi_1$ and consequently all the $pi_i$'s$.$ where



$$pi_i = frac {sumlimits_{k=i}^{infty} p_k} {sumlimits_{k=1}^{infty} sumlimits_{j=k}^{infty} p_j}.$$



for $i=1,2,cdots.$



Please help me in this regard. Thank you very much.






probability stochastic-processes markov-chains







share|cite|improve this question











$endgroup$












  • $begingroup$
    I get $sum_{j=1}^infty{jp_j}$ The value of this will depend on the $p_j$ of course. I think you've solved the problem already.
    $endgroup$
    – saulspatz
    Dec 5 '18 at 15:02










  • $begingroup$
    Whose value is $sum_{j=1}^{infty} jp_j$?
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:12










  • $begingroup$
    $1+(1-p_1)+(1-p_1-p_2)+(1-p_1-p_2-p_3)+dots=sum_{j=1}^{infty} jp_j$
    $endgroup$
    – saulspatz
    Dec 5 '18 at 15:17










  • $begingroup$
    How? I got $$sumlimits_{k=1}^{infty} sumlimits_{j=k}^{infty} p_j.$$ You may check. How do you get your expression? Would you please share @saulspatz?
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:29










  • $begingroup$
    Yeah I have understood. Anyway same expression. Actually I love multiple sums.😀
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:30
















0












0








0





$begingroup$




Consider a chain with state space ${1,2, cdots }.$ If you are at $1$ go to state $j$ with probability $p_j$ $($$ j=1,2,cdots$ $) ,$ where these are non-negative numbers adding to $1$. If you are in a state $i>1 ,$ then go just one step back$,$ that is$,$ to $i-1.$ Discuss the nature of the states and nature of the stationary distribution$.$





Assuming that all $p_j$'s are positive I found that the Markov chain is irreducible with all it's states recurrent$.$ So there is no transient state and hence inessential state in the above Markov chain$.$ While calculating stationary distribution I found a problem$.$ Here it is $:$



Suppose $pi = (pi_1 , pi_2 , cdots )$ be the stationary distribution of the above Markov chain$.$ Then I found that $pi_2 = (1-p_1) pi_1, pi_3 = (1-p_1-p_2) pi_1, cdots$
Since $sumlimits_{i=1}^{infty} pi_i = 1$ so $pi_1 {1 + (1-p_1) + (1-p_1 -p_2) + (1-p_1 -p_2 - p_3) + cdots }= 1.$ Now how do I find the sum



$$1 + sum_{k=1}^{infty} (1-p_1-p_2 -p_3 - cdots - p_k) ?$$



Or in other words



$$sumlimits_{k=1}^{infty} sumlimits_{j=k}^{infty} p_j ?$$



This gives us $pi_1$ and consequently all the $pi_i$'s$.$ where



$$pi_i = frac {sumlimits_{k=i}^{infty} p_k} {sumlimits_{k=1}^{infty} sumlimits_{j=k}^{infty} p_j}.$$



for $i=1,2,cdots.$



Please help me in this regard. Thank you very much.






probability stochastic-processes markov-chains







share|cite|improve this question











$endgroup$






Consider a chain with state space ${1,2, cdots }.$ If you are at $1$ go to state $j$ with probability $p_j$ $($$ j=1,2,cdots$ $) ,$ where these are non-negative numbers adding to $1$. If you are in a state $i>1 ,$ then go just one step back$,$ that is$,$ to $i-1.$ Discuss the nature of the states and nature of the stationary distribution$.$





Assuming that all $p_j$'s are positive I found that the Markov chain is irreducible with all it's states recurrent$.$ So there is no transient state and hence inessential state in the above Markov chain$.$ While calculating stationary distribution I found a problem$.$ Here it is $:$



Suppose $pi = (pi_1 , pi_2 , cdots )$ be the stationary distribution of the above Markov chain$.$ Then I found that $pi_2 = (1-p_1) pi_1, pi_3 = (1-p_1-p_2) pi_1, cdots$
Since $sumlimits_{i=1}^{infty} pi_i = 1$ so $pi_1 {1 + (1-p_1) + (1-p_1 -p_2) + (1-p_1 -p_2 - p_3) + cdots }= 1.$ Now how do I find the sum



$$1 + sum_{k=1}^{infty} (1-p_1-p_2 -p_3 - cdots - p_k) ?$$



Or in other words



$$sumlimits_{k=1}^{infty} sumlimits_{j=k}^{infty} p_j ?$$



This gives us $pi_1$ and consequently all the $pi_i$'s$.$ where



$$pi_i = frac {sumlimits_{k=i}^{infty} p_k} {sumlimits_{k=1}^{infty} sumlimits_{j=k}^{infty} p_j}.$$



for $i=1,2,cdots.$



Please help me in this regard. Thank you very much.






probability stochastic-processes markov-chains




probability stochastic-processes markov-chains






share|cite|improve this question















share|cite|improve this question













share|cite|improve this question




share|cite|improve this question








edited Dec 5 '18 at 15:14







Dbchatto67

















asked Dec 5 '18 at 14:34









Dbchatto67Dbchatto67

536116




536116












  • $begingroup$
    I get $sum_{j=1}^infty{jp_j}$ The value of this will depend on the $p_j$ of course. I think you've solved the problem already.
    $endgroup$
    – saulspatz
    Dec 5 '18 at 15:02










  • $begingroup$
    Whose value is $sum_{j=1}^{infty} jp_j$?
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:12










  • $begingroup$
    $1+(1-p_1)+(1-p_1-p_2)+(1-p_1-p_2-p_3)+dots=sum_{j=1}^{infty} jp_j$
    $endgroup$
    – saulspatz
    Dec 5 '18 at 15:17










  • $begingroup$
    How? I got $$sumlimits_{k=1}^{infty} sumlimits_{j=k}^{infty} p_j.$$ You may check. How do you get your expression? Would you please share @saulspatz?
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:29










  • $begingroup$
    Yeah I have understood. Anyway same expression. Actually I love multiple sums.😀
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:30




















  • $begingroup$
    I get $sum_{j=1}^infty{jp_j}$ The value of this will depend on the $p_j$ of course. I think you've solved the problem already.
    $endgroup$
    – saulspatz
    Dec 5 '18 at 15:02










  • $begingroup$
    Whose value is $sum_{j=1}^{infty} jp_j$?
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:12










  • $begingroup$
    $1+(1-p_1)+(1-p_1-p_2)+(1-p_1-p_2-p_3)+dots=sum_{j=1}^{infty} jp_j$
    $endgroup$
    – saulspatz
    Dec 5 '18 at 15:17










  • $begingroup$
    How? I got $$sumlimits_{k=1}^{infty} sumlimits_{j=k}^{infty} p_j.$$ You may check. How do you get your expression? Would you please share @saulspatz?
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:29










  • $begingroup$
    Yeah I have understood. Anyway same expression. Actually I love multiple sums.😀
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:30


















$begingroup$
I get $sum_{j=1}^infty{jp_j}$ The value of this will depend on the $p_j$ of course. I think you've solved the problem already.
$endgroup$
– saulspatz
Dec 5 '18 at 15:02




$begingroup$
I get $sum_{j=1}^infty{jp_j}$ The value of this will depend on the $p_j$ of course. I think you've solved the problem already.
$endgroup$
– saulspatz
Dec 5 '18 at 15:02












$begingroup$
Whose value is $sum_{j=1}^{infty} jp_j$?
$endgroup$
– Dbchatto67
Dec 5 '18 at 15:12




$begingroup$
Whose value is $sum_{j=1}^{infty} jp_j$?
$endgroup$
– Dbchatto67
Dec 5 '18 at 15:12












$begingroup$
$1+(1-p_1)+(1-p_1-p_2)+(1-p_1-p_2-p_3)+dots=sum_{j=1}^{infty} jp_j$
$endgroup$
– saulspatz
Dec 5 '18 at 15:17




$begingroup$
$1+(1-p_1)+(1-p_1-p_2)+(1-p_1-p_2-p_3)+dots=sum_{j=1}^{infty} jp_j$
$endgroup$
– saulspatz
Dec 5 '18 at 15:17












$begingroup$
How? I got $$sumlimits_{k=1}^{infty} sumlimits_{j=k}^{infty} p_j.$$ You may check. How do you get your expression? Would you please share @saulspatz?
$endgroup$
– Dbchatto67
Dec 5 '18 at 15:29




$begingroup$
How? I got $$sumlimits_{k=1}^{infty} sumlimits_{j=k}^{infty} p_j.$$ You may check. How do you get your expression? Would you please share @saulspatz?
$endgroup$
– Dbchatto67
Dec 5 '18 at 15:29












$begingroup$
Yeah I have understood. Anyway same expression. Actually I love multiple sums.😀
$endgroup$
– Dbchatto67
Dec 5 '18 at 15:30






$begingroup$
Yeah I have understood. Anyway same expression. Actually I love multiple sums.😀
$endgroup$
– Dbchatto67
Dec 5 '18 at 15:30












1 Answer
1






active

oldest

votes


















1












$begingroup$

$$begin{align}
sum_{j=1}^infty{jp_j}&=sum_{j=1}^infty{p_j}+sum_{j=2}^infty{(j-1)p_j}\
&=1+sum_{j=2}^infty{p_j}+sum_{j=3}^infty{(j-2)p_j}\
&=1+(1-p_1)+sum_{j=3}^infty{p_j}+sum_{j=4}^infty{(j-3)p_j}\
&vdots
end{align}$$



EDIT



This is true if the given sum converges. As discussed in the accepted answer to this question, it need not.






share|cite|improve this answer











$endgroup$













  • $begingroup$
    I have understood it already. Thanks for your answer.
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:37










  • $begingroup$
    @Dbchatto67 Right, I'd just finished typing it when I saw your comment, so I went ahead and posted it. An interesting point is that this problem shows if $p_jge0$ and $sum{p_j}=1,$ then $sum{jp_j}$ converges. Is there a more direct proof?
    $endgroup$
    – saulspatz
    Dec 5 '18 at 15:44












  • $begingroup$
    Hmm. Good observation. May be there are direct approaches but I am not familiar with those. Sorry for that. Do you know some of them? Then please don't forget to share your thoughts. That will also be helpful for me.
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:54












  • $begingroup$
    @Dbchatto67 There must be an error here. Look at math.stackexchange.com/questions/3027282/…
    $endgroup$
    – saulspatz
    Dec 5 '18 at 16:30










  • $begingroup$
    Then what is the error lying in the question?
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 16:36











Your Answer





StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "69"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
noCode: true, onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});














draft saved

draft discarded


















StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3027132%2fwhat-is-the-stationary-distribution-of-the-following-markov-chain%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown

























1 Answer
1






active

oldest

votes








1 Answer
1






active

oldest

votes









active

oldest

votes






active

oldest

votes









1












$begingroup$

$$begin{align}
sum_{j=1}^infty{jp_j}&=sum_{j=1}^infty{p_j}+sum_{j=2}^infty{(j-1)p_j}\
&=1+sum_{j=2}^infty{p_j}+sum_{j=3}^infty{(j-2)p_j}\
&=1+(1-p_1)+sum_{j=3}^infty{p_j}+sum_{j=4}^infty{(j-3)p_j}\
&vdots
end{align}$$



EDIT



This is true if the given sum converges. As discussed in the accepted answer to this question, it need not.






share|cite|improve this answer











$endgroup$













  • $begingroup$
    I have understood it already. Thanks for your answer.
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:37










  • $begingroup$
    @Dbchatto67 Right, I'd just finished typing it when I saw your comment, so I went ahead and posted it. An interesting point is that this problem shows if $p_jge0$ and $sum{p_j}=1,$ then $sum{jp_j}$ converges. Is there a more direct proof?
    $endgroup$
    – saulspatz
    Dec 5 '18 at 15:44












  • $begingroup$
    Hmm. Good observation. May be there are direct approaches but I am not familiar with those. Sorry for that. Do you know some of them? Then please don't forget to share your thoughts. That will also be helpful for me.
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:54












  • $begingroup$
    @Dbchatto67 There must be an error here. Look at math.stackexchange.com/questions/3027282/…
    $endgroup$
    – saulspatz
    Dec 5 '18 at 16:30










  • $begingroup$
    Then what is the error lying in the question?
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 16:36
















1












$begingroup$

$$begin{align}
sum_{j=1}^infty{jp_j}&=sum_{j=1}^infty{p_j}+sum_{j=2}^infty{(j-1)p_j}\
&=1+sum_{j=2}^infty{p_j}+sum_{j=3}^infty{(j-2)p_j}\
&=1+(1-p_1)+sum_{j=3}^infty{p_j}+sum_{j=4}^infty{(j-3)p_j}\
&vdots
end{align}$$



EDIT



This is true if the given sum converges. As discussed in the accepted answer to this question, it need not.






share|cite|improve this answer











$endgroup$













  • $begingroup$
    I have understood it already. Thanks for your answer.
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:37










  • $begingroup$
    @Dbchatto67 Right, I'd just finished typing it when I saw your comment, so I went ahead and posted it. An interesting point is that this problem shows if $p_jge0$ and $sum{p_j}=1,$ then $sum{jp_j}$ converges. Is there a more direct proof?
    $endgroup$
    – saulspatz
    Dec 5 '18 at 15:44












  • $begingroup$
    Hmm. Good observation. May be there are direct approaches but I am not familiar with those. Sorry for that. Do you know some of them? Then please don't forget to share your thoughts. That will also be helpful for me.
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:54












  • $begingroup$
    @Dbchatto67 There must be an error here. Look at math.stackexchange.com/questions/3027282/…
    $endgroup$
    – saulspatz
    Dec 5 '18 at 16:30










  • $begingroup$
    Then what is the error lying in the question?
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 16:36














1












1








1





$begingroup$

$$begin{align}
sum_{j=1}^infty{jp_j}&=sum_{j=1}^infty{p_j}+sum_{j=2}^infty{(j-1)p_j}\
&=1+sum_{j=2}^infty{p_j}+sum_{j=3}^infty{(j-2)p_j}\
&=1+(1-p_1)+sum_{j=3}^infty{p_j}+sum_{j=4}^infty{(j-3)p_j}\
&vdots
end{align}$$



EDIT



This is true if the given sum converges. As discussed in the accepted answer to this question, it need not.






share|cite|improve this answer











$endgroup$



$$begin{align}
sum_{j=1}^infty{jp_j}&=sum_{j=1}^infty{p_j}+sum_{j=2}^infty{(j-1)p_j}\
&=1+sum_{j=2}^infty{p_j}+sum_{j=3}^infty{(j-2)p_j}\
&=1+(1-p_1)+sum_{j=3}^infty{p_j}+sum_{j=4}^infty{(j-3)p_j}\
&vdots
end{align}$$



EDIT



This is true if the given sum converges. As discussed in the accepted answer to this question, it need not.







share|cite|improve this answer














share|cite|improve this answer



share|cite|improve this answer








edited Dec 5 '18 at 18:00

























answered Dec 5 '18 at 15:36









saulspatzsaulspatz

14.4k21329




14.4k21329












  • $begingroup$
    I have understood it already. Thanks for your answer.
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:37










  • $begingroup$
    @Dbchatto67 Right, I'd just finished typing it when I saw your comment, so I went ahead and posted it. An interesting point is that this problem shows if $p_jge0$ and $sum{p_j}=1,$ then $sum{jp_j}$ converges. Is there a more direct proof?
    $endgroup$
    – saulspatz
    Dec 5 '18 at 15:44












  • $begingroup$
    Hmm. Good observation. May be there are direct approaches but I am not familiar with those. Sorry for that. Do you know some of them? Then please don't forget to share your thoughts. That will also be helpful for me.
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:54












  • $begingroup$
    @Dbchatto67 There must be an error here. Look at math.stackexchange.com/questions/3027282/…
    $endgroup$
    – saulspatz
    Dec 5 '18 at 16:30










  • $begingroup$
    Then what is the error lying in the question?
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 16:36


















  • $begingroup$
    I have understood it already. Thanks for your answer.
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:37










  • $begingroup$
    @Dbchatto67 Right, I'd just finished typing it when I saw your comment, so I went ahead and posted it. An interesting point is that this problem shows if $p_jge0$ and $sum{p_j}=1,$ then $sum{jp_j}$ converges. Is there a more direct proof?
    $endgroup$
    – saulspatz
    Dec 5 '18 at 15:44












  • $begingroup$
    Hmm. Good observation. May be there are direct approaches but I am not familiar with those. Sorry for that. Do you know some of them? Then please don't forget to share your thoughts. That will also be helpful for me.
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 15:54












  • $begingroup$
    @Dbchatto67 There must be an error here. Look at math.stackexchange.com/questions/3027282/…
    $endgroup$
    – saulspatz
    Dec 5 '18 at 16:30










  • $begingroup$
    Then what is the error lying in the question?
    $endgroup$
    – Dbchatto67
    Dec 5 '18 at 16:36
















$begingroup$
I have understood it already. Thanks for your answer.
$endgroup$
– Dbchatto67
Dec 5 '18 at 15:37




$begingroup$
I have understood it already. Thanks for your answer.
$endgroup$
– Dbchatto67
Dec 5 '18 at 15:37












$begingroup$
@Dbchatto67 Right, I'd just finished typing it when I saw your comment, so I went ahead and posted it. An interesting point is that this problem shows if $p_jge0$ and $sum{p_j}=1,$ then $sum{jp_j}$ converges. Is there a more direct proof?
$endgroup$
– saulspatz
Dec 5 '18 at 15:44






$begingroup$
@Dbchatto67 Right, I'd just finished typing it when I saw your comment, so I went ahead and posted it. An interesting point is that this problem shows if $p_jge0$ and $sum{p_j}=1,$ then $sum{jp_j}$ converges. Is there a more direct proof?
$endgroup$
– saulspatz
Dec 5 '18 at 15:44














$begingroup$
Hmm. Good observation. May be there are direct approaches but I am not familiar with those. Sorry for that. Do you know some of them? Then please don't forget to share your thoughts. That will also be helpful for me.
$endgroup$
– Dbchatto67
Dec 5 '18 at 15:54






$begingroup$
Hmm. Good observation. May be there are direct approaches but I am not familiar with those. Sorry for that. Do you know some of them? Then please don't forget to share your thoughts. That will also be helpful for me.
$endgroup$
– Dbchatto67
Dec 5 '18 at 15:54














$begingroup$
@Dbchatto67 There must be an error here. Look at math.stackexchange.com/questions/3027282/…
$endgroup$
– saulspatz
Dec 5 '18 at 16:30




$begingroup$
@Dbchatto67 There must be an error here. Look at math.stackexchange.com/questions/3027282/…
$endgroup$
– saulspatz
Dec 5 '18 at 16:30












$begingroup$
Then what is the error lying in the question?
$endgroup$
– Dbchatto67
Dec 5 '18 at 16:36




$begingroup$
Then what is the error lying in the question?
$endgroup$
– Dbchatto67
Dec 5 '18 at 16:36


















draft saved

draft discarded




















































Thanks for contributing an answer to Mathematics Stack Exchange!


  • Please be sure to answer the question. Provide details and share your research!

But avoid …



  • Asking for help, clarification, or responding to other answers.

  • Making statements based on opinion; back them up with references or personal experience.


Use MathJax to format equations. MathJax reference.


To learn more, see our tips on writing great answers.




draft saved


draft discarded














StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f3027132%2fwhat-is-the-stationary-distribution-of-the-following-markov-chain%23new-answer', 'question_page');
}
);

Post as a guest















Required, but never shown





















































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown

































Required, but never shown














Required, but never shown












Required, but never shown







Required, but never shown







-

Popular posts from this blog

Ellipse (mathématiques)

Image
Pour les articles homonymes, voir Ellipse. L'ellipse est le lieu des points dont la somme des distances à deux points fixes, dits foyers, est constante. Section du cône ou projection du cercle. En géométrie, une ellipse est une courbe plane fermée obtenue par l’intersection d’un cône de révolution avec un plan, à condition que celui-ci coupe l'axe de rotation du cône ou du cylindre : c'est une conique d'excentricité strictement comprise entre 0 et 1. On peut également la définir comme le lieu des points dont la somme des distances à deux points fixes, dits foyers, est constante (sa construction par la méthode du jardinier est très simple). Dans la vie courante, l’ellipse est la forme qu'on perçoit en regardant un cercle en perspective, ou la figure formée par l’ombre d'un disque sur une surface plane. On retrouve aussi, en première approximation [ 1 ] , des ellipses dans les trajectoires des corps célestes (planètes, comètes ou satellites arti...
Read more

Quarter-circle Tiles

Image
up vote 0 down vote favorite I have $99$ identical square tiles, each with a quarter-circle drawn on it like this: [asy] size(1.5cm); draw(Arc((2,0),1,90,180),red+1); draw((0,0)--(2,0)--(2,2)--(0,2)--(0,0)); [/asy] When I arrange the tiles in a $9times 11$ rectangular grid, each with a random orientation, what is the expected value of the number of full circles I form? I think this problem has to do with finding the chance any given 2x2 square has a circle, but I can't find it. expected-value share | cite | improve this question asked Nov 20 at 15:03 6minecraftninja 1 2 ...
Read more

Mont Emei

Image
Mont Emei.mw-parser-output .entete.map{background-image:url("//upload.wikimedia.org/wikipedia/commons/7/7a/Picto_infobox_map.png")} Vue du sommet Wanfo du mont Emei Géographie Altitude 3 099  m , Wanfo Coordonnées 29° 31′ 11″ nord, 103° 19′ 57″ est Administration Pays   Chine Province Sichuan Ville-préfecture Leshan Géolocalisation sur la carte : Sichuan Mont Emei Géolocalisation sur la carte : Chine Mont Emei modifier   Paysage panoramique du mont Emei, incluant le paysage panoramique du grand Bouddha de Leshan *   Patrimoine mondial de l'UNESCO Passerelle en bois sur le versant ouest Pays   Chine Subdivision Sichuan Type Mixte Critères (iv) (vi) (x) Superficie 15 400 ha Numéro d’identification 779 Zone géographique Asie et Pacifique  ** Année d’inscription 1996 (20 e session) * Descriptif officiel UNESCO ** Classification géog...
Read more