Using Time Homogenous Markov Chain to maximise profit











up vote
0
down vote

favorite












Suppose there is a company with 30 printing machines and they need to hire staff to operate the machines such that the profit is maximised. The model is that each machine is either
1. Idle state (not operating)
2. Setup state (Operator is working on readying it for printing)
3. Working state (machine is printing, operator not needed)



When a machine completes a print job (working state), it enters either setup state (if there is a free operator available) or Idle state (if no operators are free).



When an operator finishes Setup state of a machine, the machine enters Working state and the Operator either selects an Idle machine and start Setup or if no machines are available, the operator waits until next machine becomes available.



The length of each print job (in days) follows Exp(7) and length of time (in days) to set up a machine follows Exp(1) dist. Setup times and print times are independent.



While in working, the machine earns $30/day and $0 in other states. Each operator costs $80 per day.
The question is how to maximise profit, by mainly using Time Homogenous Markov chains and R coding










share|cite|improve this question







New contributor




TimMarkhov is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
Check out our Code of Conduct.
























    up vote
    0
    down vote

    favorite












    Suppose there is a company with 30 printing machines and they need to hire staff to operate the machines such that the profit is maximised. The model is that each machine is either
    1. Idle state (not operating)
    2. Setup state (Operator is working on readying it for printing)
    3. Working state (machine is printing, operator not needed)



    When a machine completes a print job (working state), it enters either setup state (if there is a free operator available) or Idle state (if no operators are free).



    When an operator finishes Setup state of a machine, the machine enters Working state and the Operator either selects an Idle machine and start Setup or if no machines are available, the operator waits until next machine becomes available.



    The length of each print job (in days) follows Exp(7) and length of time (in days) to set up a machine follows Exp(1) dist. Setup times and print times are independent.



    While in working, the machine earns $30/day and $0 in other states. Each operator costs $80 per day.
    The question is how to maximise profit, by mainly using Time Homogenous Markov chains and R coding










    share|cite|improve this question







    New contributor




    TimMarkhov is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
    Check out our Code of Conduct.






















      up vote
      0
      down vote

      favorite









      up vote
      0
      down vote

      favorite











      Suppose there is a company with 30 printing machines and they need to hire staff to operate the machines such that the profit is maximised. The model is that each machine is either
      1. Idle state (not operating)
      2. Setup state (Operator is working on readying it for printing)
      3. Working state (machine is printing, operator not needed)



      When a machine completes a print job (working state), it enters either setup state (if there is a free operator available) or Idle state (if no operators are free).



      When an operator finishes Setup state of a machine, the machine enters Working state and the Operator either selects an Idle machine and start Setup or if no machines are available, the operator waits until next machine becomes available.



      The length of each print job (in days) follows Exp(7) and length of time (in days) to set up a machine follows Exp(1) dist. Setup times and print times are independent.



      While in working, the machine earns $30/day and $0 in other states. Each operator costs $80 per day.
      The question is how to maximise profit, by mainly using Time Homogenous Markov chains and R coding










      share|cite|improve this question







      New contributor




      TimMarkhov is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.











      Suppose there is a company with 30 printing machines and they need to hire staff to operate the machines such that the profit is maximised. The model is that each machine is either
      1. Idle state (not operating)
      2. Setup state (Operator is working on readying it for printing)
      3. Working state (machine is printing, operator not needed)



      When a machine completes a print job (working state), it enters either setup state (if there is a free operator available) or Idle state (if no operators are free).



      When an operator finishes Setup state of a machine, the machine enters Working state and the Operator either selects an Idle machine and start Setup or if no machines are available, the operator waits until next machine becomes available.



      The length of each print job (in days) follows Exp(7) and length of time (in days) to set up a machine follows Exp(1) dist. Setup times and print times are independent.



      While in working, the machine earns $30/day and $0 in other states. Each operator costs $80 per day.
      The question is how to maximise profit, by mainly using Time Homogenous Markov chains and R coding







      stochastic-processes markov-chains markov-process transition-matrix






      share|cite|improve this question







      New contributor




      TimMarkhov is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.











      share|cite|improve this question







      New contributor




      TimMarkhov is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      share|cite|improve this question




      share|cite|improve this question






      New contributor




      TimMarkhov is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.









      asked Nov 15 at 6:31









      TimMarkhov

      1




      1




      New contributor




      TimMarkhov is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.





      New contributor





      TimMarkhov is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.






      TimMarkhov is a new contributor to this site. Take care in asking for clarification, commenting, and answering.
      Check out our Code of Conduct.



























          active

          oldest

          votes











          Your Answer





          StackExchange.ifUsing("editor", function () {
          return StackExchange.using("mathjaxEditing", function () {
          StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
          StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
          });
          });
          }, "mathjax-editing");

          StackExchange.ready(function() {
          var channelOptions = {
          tags: "".split(" "),
          id: "69"
          };
          initTagRenderer("".split(" "), "".split(" "), channelOptions);

          StackExchange.using("externalEditor", function() {
          // Have to fire editor after snippets, if snippets enabled
          if (StackExchange.settings.snippets.snippetsEnabled) {
          StackExchange.using("snippets", function() {
          createEditor();
          });
          }
          else {
          createEditor();
          }
          });

          function createEditor() {
          StackExchange.prepareEditor({
          heartbeatType: 'answer',
          convertImagesToLinks: true,
          noModals: true,
          showLowRepImageUploadWarning: true,
          reputationToPostImages: 10,
          bindNavPrevention: true,
          postfix: "",
          imageUploader: {
          brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
          contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
          allowUrls: true
          },
          noCode: true, onDemand: true,
          discardSelector: ".discard-answer"
          ,immediatelyShowMarkdownHelp:true
          });


          }
          });






          TimMarkhov is a new contributor. Be nice, and check out our Code of Conduct.










           

          draft saved


          draft discarded


















          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2999314%2fusing-time-homogenous-markov-chain-to-maximise-profit%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown






























          active

          oldest

          votes













          active

          oldest

          votes









          active

          oldest

          votes






          active

          oldest

          votes








          TimMarkhov is a new contributor. Be nice, and check out our Code of Conduct.










           

          draft saved


          draft discarded


















          TimMarkhov is a new contributor. Be nice, and check out our Code of Conduct.













          TimMarkhov is a new contributor. Be nice, and check out our Code of Conduct.












          TimMarkhov is a new contributor. Be nice, and check out our Code of Conduct.















           


          draft saved


          draft discarded














          StackExchange.ready(
          function () {
          StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmath.stackexchange.com%2fquestions%2f2999314%2fusing-time-homogenous-markov-chain-to-maximise-profit%23new-answer', 'question_page');
          }
          );

          Post as a guest















          Required, but never shown





















































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown

































          Required, but never shown














          Required, but never shown












          Required, but never shown







          Required, but never shown







          Popular posts from this blog

          Quarter-circle Tiles

          build a pushdown automaton that recognizes the reverse language of a given pushdown automaton?

          Mont Emei