Problem # 2 Bit Bucket Computers specializes in installing and maintaining
computer systems. Unfortunately, the reliability of their computer systems is
somewhat questionable. One of its standard congratulations is to install two
computers. When both are working at the start of business, there is a 30% chance
that one will fail by the close of business, and a 10% chance that both will fail. If
only one computer is working at the start of business, then there is a 20% chance
it will fail by the close of business. Computers that fail during the day are picked
up the following morning, repaired, and then returned the next day after that,
before the start of business. Suppose we start observing an office with this
congratulation on a day with two working computers at the start of business.
Model this setting as a Markov process by defining:
• the state space and the meaning of each state in the setting's context,
• the meaning of one-time step in the setting's context,
• the meaning of the state visited in the nth time step in the setting's context,
and
• the one-step transition probabilities and initial state probabilities
