Question

3. (40 points) An appliance store can place orders for refrigerators at the beginning of each month for immediate delivery. A fixed cost $100 is incurred every time an order is placed. The storage cost per refrigerator per month is $5. In a period, the customer demand which can not be met from the stock is lost. The penalty for lost customer demand is estimated at $150 per refrigerator per month. The monthly demand is given by the following probability mass function: Pr{D = 0} = 0.2, Pr{D = 1} = 0.5, Pr{D = 2} = 0.3. The store's policy is that the maximum stock level should not exceed two refrigerators in any single month. You are asked to model the problem as a Markov Decision Process by answering the following sequence of questions a. (5 points) What is the state space of the process? b. (5 points) What are action sets for each state? c. (5 points) Provide one possible stationary policy. d. (15 points) What is the transition matrix of the policy your provided? e. (10 points) Provide the one-period expected costs for the policy you provided.

          3. (40 points) An appliance store can place orders for refrigerators at the beginning of each month for immediate delivery. A fixed cost $100 is incurred every time an order is placed. The storage cost per refrigerator per month is $5. In a period, the customer demand which can not be met from the stock is lost. The penalty for lost customer demand is estimated at $150 per refrigerator per month. The monthly demand is given by the following probability mass function:
Pr{D = 0} = 0.2, Pr{D = 1} = 0.5, Pr{D = 2} = 0.3.
The store's policy is that the maximum stock level should not exceed two refrigerators in any single month. You are asked to model the problem as a Markov Decision Process by answering the following sequence of questions
a. (5 points) What is the state space of the process?
b. (5 points) What are action sets for each state?
c. (5 points) Provide one possible stationary policy.
d. (15 points) What is the transition matrix of the policy your provided?
e. (10 points) Provide the one-period expected costs for the policy you provided.

Show more…

3. (40 points) An appliance store can place orders for refrigerators at the beginning of each month for immediate delivery. A fixed cost 100 is incurred every time an order is placed. The storage cost per refrigerator per month is5. In a period, the customer demand which can not be met from the stock is lost. The penalty for lost customer demand is estimated at 150 per refrigerator per month. The monthly demand is given by the following probability mass function:
PrD = 0 = 0.2, PrD = 1 = 0.5, PrD = 2 = 0.3.
The store's policy is that the maximum stock level should not exceed two refrigerators in any single month. You are asked to model the problem as a Markov Decision Process by answering the following sequence of questions
a. (5 points) What is the state space of the process?
b. (5 points) What are action sets for each state?
c. (5 points) Provide one possible stationary policy.
d. (15 points) What is the transition matrix of the policy your provided?
e. (10 points) Provide the one-period expected costs for the policy you provided.

Added by Daisy C.

Calculus: Early Transcendentals

James Stewart 8th Edition

Instant Answer

Solved by Expert Shaiju T

06/30/2022

Step 1

In this scenario, the state is defined by the number of refrigerators in stock at the beginning of the month, which can range from 0 to 2 due to the store's policy. Therefore, the state space is {0, 1, 2}. Show more…

Show all steps

lock

Thanks for your feedback!

An appliance store can place orders for refrigerators at the beginning of each month for immediate delivery. A fixed cost of $100 is incurred every time an order is placed. The storage cost per refrigerator per month is $5. In a period, the customer demand which cannot be met from the stock is lost. The penalty for lost customer demand is estimated at $150 per refrigerator per month. The monthly demand is given by the following probability mass function: Pr{D = 0} = 0.2, Pr{D = 1} = 0.5, Pr{D = 2} = 0.3 The store's policy is that the maximum stock level should not exceed two refrigerators in any single month. You are asked to model the problem as a Markov Decision Process by answering the following sequence of questions: 1. What is the state space of the process? 2. What are the action sets for each state? 3. Provide one possible stationary policy. 4. What is the transition matrix of the policy you provided? 5. Provide the one-period expected costs for the policy you provided.

Play audio

Feedback

Powered by NumerAI

Shaiju T and 86 other subject Calculus 3 educators are ready to help you.

Ask a new question

Labs

Want to see this concept in action?

NEW

Explore this concept interactively to see how it behaves as you change inputs.

View Labs

Key Concepts

Recommended Videos

Recommended Textbooks

Transcript

00:01 Hello everyone so we have an appliance store so a fixed cost of hundred dollars is incurred every time when order is placed so the storage cost storage cost is five dollars per refrigerator so the customer is demanding and the customer demand is estimated customer's demand is estimated to be $150 per refrigerator.

00:48 So we have the monthly demand given by the equation, pr, when d is equal to 0 is equal to 0 .2, and pr, when d is equal to 1 is equal to 0 .5, and pr, when d is equal to 2 is equal to 0 .3.

01:09 So we have to give the possible outcomes.

01:13 Part a, what is the state space of the process? part b, action sets, part c, one possible stationary policy, one possible stationary policy.

01:38 Part d, transition matrix.

01:47 Part e is the one period expected cost.

01:52 One period expected cost for the policy that we have provided.

02:02 So let's jump on to the solution of the question.

02:05 So part a, state space.

02:09 So how do we give the state space? state space would be given by, let us denote this by s, so is a set of space.

02:21 Is a set of states.

02:25 So this is going to be the sample space s is equal to storage cost is incurred.

02:30 So storage cost, comma, customers demand.

02:38 So this is my state space.

02:41 Part b, action sets...

Ace is your personal tutor. It breaks down any question with clear steps so you can learn.

Start Using Ace

Continue solving this problem

Create a free account to:

View full step-by-step solution
Ask follow-up questions with Ace AI
Save progress and study later