Determining of an Optimal Maintenance Policy for Three State Machine Replacement Problem Using Dynamic Programming

Document Type: Research Paper


Department of Industrial Engineering, Yazd University, Yazd, Iran


In this article, we present a sequential sampling plan for a three-state machine replacement problem using dynamic programming model. We consider an application of the Bayesian Inferences in a machine replacement problem. The machine was studied at different states of good, medium and bad. Discount dynamic programming (DDP) was applied to solve the three-state machine replacement problem, mainly to provide a policy for maintenance by considering item quality and to determine an optimal threshold policy for maintenance in the finite time horizon.  A decision tree based on the sequential sampling which included the decisions of renew, repair and do-nothing was implemented in order to achieve a threshold for making an optimized decision minimizing expected final cost. According to condition-based maintenance, where the point of defective item is placed in continuing sampling area, we decided to repair the machine or to continue sampling. A sensitivity analysis technique shows that the optimal policy can be very sensitive. 


Main Subjects

Aslam, M., Fallahnezhad, M.S. and Azam, M. (2013). Decision procedure for the weibull distribution based on run lengths of conforming items, Journal of Testing and Evaluation, Vol.41(5), pp. 826-832.

Aslam, M., Niaki, S., Rasool, M. and Fallahnezhad, M., (2012). Decision rule of repetitive acceptance sampling plans assuring percentile life, Scientia Iranica, Vol. 19(3), pp. 879-884.

Bowling, SR, Khasawneh, MT, Kaewkuekool, S, Cho, BR. (2004). A Markovian approach to determining optimum process target levels for a multi-stage serial production system, European Journal of Operational Research, Vol. 159, pp. 636–650.

Chun, Y.H. and Rinks, D.B., (1998). Three types of producer's and consumer's risks in the single sampling plan, Journal of Quality Technology, Vol. 30(3), pp.254-268.

Fallahnezhad,M. S., Niaki, S. T. A., Eshragh-Jahromi, (2007),A. A one-stage two machines replacement strategy based on the Bayesian inference method. Journal of Industrial and Systems Engineering, Vol. 1, pp. 235–250.

Fallahnezhad, M. S., Niaki, S. T. A. (2011). A multi-stage two-machine replacement strategy using mixture models, Bayesian inference and stochastic dynamic programming, Communications in Statistics - Theory and Methods, Vol. 40(4), pp.702–725.

Fallahnezhad, M.S.., Niaki, S.T.A. and Abooie M. H. (2011). A new acceptance sampling plan based on cumulative sums of conforming run-lengths, Journal of Industrial and systems engineering, Vol. 4(4), pp. 256-264.

Fallahnezhad, M.S. and Niaki, S.T.A. (2013). A new acceptance sampling policy based on number of successive conforming items, Communications in Statistics-Theory and Methods, Vol. 42(8), pp. 1542-1552.

Fallahnezhad, M.S. and Nasab, H.H. (2011). Designing a single stage acceptance sampling plan based on the control threshold policy, International Journal of Industrial Engineering, Vol. 22(3), pp. 143-150.

Fallahnezhad, M.S., Niaki, S. and Zad, M.V., (2012). A new acceptance sampling design using bayesian modeling and backwards induction, International Journal of Engineering-Transactions C: Aspects, Vol. 25(1), pp. 45-54.

Fallahnezhad, M.S., Aslam, M. (2013). A new economical design of acceptance sampling models using Bayesian inference, Accred Qual Assur, Vol. 18, pp. 187-195.

Goldstein, T., Ladany, S. P., Mehrez, A. (1988). A discounted machine replacement model with an expected future technological breakthrough, Naval Res. Logist. Quart, Vol. 35, pp. 209–220.

Honkela, T., Duch, W., Girolami, M., Kaski, S. (2011). Artificial Neural Networks and Machine Learning- ICANN, Proceedings of 21st International Conference on Artificial Neural Networks, Espoo, 21, pp. 14-17.

Ivy, J.S. and H.B. Nembhard, (2005). A modeling approach to maintenance decisions using statistical quality control and optimization. Quality and Reliability Engineering International, Vol. 21(4), pp. 355-366.

Kuo, Y. (2006). Optimal adaptive control policy for joint machine maintenance and product quality control, European Journal of Operational Research, Vol. 171, pp. 586–597.

Niaki, S.A. and Fallahnezhad, M. (2011). A new machine replacement policy based on number of defective items and Markov chains, Iranian Journal of Operations Research, Vol. 2 (2), pp. 17-28.

Niaki, S. T. A., Fallahnezhad, M. S. (2007). A decision making framework in production processes using Bayesian inference and stochastic dynamic programming. Journal of Applied Sciences, Vol. 7, pp. 3618–3627.

Niaki, A. and Fallahnezhad, (2012). A new markov chain based acceptance sampling policy via the minimum angle method, Iranian Journal of Operations Research, Vol. 3(1), pp. 104-111.

Niaki, S.A. and Fallahnezhad, M. (2009). Designing an optimum acceptance sampling plan using bayesian inferences and a stochastic dynamic programming approach, Scientia Iranica Transaction E-Industrial Engineering, Vol. 16(1), pp. 19-25.

Raiffa, H., Schlaifer, R., (2000). Applied statistical decision theory, New York: Wiley Classical Library.

Sethi, S. P., Suo, W., Taksar, M. I., Zhang, Q. (1997). Optimal production planning in a stochastic manufacturing system with long-run average cost. Journal of Optimization Theory and Applications, Vol. 92, pp. 161–188.

Tagaras, G. (1988). Integrated cost model for the joint optimization of process control and maintenance, Journal of Operational Research Society, Vol. 39, pp. 757–766.