Predictive maintenance is based on observing an indicator of the state of a system, at different intervals of time which gives the decision maker some information about the exact state. The problem is to obtain an optimal replacement policy minimizing the long run expected cost per unit of time and to formulate it as a partially observable Markov decision process.