Markov Decision Process (MDP) Algorithm

Simple grid world Value Iteration for MDP algorithm

You are now following this Submission

This code is an implementation for the MDP algorithm. It is simple grid world Value Iteration. It provides a graphical representation of the value and policy of each cell and also it draws the final path from the start cell to the end cell.
It was originally a java code. I found it in
https://galweejit.wordpress.com/2010/12/16/ai-class-implementation-of-mdp-grid-world-from-week-5-unit-9/
and I converted it to Matlab version as my homework for Visualization course in my Master degree.

You can email me if u have any question about the code in:
toma2u@hotmail.com

Cite As

Fatuma Shifa (2026). Markov Decision Process (MDP) Algorithm (https://in.mathworks.com/matlabcentral/fileexchange/55943-markov-decision-process-mdp-algorithm), MATLAB Central File Exchange. Retrieved .

Acknowledgements

Inspired by: MDP robot grid-world example

General Information

MATLAB Release Compatibility

  • Compatible with any release

Platform Compatibility

  • Windows
  • macOS
  • Linux
Version Published Release Notes Action
2.0.0.0

I only added a figure to represent the result of the code

1.0.0.0