Problem Solving Is Often a Matter of Cooking Up an Appropriate Markov Chain