Markov Decision Processes: Discrete Stochastic Dynamic Programming

Laurence A. Baxter; Martin L. Puterman

doi:https://doi.org/10.2307/1269932

Markov Decision Processes: Discrete Stochastic Dynamic Programming

1995 · Technometrics · 1,898 citations · 3 from inside this corpus

Laurence A. Baxter low, Martin L. Puterman

The source holds an abstract for this work, but its best open-access copy is under no open licence, which does not permit us to republish the text. Read it at the source below.

3 of 3 neighbouring works in this corpus. Blue is what this paper cites; orange is what cites it, and a dashed line is one neighbour citing another. Only the largest labels are drawn — every node carries its full title on hover.

this paper works it cites works citing it node size = global citations · hover for the full title

Citation edge evidence

Each row is directed from the citing work to the cited work. Source status remains readable without the interactive graph.

Reinforcement Learning: A Survey→Markov Decision Processes: Discrete Stochastic Dynamic ProgrammingLegacy edge — source detail unavailable
Machine Learning: Algorithms, Real-World Applications and Research Directions→Markov Decision Processes: Discrete Stochastic Dynamic ProgrammingLegacy edge — source detail unavailable
Mastering Atari, Go, chess and shogi by planning with a learned model→Markov Decision Processes: Discrete Stochastic Dynamic ProgrammingLegacy edge — source detail unavailable
Machine Learning: Algorithms, Real-World Applications and Research Directions→Reinforcement Learning: A SurveyLegacy edge — source detail unavailable

What cites it, inside the corpus

Paper	Year	Cited
Reinforcement Learning: A Survey	1996	8,953
Machine Learning: Algorithms, Real-World Applications and Research Directions	2021	5,368
Mastering Atari, Go, chess and shogi by planning with a learned model		1,374

Links

Download BibTeX · Download RIS · DOI · OpenAlex record

Topics

Reinforcement Learning in Robotics	Computer Science
Auction Theory and Applications	Decision Sciences

Is this record sound?

partial

One field of this record is missing or disagrees with another. What is shown below is what the source publishes.

supports2 author record(s) attached.
weakensNo references are recorded despite 1,898 citations. A paper this heavily cited did not cite nothing, so the record is incomplete.
neutralThe DOI carries no year to check against.
supportsA title is present.

Provenance

Everything above was read from one stored OpenAlex payload, fetched 2026-09-04T03:58:52+00:00.

sha256 930f5bc64fea8a60…