Policy Gradient Methods for Reinforcement Learning with Function Approximation

Richard S. Sutton; David McAllester; Satinder Singh; Yishay Mansour

Policy Gradient Methods for Reinforcement Learning with Function Approximation

1999 · 4,966 citations · 11 from inside this corpus

Richard S. Sutton, David McAllester low, Satinder Singh, Yishay Mansour

The source holds an abstract for this work, but its best open-access copy is under no open licence, which does not permit us to republish the text. Read it at the source below.

15 of 15 neighbouring works in this corpus. Blue is what this paper cites; orange is what cites it, and a dashed line is one neighbour citing another. Only the largest labels are drawn — every node carries its full title on hover.

this paper works it cites works citing it node size = global citations · hover for the full title

Citation edge evidence

Each row is directed from the citing work to the cited work. Source status remains readable without the interactive graph.

Deep learning in neural networks: An overview→Policy Gradient Methods for Reinforcement Learning with Function ApproximationLegacy edge — source detail unavailable
Mastering the game of Go with deep neural networks and tree search→Policy Gradient Methods for Reinforcement Learning with Function ApproximationLegacy edge — source detail unavailable
Reinforcement learning in robotics: A survey→Policy Gradient Methods for Reinforcement Learning with Function ApproximationLegacy edge — source detail unavailable
Actor-critic algorithms→Policy Gradient Methods for Reinforcement Learning with Function ApproximationLegacy edge — source detail unavailable
Dueling Network Architectures for Deep Reinforcement Learning→Policy Gradient Methods for Reinforcement Learning with Function ApproximationLegacy edge — source detail unavailable
High-Dimensional Continuous Control Using Generalized Advantage Estimation→Policy Gradient Methods for Reinforcement Learning with Function ApproximationLegacy edge — source detail unavailable
Deterministic Policy Gradient Algorithms→Policy Gradient Methods for Reinforcement Learning with Function ApproximationLegacy edge — source detail unavailable
Counterfactual Multi-Agent Policy Gradients→Policy Gradient Methods for Reinforcement Learning with Function ApproximationLegacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→Policy Gradient Methods for Reinforcement Learning with Function ApproximationLegacy edge — source detail unavailable
Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates→Policy Gradient Methods for Reinforcement Learning with Function ApproximationLegacy edge — source detail unavailable
Hybrid computing using a neural network with dynamic external memory→Policy Gradient Methods for Reinforcement Learning with Function ApproximationLegacy edge — source detail unavailable
Policy Gradient Methods for Reinforcement Learning with Function Approximation→Reinforcement Learning: An IntroductionLegacy edge — source detail unavailable
Policy Gradient Methods for Reinforcement Learning with Function Approximation→Simple statistical gradient-following algorithms for connectionist reinforcement learningLegacy edge — source detail unavailable
Policy Gradient Methods for Reinforcement Learning with Function Approximation→Introduction to Reinforcement LearningLegacy edge — source detail unavailable
Policy Gradient Methods for Reinforcement Learning with Function Approximation→Actor-critic algorithmsLegacy edge — source detail unavailable
High-Dimensional Continuous Control Using Generalized Advantage Estimation→Introduction to Reinforcement LearningLegacy edge — source detail unavailable
High-Dimensional Continuous Control Using Generalized Advantage Estimation→Simple statistical gradient-following algorithms for connectionist reinforcement learningLegacy edge — source detail unavailable
Reinforcement learning in robotics: A survey→Introduction to Reinforcement LearningLegacy edge — source detail unavailable
Reinforcement learning in robotics: A survey→Simple statistical gradient-following algorithms for connectionist reinforcement learningLegacy edge — source detail unavailable
Deep learning in neural networks: An overview→Introduction to Reinforcement LearningLegacy edge — source detail unavailable
Deep learning in neural networks: An overview→Simple statistical gradient-following algorithms for connectionist reinforcement learningLegacy edge — source detail unavailable
Deep learning in neural networks: An overview→Reinforcement Learning: An IntroductionLegacy edge — source detail unavailable
Actor-critic algorithms→Simple statistical gradient-following algorithms for connectionist reinforcement learningLegacy edge — source detail unavailable
Actor-critic algorithms→Reinforcement Learning: An IntroductionLegacy edge — source detail unavailable
Deterministic Policy Gradient Algorithms→Introduction to Reinforcement LearningLegacy edge — source detail unavailable
Deterministic Policy Gradient Algorithms→Simple statistical gradient-following algorithms for connectionist reinforcement learningLegacy edge — source detail unavailable
Deterministic Policy Gradient Algorithms→Reinforcement Learning: An IntroductionLegacy edge — source detail unavailable
Dueling Network Architectures for Deep Reinforcement Learning→Introduction to Reinforcement LearningLegacy edge — source detail unavailable
Dueling Network Architectures for Deep Reinforcement Learning→Mastering the game of Go with deep neural networks and tree searchLegacy edge — source detail unavailable
Mastering the game of Go with deep neural networks and tree search→Simple statistical gradient-following algorithms for connectionist reinforcement learningLegacy edge — source detail unavailable
Mastering the game of Go with deep neural networks and tree search→Reinforcement Learning: An IntroductionLegacy edge — source detail unavailable
Hybrid computing using a neural network with dynamic external memory→Simple statistical gradient-following algorithms for connectionist reinforcement learningLegacy edge — source detail unavailable
Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates→Reinforcement learning in robotics: A surveyLegacy edge — source detail unavailable
Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates→Simple statistical gradient-following algorithms for connectionist reinforcement learningLegacy edge — source detail unavailable
Counterfactual Multi-Agent Policy Gradients→High-Dimensional Continuous Control Using Generalized Advantage EstimationLegacy edge — source detail unavailable
Counterfactual Multi-Agent Policy Gradients→Simple statistical gradient-following algorithms for connectionist reinforcement learningLegacy edge — source detail unavailable
Counterfactual Multi-Agent Policy Gradients→Actor-critic algorithmsLegacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→High-Dimensional Continuous Control Using Generalized Advantage EstimationLegacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→Mastering the game of Go with deep neural networks and tree searchLegacy edge — source detail unavailable

What this paper cites, inside the corpus

Paper	Year	Cited
Reinforcement Learning: An Introduction	2005	25,758
Simple statistical gradient-following algorithms for connectionist reinforcement learning	1992	7,519
Introduction to Reinforcement Learning	1998	6,917
Actor-critic algorithms	2002	1,818

What cites it, inside the corpus

Paper	Year	Cited
Deep learning in neural networks: An overview	2014	18,236
Mastering the game of Go with deep neural networks and tree search	2016	16,014
Reinforcement learning in robotics: A survey	2013	3,154
Actor-critic algorithms	2002	1,818
Dueling Network Architectures for Deep Reinforcement Learning	2015	1,811
High-Dimensional Continuous Control Using Generalized Advantage Estimation	2015	1,746
Deterministic Policy Gradient Algorithms	2014	1,736
Counterfactual Multi-Agent Policy Gradients	2018	1,727
Deep Reinforcement Learning That Matters	2018	1,580
Deep reinforcement learning for robotic manipulation with asynchronous off-policy updates	2017	1,468
Hybrid computing using a neural network with dynamic external memory	2016	1,448

Links

Download BibTeX · Download RIS · OpenAlex record

Topics

Reinforcement Learning in Robotics	Computer Science
Electric Vehicles and Infrastructure	Engineering
Adaptive Dynamic Programming Control	Computer Science

Is this record sound?

complete

Nothing in this record contradicts itself and no field we check is missing.

supports4 author record(s) attached.
supports18 reference(s) recorded.
neutralThe DOI carries no year to check against.
supportsA title is present.

Provenance

Everything above was read from one stored OpenAlex payload, fetched 2026-09-04T03:58:44+00:00.

sha256 648f8491aaceaa34…