Deep Reinforcement Learning That Matters

Peter Henderson; Riashat Islam; Philip Bachman; Joëlle Pineau; Doina Precup; David Meger

doi:https://doi.org/10.1609/aaai.v32i1.11694

Deep Reinforcement Learning That Matters

2018 · Proceedings of the AAAI Conference on Artificial Intelligence · 1,580 citations · 3 from inside this corpus

Peter Henderson, Riashat Islam low, Philip Bachman low, Joëlle Pineau, Doina Precup, David Meger

The source holds an abstract for this work, but its best open-access copy is under no open licence, which does not permit us to republish the text. Read it at the source below.

16 of 16 neighbouring works in this corpus. Blue is what this paper cites; orange is what cites it, and a dashed line is one neighbour citing another. Only the largest labels are drawn — every node carries its full title on hover.

this paper works it cites works citing it node size = global citations · hover for the full title

Citation edge evidence

Each row is directed from the citing work to the cited work. Source status remains readable without the interactive graph.

Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochast…→Deep Reinforcement Learning That MattersLegacy edge — source detail unavailable
Addressing Function Approximation Error in Actor-Critic Methods→Deep Reinforcement Learning That MattersLegacy edge — source detail unavailable
Soft Actor-Critic Algorithms and Applications→Deep Reinforcement Learning That MattersLegacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→Mastering the game of Go with deep neural networks and tree searchLegacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→Understanding the difficulty of training deep feedforward neural networksLegacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→Diagnosing Non-Intermittent Anomalies in Reinforcement Learning Policy Executions (Short …Legacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model SelectionLegacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→Continuous control with deep reinforcement learningLegacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→Continuous control with deep reinforcement learningLegacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→Playing Atari with Deep Reinforcement LearningLegacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→Policy Gradient Methods for Reinforcement Learning with Function ApproximationLegacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→An Introduction to the Bootstrap.Legacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→Trust Region Policy OptimizationLegacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→An Introduction to the BootstrapLegacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→High-Dimensional Continuous Control Using Generalized Advantage EstimationLegacy edge — source detail unavailable
Deep Reinforcement Learning That Matters→Asynchronous Methods for Deep Reinforcement LearningLegacy edge — source detail unavailable
High-Dimensional Continuous Control Using Generalized Advantage Estimation→Policy Gradient Methods for Reinforcement Learning with Function ApproximationLegacy edge — source detail unavailable
High-Dimensional Continuous Control Using Generalized Advantage Estimation→Continuous control with deep reinforcement learningLegacy edge — source detail unavailable
Trust Region Policy Optimization→Playing Atari with Deep Reinforcement LearningLegacy edge — source detail unavailable
Continuous control with deep reinforcement learning→Playing Atari with Deep Reinforcement LearningLegacy edge — source detail unavailable
Mastering the game of Go with deep neural networks and tree search→Policy Gradient Methods for Reinforcement Learning with Function ApproximationLegacy edge — source detail unavailable
Asynchronous Methods for Deep Reinforcement Learning→High-Dimensional Continuous Control Using Generalized Advantage EstimationLegacy edge — source detail unavailable
Asynchronous Methods for Deep Reinforcement Learning→Playing Atari with Deep Reinforcement LearningLegacy edge — source detail unavailable
Asynchronous Methods for Deep Reinforcement Learning→Continuous control with deep reinforcement learningLegacy edge — source detail unavailable
Diagnosing Non-Intermittent Anomalies in Reinforcement Learning Policy Executions (Short …→High-Dimensional Continuous Control Using Generalized Advantage EstimationLegacy edge — source detail unavailable
Diagnosing Non-Intermittent Anomalies in Reinforcement Learning Policy Executions (Short …→Trust Region Policy OptimizationLegacy edge — source detail unavailable
Diagnosing Non-Intermittent Anomalies in Reinforcement Learning Policy Executions (Short …→Asynchronous Methods for Deep Reinforcement LearningLegacy edge — source detail unavailable
Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochast…→Playing Atari with Deep Reinforcement LearningLegacy edge — source detail unavailable
Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochast…→Continuous control with deep reinforcement learningLegacy edge — source detail unavailable
Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochast…→Mastering the game of Go with deep neural networks and tree searchLegacy edge — source detail unavailable
Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochast…→Diagnosing Non-Intermittent Anomalies in Reinforcement Learning Policy Executions (Short …Legacy edge — source detail unavailable
Addressing Function Approximation Error in Actor-Critic Methods→Trust Region Policy OptimizationLegacy edge — source detail unavailable
Addressing Function Approximation Error in Actor-Critic Methods→Continuous control with deep reinforcement learningLegacy edge — source detail unavailable
Addressing Function Approximation Error in Actor-Critic Methods→Diagnosing Non-Intermittent Anomalies in Reinforcement Learning Policy Executions (Short …Legacy edge — source detail unavailable
Addressing Function Approximation Error in Actor-Critic Methods→Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochast…Legacy edge — source detail unavailable
Soft Actor-Critic Algorithms and Applications→Playing Atari with Deep Reinforcement LearningLegacy edge — source detail unavailable
Soft Actor-Critic Algorithms and Applications→Trust Region Policy OptimizationLegacy edge — source detail unavailable
Soft Actor-Critic Algorithms and Applications→Continuous control with deep reinforcement learningLegacy edge — source detail unavailable
Soft Actor-Critic Algorithms and Applications→Mastering the game of Go with deep neural networks and tree searchLegacy edge — source detail unavailable
Soft Actor-Critic Algorithms and Applications→Diagnosing Non-Intermittent Anomalies in Reinforcement Learning Policy Executions (Short …Legacy edge — source detail unavailable
Soft Actor-Critic Algorithms and Applications→Addressing Function Approximation Error in Actor-Critic MethodsLegacy edge — source detail unavailable
Continuous control with deep reinforcement learning→Playing Atari with Deep Reinforcement LearningLegacy edge — source detail unavailable

What this paper cites, inside the corpus

Paper	Year	Cited
Mastering the game of Go with deep neural networks and tree search	2016	16,014
Understanding the difficulty of training deep feedforward neural networks	2010	12,673
Diagnosing Non-Intermittent Anomalies in Reinforcement Learning Policy Executions (Short …	2017	11,354
A Study of Cross-Validation and Bootstrap for Accuracy Estimation and Model Selection	1995	10,743
Continuous control with deep reinforcement learning	2016	6,783
Continuous control with deep reinforcement learning	2015	5,370
Playing Atari with Deep Reinforcement Learning	2013	5,104
Policy Gradient Methods for Reinforcement Learning with Function Approximation	1999	4,966
An Introduction to the Bootstrap.	1994	3,241
Trust Region Policy Optimization	2015	3,129
An Introduction to the Bootstrap	1995	2,240
High-Dimensional Continuous Control Using Generalized Advantage Estimation	2015	1,746
Asynchronous Methods for Deep Reinforcement Learning	2016	1,689

What cites it, inside the corpus

Paper	Year	Cited
Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochast…	2018	3,500
Addressing Function Approximation Error in Actor-Critic Methods	2018	2,372
Soft Actor-Critic Algorithms and Applications	2018	1,994

Links

Download BibTeX · Download RIS · DOI · Open access copy · OpenAlex record

Topics

Reinforcement Learning in Robotics	Computer Science
Evolutionary Algorithms and Applications	Computer Science
Viral Infectious Diseases and Gene Expression in Insects	Biochemistry, Genetics and Molecular Biology

Is this record sound?

complete

Nothing in this record contradicts itself and no field we check is missing.

supports6 author record(s) attached.
supports60 reference(s) recorded.
neutralThe DOI carries no year to check against.
supportsA title is present.

Provenance

Everything above was read from one stored OpenAlex payload, fetched 2026-09-04T03:58:57+00:00.

sha256 b3024609427ad450…