Satinder Singh

22.5k citations
150 papers · 11.2k indexed · 5 hit papers · h-index 40

Satinder Singh

140 papers receiving 10.3k citations

Hit Papers

Reward is en...219199520262005201550010001.5k2.0k2.5k

Peers

Satinder Singh
Comparison fields: 5 of 192
  • Artificial Intelligence 7.5k
  • Management Science and Operations Research 1.5k
  • Computational Theory and Mathematics 1.4k
  • Control and Systems Engineering 1.8k
  • Computer Vision and Pattern Recognition 1.3k
Replace Christopher J. Watkins with:
Christopher J. Watkins United Kingdom
Leslie Pack Kaelbling United States
Jeffrey D. Johnson United States
Peter Stone United States
Doina Precup Canada
Benjamin Kuipers United States
Andreas Fidjeland United Kingdom
Randall Davis United States
Andy Barto
Manuela Veloso United States
Satinder Singh relative to Christopher J. Watkins United Kingdom Christopher J. Watkins's profile →
Citations per field
00.5×1.5×1.8×
Christopher J. Watkins · 1×
Citations per year

Countries citing papers authored by Satinder Singh

Since Specialization
Citations

This map shows the geographic impact of Satinder Singh's research. It shows the number of citations coming from papers published by authors working in each country. You can also color the map by specialization and compare the number of citations received by Satinder Singh with the expected number of citations based on a country's size and research output (numbers larger than one mean the country cites Satinder Singh more than expected).

Fields of papers citing papers by Satinder Singh

Since Specialization
Physical SciencesHealth SciencesLife SciencesSocial Sciences

This network shows the impact of papers produced by Satinder Singh. Nodes represent research fields, and links connect fields that are likely to share authors. Colored nodes show fields that tend to cite the papers produced by Satinder Singh. The network helps show where Satinder Singh may publish in the future.

Co-authorship network

The 25 scholars most cited alongside Satinder Singh, linked wherever they have co-authored with each other. Click a name or a connecting line to browse the papers they share.

Border = papers with Satinder Singh Line = papers co-authored together Satinder Singh links everyone, so they are left out of the graph.

All Works

20 of 20 papers shown
#Work
1 20250
2 20241
3
A Self-Tuning Actor-Critic Algorithm
20202
4
Meta-Gradient Reinforcement Learning with an Objective Discovered Online
20202
5
Commitment semantics for sequential decision making under reward uncertainty
20166
6 20150
7
Abstraction Selection in Model-based Reinforcement Learning
201515
8
Reward Mapping for Transfer in Long-Lived Agents
20132
9
Variance-based rewards for approximate Bayesian reinforcement learning
201015
10
Where Do Rewards Come From
200962
11
Building incomplete but accurate models
20083
12
Relational knowledge with predictive state representations
20077
13
Off-policy Learning with Options and Recognizers
20055
14
Reinforcement learning of hierarchical skills on the sony aibo robot
200513
15 20022
16
Empirical Evaluation of a Reinforcement Learning Spoken Dialogue System
200029
17
Eligibility Traces for Off-Policy Policy Evaluation
2000172
18
Cobot in LambdaMOO: A Social Statistics Agent
200041
19
Experimental Results on Learning Stochastic Memoryless Policies for Partially Observable Markov Decision Processes
19986
20
Reinforcement Learning with Soft State Aggregation
1994149

About Satinder Singh

Satinder Singh is a scholar working on Artificial Intelligence, Management Science and Operations Research and Complementary and Manual Therapy, having authored 150 papers that have together received 11.2k indexed citations. Recurring topics across this work include Reinforcement Learning in Robotics (75 papers), Machine Learning and Algorithms (20 papers), Evolutionary Algorithms and Applications (16 papers), Advanced Bandit Algorithms Research (15 papers), Auction Theory and Applications (11 papers), Bayesian Modeling and Causal Inference (11 papers), Speech and dialogue systems (10 papers) and Topic Modeling (7 papers). The work is most often cited by research in Artificial Intelligence (7.5k citations), Management Science and Operations Research (1.5k citations) and Computational Theory and Mathematics (1.4k citations). Satinder Singh has collaborated with scholars based in United States, India and United Kingdom. Frequent co-authors include Richard S. Sutton, Doina Precup, Yishay Mansour, David McAllester, Michael Kearns, Andrew G. Barto, Tommi Jaakkola, Michael I. Jordan, Steven J. Bradtke and Richard L. Lewis. Their work appears in journals such as Machine Learning, Artificial Intelligence, Topics in Cognitive Science, Journal of Artificial Intelligence Research and Folia Phoniatrica et Logopaedica.

Rankless uses publication and citation data sourced from OpenAlex, an open and comprehensive bibliographic database. While OpenAlex provides broad and valuable coverage of the global research landscape, it—like all bibliographic datasets—has inherent limitations. These include incomplete records, variations in author disambiguation, differences in journal indexing, and delays in data updates. As a result, some metrics and network relationships displayed in Rankless may not fully capture the entirety of a scholar's output or impact.

Explore authors with similar magnitude of impact

Rankless by CCL
2026