Toby Jia-Jun Li

1.8k total citations · 1 hit paper
64 papers, 722 citations indexed

About

Toby Jia-Jun Li is a scholar working on Artificial Intelligence, Information Systems and Human-Computer Interaction. According to data from OpenAlex, Toby Jia-Jun Li has authored 64 papers receiving a total of 722 indexed citations (citations by other indexed papers that have themselves been cited), including 32 papers in Artificial Intelligence, 18 papers in Information Systems and 14 papers in Human-Computer Interaction. Recurrent topics in Toby Jia-Jun Li's work include Topic Modeling (17 papers), Software Engineering Research (10 papers) and Speech and dialogue systems (9 papers). Toby Jia-Jun Li is often cited by papers focused on Topic Modeling (17 papers), Software Engineering Research (10 papers) and Speech and dialogue systems (9 papers). Toby Jia-Jun Li collaborates with scholars based in United States, China and United Kingdom. Toby Jia-Jun Li's co-authors include Brad A. Myers, Amos Azaria, Zheng Zhang, Oriana Riva, Haijun Xia, Daniel Ritchie, Ying Xu, Bingsheng Yao, Dakuo Wang and Tongshuang Wu and has published in prestigious journals such as IEEE Transactions on Software Engineering, Journal of Systems and Software and ACM Transactions on Software Engineering and Methodology.

In The Last Decade

Toby Jia-Jun Li

53 papers receiving 710 citations

Hit Papers

Limitations of the LLM-as-a-Judge Approach for Evaluating... 2025 2026 2025 5 10 15
What are hit papers?

Hit papers significantly outperform the citation benchmark for their cohort. A paper qualifies if it has ≥500 total citations, achieves ≥1.5× the top-1% citation threshold for papers in the same subfield and year (this is the minimum needed to enter the top 1%, not the average within it), or reaches the top citation threshold in at least one of its specific research topics.

  1. Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Tasks
    2025 17 citations Heather A. Eicher‐Miller, Toby Jia-Jun Li et al. profile →

Peers — A (Enhanced Table)

Peers by citation overlap · career bar shows stage (early→late) cites · hero ref

Name h Career Trend Papers Cites
Toby Jia-Jun Li United States 16 319 150 141 134 82 64 722
Tongshuang Wu United States 17 608 1.9× 133 0.9× 83 0.6× 208 1.6× 55 0.7× 48 971
Frank Hopfgartner United Kingdom 15 263 0.8× 283 1.9× 95 0.7× 365 2.7× 149 1.8× 108 954
Cristina Gena Italy 16 214 0.7× 293 2.0× 123 0.9× 210 1.6× 119 1.5× 98 776
Erik Andersen United States 18 402 1.3× 159 1.1× 163 1.2× 190 1.4× 206 2.5× 34 963
Jofish Kaye United States 13 258 0.8× 92 0.6× 219 1.6× 38 0.3× 176 2.1× 37 653
Justin D. Weisz United States 13 397 1.2× 137 0.9× 122 0.9× 102 0.8× 134 1.6× 37 856
Olga De Troyer Belgium 16 339 1.1× 360 2.4× 204 1.4× 146 1.1× 155 1.9× 107 987
Pratyush Kumar India 12 613 1.9× 94 0.6× 132 0.9× 139 1.0× 85 1.0× 41 875
Malin Eiband Germany 12 256 0.8× 174 1.2× 194 1.4× 48 0.4× 106 1.3× 21 656
Renata Pontin de Mattos Fortes Brazil 18 381 1.2× 464 3.1× 266 1.9× 55 0.4× 74 0.9× 135 1.2k

Countries citing papers authored by Toby Jia-Jun Li

Since Specialization
Citations

This map shows the geographic impact of Toby Jia-Jun Li's research. It shows the number of citations coming from papers published by authors working in each country. You can also color the map by specialization and compare the number of citations received by Toby Jia-Jun Li with the expected number of citations based on a country's size and research output (numbers larger than one mean the country cites Toby Jia-Jun Li more than expected).

Fields of papers citing papers by Toby Jia-Jun Li

Since Specialization
Physical SciencesHealth SciencesLife SciencesSocial Sciences

This network shows the impact of papers produced by Toby Jia-Jun Li. Nodes represent research fields, and links connect fields that are likely to share authors. Colored nodes show fields that tend to cite the papers produced by Toby Jia-Jun Li. The network helps show where Toby Jia-Jun Li may publish in the future.

Co-authorship network of co-authors of Toby Jia-Jun Li

This figure shows the co-authorship network connecting the top 25 collaborators of Toby Jia-Jun Li. A scholar is included among the top collaborators of Toby Jia-Jun Li based on the total number of citations received by their joint publications. Widths of edges represent the number of papers authors have co-authored together. Node borders signify the number of papers an author published with Toby Jia-Jun Li. Toby Jia-Jun Li is excluded from the visualization to improve readability, since they are connected to all nodes in the network.

All Works

20 of 20 papers shown
1.
2.
3.
Eicher‐Miller, Heather A., et al.. (2025). Limitations of the LLM-as-a-Judge Approach for Evaluating LLM Outputs in Expert Knowledge Tasks. 952–966. 17 indexed citations breakdown →
4.
Huang, Yu, et al.. (2025). Context-aware code summary generation. Journal of Systems and Software. 231. 112580–112580. 1 indexed citations
5.
Huang, Yu, et al.. (2025). Programmer Visual Attention During Context-Aware Code Summarization. IEEE Transactions on Software Engineering. 51(5). 1524–1537. 1 indexed citations
6.
Chiang, Charles, et al.. (2025). MetricMate: An Interactive Tool for Generating Evaluation Criteria for LLM-as-a-Judge Workflow. 1–18. 2 indexed citations
7.
8.
9.
Li, Toby Jia-Jun, et al.. (2025). Iterative Contextual Consent: AI-enabled Data Privacy Contracts. 84–91.
10.
11.
Zhang, Zheng, et al.. (2024). MIMOSA: Human-AI Co-Creation of Computational Spatial Audio Effects on Videos. Creativity and Cognition. 156–169. 4 indexed citations
12.
Zhang, Chao, et al.. (2024). From Awareness to Action: Exploring End-User Empowerment Interventions for Dark Patterns in UX. Proceedings of the ACM on Human-Computer Interaction. 8(CSCW1). 1–41. 6 indexed citations
13.
14.
15.
Li, Toby Jia-Jun, et al.. (2024). CoCo Matrix: Taxonomy of Cognitive Contributions in Co-writing with Intelligent Agents. Creativity and Cognition. 504–511. 1 indexed citations
16.
Li, Toby Jia-Jun, et al.. (2024). EyeTrans: Merging Human and Machine Attention for Neural Code Summarization. Proceedings of the ACM on software engineering.. 1(FSE). 115–136. 5 indexed citations
17.
Li, Toby Jia-Jun, et al.. (2024). Sketchar: Supporting Character Design and Illustration Prototyping Using Generative AI. Proceedings of the ACM on Human-Computer Interaction. 8(CHI PLAY). 1–28. 11 indexed citations
18.
Li, Toby Jia-Jun, et al.. (2024). A Tale of Two Comprehensions? Analyzing Student Programmer Attention during Code Summarization. ACM Transactions on Software Engineering and Methodology. 33(7). 1–37. 1 indexed citations
19.
Li, Toby Jia-Jun, Tom M. Mitchell, & Brad A. Myers. (2020). Interactive Task Learning from GUI-Grounded Natural Language Instructions and Demonstrations. 215–223. 10 indexed citations
20.
Li, Toby Jia-Jun, et al.. (2019). Interactive Task and Concept Learning from Natural Language Instructions and GUI Demonstrations. arXiv (Cornell University). 1 indexed citations

Rankless uses publication and citation data sourced from OpenAlex, an open and comprehensive bibliographic database. While OpenAlex provides broad and valuable coverage of the global research landscape, it—like all bibliographic datasets—has inherent limitations. These include incomplete records, variations in author disambiguation, differences in journal indexing, and delays in data updates. As a result, some metrics and network relationships displayed in Rankless may not fully capture the entirety of a scholar's output or impact.

Explore authors with similar magnitude of impact

Breakdown of academic impact, for papers by Tongshuang Wu Breakdown of academic impact, for papers by Frank Hopfgartner Breakdown of academic impact, for papers by Cristina Gena Breakdown of academic impact, for papers by Erik Andersen Breakdown of academic impact, for papers by Jofish Kaye Breakdown of academic impact, for papers by Justin D. Weisz Breakdown of academic impact, for papers by Olga De Troyer Breakdown of academic impact, for papers by Pratyush Kumar Breakdown of academic impact, for papers by Malin Eiband Breakdown of academic impact, for papers by Renata Pontin de Mattos Fortes
Rankless by CCL
2026