profile_picture
Leonardo Bertolazzi
Ph.D., University of Trento
leonardo.bertolazzi@unitn.it

Ciao, I’m Leonardo! I’m a PhD student in Information Engineering and Computer Science at University of Trento, supervised by Prof. Raffaella Bernardi.

My research interests lie at the intersection of Cognitive Science and AI, with a focus on the deductive reasoning capabilities of Large Language Models (LLMs).

During my PhD, I aim to explore questions such as:

  1. LLM Reasoning Processes: How do LLMs handle basic deductive tasks? What algorithms are they using, and how do these compare to human cognitive processes?

  2. Studying LLMs through Cognitive Psychology: Cognitive psychologists have historically used behavioral methods to study human reasoning, even before brain data was accessible. Can we apply similar approaches to better understand the strengths and weaknesses of LLMs?

  3. Comparative Cognition: While humans and LLMs learn and process information differently, can they develop similar biases? On the flip side, what biases are unique to each system?

If you have any questions about my research or if you’re interested in collaborating, feel free to reach out!

Interests

  • Language Models
  • Reasoning
  • Natural Language Processing
  • Cognitive Science
  • Cognitive Modeling

Academia

University of Trento
2023 - present
Ph.D. Information Engineering and Computer Science
University of Trento
2021 - 2023
M.Sc. Cognitive Science
University of Trento
2019 - 2021
B.A. Philosophy

News

Recent Publications

see my google scholar for the latest list
LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks, 2024, arXiv preprint
Anna Bavaresco , Raffaella Bernardi , Leonardo Bertolazzi , Desmond Elliott , Raquel Fernández , Albert Gatt , Esam Ghaleb , Mario Giulianelli , Michael Hanna , Alexander Koller , André F. T. Martins , Philipp Mondorf , Vera Neplenbroek , Sandro Pezzelle , Barbara Plank , David Schlangen , Alessandro Suglia , Aditya K Surikuchi , Ece Takmaz , Alberto Testoni
A Systematic Analysis of Large Language Models as Soft Reasoners: The Case of Syllogistic Inferences, 2024, The 2024 Conference on Empirical Methods in Natural Language Processing
Leonardo Bertolazzi , Albert Gatt , Raffaella Bernardi
ChatGPT’s Information Seeking Strategy: Insights from the 20-Questions Game, 2023, Proceedings of the 16th International Natural Language Generation Conference
Leonardo Bertolazzi , Davide Mazzaccara , Filippo Merlo , Raffaella Bernardi