Applying Characteristics of Human Reasoning to Zero-shot Reasoning in GPT Models
Summary
This work builds upon an analogy between human and artificial reasoning. Large Transformer based language models have achieved state-of-the-art in many tasks, and recently have even been able to do this without requiring task specific fine-tuning, by deploying either in-context or zero-shot learning. However, reasoning remains to be a difficult task for these models, especially in a zero-shot setting. On the contrary, humans are good at reasoning without being explicitly trained for it like models are, hinting that properties of human reasoning might be of help to boost the performance of models. We explore this intuition in two ways: (1) using human-like linguistic input for fine-tuning and (2) prompting models to ``imagine", a technique that has shown to help humans reason better. Our results show that our approach was fruitful for reasoning about fantastical scenarios, which is in line with previous research on humans, confirming that making an analogy between human and artificial reasoning can be helpful. This research opens many doors for future research on zero-shot reasoning, also using smaller models, which is a desirable development towards human-like general intelligence.
Collections
Related items
Showing items related by title, author, creator and subject.
-
Do children need to give less reason to get their will when they have the power anyway? – The moderating roles of culture and age on the relationship of power and reason-giving
Peters, Jule (2024)Social conflicts are part of societies and groups. While social animals, might resolve them using power and dominance, Humans evolved an alternative strategy characterised by debating, arguing, and reasoning. It functions ... -
Validation of the Dutch version of the Nurses Clinical Reasoning Scale to evaluate nurses’ perception of clinical reasoning competence
Janssen, B. (2021)Background: Clinical reasoning is the fundamental base of clinical practice. It guides nurses in gathering, assessing, interpreting information, and generating hypotheses. Clinical reasoning is of significant importance ... -
Combining A Fortiori Reasoning and a Similarity Measure in Case-Based Reasoning
Nouwens, Joep (2024)Over the last years, case-based reasoning has shown to be a promising AI-method in the legal domain, in which a fortiori reasoning is utilized to find similar cases from the past. However, this approach limits the decision ...