How Does Cognitive Capability and Personality Influence Problem-Solving in Coding Interview Puzzles?
- URL: http://arxiv.org/abs/2511.14367v1
- Date: Tue, 18 Nov 2025 11:13:36 GMT
- Title: How Does Cognitive Capability and Personality Influence Problem-Solving in Coding Interview Puzzles?
- Authors: Dulaji Hidellaarachchi, Sebastian Baltes, John Grundy,
- Abstract summary: This study investigates how cognitive capability and personality traits jointly relate to software problem solving among 80 participants.<n>Grammatical-reasoning accuracy correlated positively with problem solving performance.<n>Neuroticism showed small, negative associations with accuracy and performance.
- Score: 5.017321567986849
- License: http://creativecommons.org/licenses/by-nc-nd/4.0/
- Abstract: Software engineering is a deeply cognitive activity shaped by individual differences that extend beyond technical skill. This study investigates how cognitive capability and personality traits jointly relate to software problem solving among 80 participants (40 software practitioners, 40 software engineering students). Cognitive capability was measured using Baddeleys three minute grammatical reasoning test, while personality was assessed using the IPIP NEO 50 test. Participants further completed nine interview style problem solving questions. Six questions were related to coding and three were related to logical reasoning. Descriptive and correlational analyses show that practitioners achieved slightly higher grammatical reasoning accuracy and overall task performance than students. Grammatical-reasoning accuracy correlated positively with problem solving performance, indicating that stronger cognitive capability is associated with better performance in coding and logical tasks. Personality performance links were systematic. We identified that the conscientiousness trait correlated most strongly with problem solving and with reasoning accuracy, while the openness to experience trait was positively related to both outcomes. Neuroticism showed small, negative associations with accuracy and performance. Taken together, our results suggest that conscientiousness and openness to experience characteristics complement reasoning accuracy to support software problem solving, whereas elevated negative affect may hinder precision under time pressure. Our findings suggest practical implications for education and industry such as integrating structured reasoning tasks in curricula, and considering personality cognition in recruitment and role allocation. We highlight directions for future research such as longitudinal and task diverse replications with larger samples.
Related papers
- Cognitive Foundations for Reasoning and Their Manifestation in LLMs [63.12951576410617]
Large language models (LLMs) solve complex problems yet fail on simpler variants, suggesting they achieve correct outputs through mechanisms fundamentally different from human reasoning.<n>We synthesize cognitive science research into a taxonomy of 28 cognitive elements spanning reasoning invariants, meta-cognitive controls, representations for organizing reasoning & knowledge, and transformation operations.<n>We develop test-time reasoning guidance that automatically scaffold successful structures, improving performance by up to 66.7% on complex problems.
arXiv Detail & Related papers (2025-11-20T18:59:00Z) - Improving Question Embeddings with Cognitive Representation Optimization for Knowledge Tracing [77.14348157016518]
Research on KT modeling focuses on predicting future student performance based on existing, unupdated records of student learning interactions.<n>We propose a knowledge-tracking cognitive representation optimization (CRO-KT) model that uses dynamic programming algorithms to optimize the structure of cognitive representation.
arXiv Detail & Related papers (2025-04-05T09:32:03Z) - I Felt Pressured to Give 100% All the Time: How Are Neurodivergent Professionals Being Included in Software Development Teams? [0.46873264197900916]
This study seeks to understand the work experiences of neurodivergent professionals acting in different software development roles.<n>We applied the Sociotechnical Theory (STS) to investigate how the social structures of organizations and their respective work technologies influence the inclusion of these professionals.
arXiv Detail & Related papers (2025-03-12T02:28:59Z) - Triangulating LLM Progress through Benchmarks, Games, and Cognitive Tests [87.0481906768826]
We examine three evaluation paradigms: standard benchmarks, interactive games, and cognitive tests.<n>Our analyses reveal that interactive games are superior to standard benchmarks in discriminating models.<n>We advocate for the development of new interactive benchmarks and targeted cognitive tasks inspired by assessing human abilities.
arXiv Detail & Related papers (2025-02-20T08:36:58Z) - Understanding the relationships between the perceptions of burnout and instability in Software Engineering [0.0]
burnout is a recognized disease that impacts productivity, turnover, and, most importantly, developers' well-being.<n>This study aims to identify and describe the relationship between perceived instability and burnout among software developers.
arXiv Detail & Related papers (2025-02-14T15:59:30Z) - Thoughts Are All Over the Place: On the Underthinking of o1-Like LLMs [86.79757571440082]
Large language models (LLMs) such as OpenAI's o1 have demonstrated remarkable abilities in complex reasoning tasks.<n>We identify a phenomenon we term underthinking, where o1-like LLMs frequently switch between different reasoning thoughts.<n>We propose a decoding strategy with thought switching penalty TIP that discourages premature transitions between thoughts.
arXiv Detail & Related papers (2025-01-30T18:58:18Z) - Cross-subject Brain Functional Connectivity Analysis for Multi-task Cognitive State Evaluation [16.198003101055264]
This study adopts brain functional connectivity with electroencephalography signals to capture associations in brain regions across multiple subjects for evaluating real-time cognitive states.
Thirty subjects are acquired for analysis and evaluation. The results are interpreted through different perspectives, including inner-subject and cross-subject for task-wise and gender-wise underlying brain functional connectivity.
arXiv Detail & Related papers (2024-08-27T12:51:59Z) - PsyCoT: Psychological Questionnaire as Powerful Chain-of-Thought for
Personality Detection [50.66968526809069]
We propose a novel personality detection method, called PsyCoT, which mimics the way individuals complete psychological questionnaires in a multi-turn dialogue manner.
Our experiments demonstrate that PsyCoT significantly improves the performance and robustness of GPT-3.5 in personality detection.
arXiv Detail & Related papers (2023-10-31T08:23:33Z) - Exploring the Relationship Between Personality Traits and User Feedback [9.289846887298852]
We present a preliminary study about the effect of personality traits on user feedback.
56 university students provided feedback on different software features of an e-learning tool used in the course.
Results suggest that sensitivity to frustration and lower stress tolerance may negatively impact the feedback of users.
arXiv Detail & Related papers (2023-07-22T10:10:27Z) - Unleashing the Emergent Cognitive Synergy in Large Language Models: A Task-Solving Agent through Multi-Persona Self-Collaboration [116.09561564489799]
Solo Performance Prompting transforms a single LLM into a cognitive synergist by engaging in multi-turn self-collaboration with multiple personas.
A cognitive synergist is an intelligent agent that collaboratively combines multiple minds' strengths and knowledge to enhance problem-solving in complex tasks.
Our in-depth analysis shows that assigning multiple fine-grained personas in LLMs improves problem-solving abilities compared to using a single or fixed number of personas.
arXiv Detail & Related papers (2023-07-11T14:45:19Z) - Understanding Self-Efficacy in the Context of Software Engineering: A
Qualitative Study in the Industry [2.268415020650315]
Self-efficacy is a concept researched in various areas of knowledge that impacts various factors such as performance, satisfaction, and motivation.
This study aims to understand the impact on the software development context with a focus on understanding the behavioral signs of self-efficacy.
arXiv Detail & Related papers (2023-05-26T17:16:37Z) - Co-Located Human-Human Interaction Analysis using Nonverbal Cues: A
Survey [71.43956423427397]
We aim to identify the nonverbal cues and computational methodologies resulting in effective performance.
This survey differs from its counterparts by involving the widest spectrum of social phenomena and interaction settings.
Some major observations are: the most often used nonverbal cue, computational method, interaction environment, and sensing approach are speaking activity, support vector machines, and meetings composed of 3-4 persons equipped with microphones and cameras, respectively.
arXiv Detail & Related papers (2022-07-20T13:37:57Z) - CogAlign: Learning to Align Textual Neural Representations to Cognitive
Language Processing Signals [60.921888445317705]
We propose a CogAlign approach to integrate cognitive language processing signals into natural language processing models.
We show that CogAlign achieves significant improvements with multiple cognitive features over state-of-the-art models on public datasets.
arXiv Detail & Related papers (2021-06-10T07:10:25Z)
This list is automatically generated from the titles and abstracts of the papers in this site.
This site does not guarantee the quality of this site (including all information) and is not responsible for any consequences.