Date
AI Overview
Why it matters
Generative AI is reshaping software engineering, raising questions about whether core entry-level competencies and assessments have changed, and whether higher education expectations still align with industry hiring needs.
Study at a glance
- Question: How have educators and hiring professionals adapted their assessments, skill priorities, and readiness expectations in response to generative AI?
- Setting and data: 56 computing educators across 17 countries and 24 hiring professionals across 10 countries.
- Method: Surveys with descriptive analysis, open coding, and Mann-Whitney U tests.
- AI tools: ChatGPT, Gemini, Claude, Claude Opus 4.7
Key findings
- Educators and hiring professionals agreed on the most important competencies, ranking critical evaluation of AI outputs, independent learning, and responsible tool use highest.
- Hiring professionals reported larger graduate readiness gaps than educators on 10 of 12 skills, with statistically significant disagreements concentrated in foundational technical competencies.
- Both groups shifted toward AI-resistant evaluations, with 84% of educators increasing oral assessments and 66% increasing supervised exams, while industry moved toward real-time, observable tasks.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
GenAI's ability to solve a wide range of software engineering tasks is reshaping the software industry, raising the question of what an entry-level software engineer looks like today. In this work, we investigate whether the core skills for entry-level engineers have changed with GenAI and how the assessment of those skills has changed. Through two surveys, we consider both the educational and hiring perspectives, drawing on responses from 56 educators and 24 hiring professionals across diverse geographic regions to identify gaps and misaligned expectations. We find that educators frame their GenAI policies primarily around academic integrity, whereas GenAI use in industry is near-universal, with organizational policy governing how it should be used rather than whether to use it. Policies on GenAI use during interviews are still emerging, and respondents are split on whether they prefer candidates who demonstrate GenAI skills. Both populations are moving toward GenAI-resistant assessments built on observable real-time interactions and higher-order tasks, and both agree on which skills matter most, rating critical evaluation of AI-generated output, responsible and effective use of GenAI tools, and the ability to learn and adapt independently highly. However, they disagree on graduate readiness in these skills: hiring professionals report larger gaps, with the disagreement concentrated on foundational, non-GenAI-specific skills.
Research Categories
What is the application?
Who age?
Why use AI?
Study design
Methods
AI tools
Publication Source
Publisher
arXiv
