Date
AI Overview
Why it matters
Large language models show impressive capabilities across language tasks, yet understanding how to integrate them across diverse disciplines while navigating key limitations, unresolved challenges, and open risks remains an ongoing challenge.
Study at a glance
- Question: How are large language models shaping research, educational practice, and workflows across various academic disciplines?
- Setting and data: Cross-disciplinary survey of literature, empirical studies, and benchmark evaluations across the humanities, business, and science domains.
- Method: Systematic review and benchmark synthesis (Systematic / scoping review)
- AI tools: ChatGPT, GPT-4o, Claude 3.7 Sonnet, DeepSeek-R1, Gemini 2.0 Flash, Llama 3
Key findings
- No single large language model dominates across all domains, with performance trading off between general dialogue capabilities, domain-specific tasks, and complex multi-step reasoning.
- On mathematical education tasks, students receiving model-generated explanations performed better on subsequent tests than those seeing only answers, especially when trying problems first.
- Across disciplines, models face critical bottlenecks including factual hallucinations, lack of deep causal reasoning, prompt sensitivity, and an inability to natively verify physical or legal constraints.
Summary drafted with AI from the full paper and may contain errors. See the full paper for details.
Cutting-edge Artificial Intelligence (AI) techniques keep reshaping our view of the world. For example, Large Language Models (LLMs) based applications such as ChatGPT have shown the capability of generating human-like conversation on extensive topics. Due to the impressive performance on a variety of language-related tasks (e.g., open-domain question answering, translation, and document summarization), one can envision the far-reaching impacts that can be brought by the LLMs with broader real-world applications (e.g., customer service, education and accessibility, and scientific discovery). Inspired by their success, this paper will offer an overview of state-of-the-art LLMs and their integration into a wide range of academic disciplines, including: (1) arts, letters, and law (e.g., history, philosophy, political science, arts and architecture, law), (2) economics and business (e.g., finance, economics, accounting, marketing), and (3) science and engineering (e.g., mathematics, physics and mechanical engineering, chemistry and chemical engineering, life sciences and bioengineering, earth sciences and civil engineering, computer science and electrical engineering). Integrating humanity and technology, in this paper, we will explore how LLMs are shaping research and practice in these fields, while also discussing key limitations, open challenges, and future directions in the era of generative AI. The review of how LLMs are engaged across disciplines-along with key observations and insights-can help researchers and practitioners interested in exploiting LLMs to advance their works in diverse real-world applications.
Research Categories
What is the application?
Who age?
Why use AI?
Study design
AI tools
Datasets
Publication Source
Publisher
arXiv
