Figure 2: Percentage of Research Repository and causal impact papers by study design
Note: Technical/Computational is defined as research focusing on algorithm development, model benchmarking, creation of new datasets, or other computer science–related outcomes. The methodology generally includes computational experiments, including architecture descriptions, training procedures, dataset creation, performance evaluations, or ablation studies. Some examples of papers in this category are Enhancing Retrieval-Augmented Generation with Entity Linking for Educational Platforms and Can Large Language Models Make the Grade? An Empirical Study Evaluating LLMs Ability to Mark Short Answer Questions in K-12 Education. Other quantitative methods include mixed-methods studies, observational studies, case studies with quantitative components among others. Some of the causal impact papers include descriptive, technical/computational, or other quantitative methods (in addition to causal methods), which is why those papers are included in the causal impact papers.
