TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/What Differentiates Educational Literature? A Multimodal F...

What Differentiates Educational Literature? A Multimodal Fusion Approach of Transformers and Computational Linguistics

Jordan J. Bird

2024-11-26Text ClassificationDecision Makingtext-classification
PaperPDF

Abstract

The integration of new literature into the English curriculum remains a challenge since educators often lack scalable tools to rapidly evaluate readability and adapt texts for diverse classroom needs. This study proposes to address this gap through a multimodal approach that combines transformer-based text classification with linguistic feature analysis to align texts with UK Key Stages. Eight state-of-the-art Transformers were fine-tuned on segmented text data, with BERT achieving the highest unimodal F1 score of 0.75. In parallel, 500 deep neural network topologies were searched for the classification of linguistic characteristics, achieving an F1 score of 0.392. The fusion of these modalities shows a significant improvement, with every multimodal approach outperforming all unimodal models. In particular, the ELECTRA Transformer fused with the neural network achieved an F1 score of 0.996. Unimodal and multimodal approaches are shown to have statistically significant differences in all validation metrics (accuracy, precision, recall, F1 score) except for inference time. The proposed approach is finally encapsulated in a stakeholder-facing web application, providing non-technical stakeholder access to real-time insights on text complexity, reading difficulty, curriculum alignment, and recommendations for learning age range. The application empowers data-driven decision making and reduces manual workload by integrating AI-based recommendations into lesson planning for English literature.

Results

TaskDatasetMetricValueModel
Text ClassificationUK Key Stage ReadabilityF199.6ELECTRA + ANN
Text ClassificationUK Key Stage ReadabilityF199.4ERNIE + ANN
Text ClassificationUK Key Stage ReadabilityF199.2XLNet + ANN
Text ClassificationUK Key Stage ReadabilityF198.7RoBERTa + ANN
Text ClassificationUK Key Stage ReadabilityF193.9Longformer + ANN
Text ClassificationUK Key Stage ReadabilityF190.5BERT + ANN
Text ClassificationUK Key Stage ReadabilityF179.7ALBERT + ANN
Text ClassificationUK Key Stage ReadabilityF175BERT
Text ClassificationUK Key Stage ReadabilityF174.4DistilBERT
Text ClassificationUK Key Stage ReadabilityF174Longformer
Text ClassificationUK Key Stage ReadabilityF174XLNet
Text ClassificationUK Key Stage ReadabilityF173.6ERNIE
Text ClassificationUK Key Stage ReadabilityF173.1RoBERTa
Text ClassificationUK Key Stage ReadabilityF171.3ELECTRA
Text ClassificationUK Key Stage ReadabilityF167.8ALBERT
ClassificationUK Key Stage ReadabilityF199.6ELECTRA + ANN
ClassificationUK Key Stage ReadabilityF199.4ERNIE + ANN
ClassificationUK Key Stage ReadabilityF199.2XLNet + ANN
ClassificationUK Key Stage ReadabilityF198.7RoBERTa + ANN
ClassificationUK Key Stage ReadabilityF193.9Longformer + ANN
ClassificationUK Key Stage ReadabilityF190.5BERT + ANN
ClassificationUK Key Stage ReadabilityF179.7ALBERT + ANN
ClassificationUK Key Stage ReadabilityF175BERT
ClassificationUK Key Stage ReadabilityF174.4DistilBERT
ClassificationUK Key Stage ReadabilityF174Longformer
ClassificationUK Key Stage ReadabilityF174XLNet
ClassificationUK Key Stage ReadabilityF173.6ERNIE
ClassificationUK Key Stage ReadabilityF173.1RoBERTa
ClassificationUK Key Stage ReadabilityF171.3ELECTRA
ClassificationUK Key Stage ReadabilityF167.8ALBERT

Related Papers

Graph-Structured Data Analysis of Component Failure in Autonomous Cargo Ships Based on Feature Fusion2025-07-18Making Language Model a Hierarchical Classifier and Generator2025-07-17Higher-Order Pattern Unification Modulo Similarity Relations2025-07-17Exploiting Constraint Reasoning to Build Graphical Explanations for Mixed-Integer Linear Programming2025-07-17Acting and Planning with Hierarchical Operational Models on a Mobile Robot: A Study with RAE+UPOM2025-07-15CogDDN: A Cognitive Demand-Driven Navigation with Decision Optimization and Dual-Process Thinking2025-07-15Detección y Cuantificación de Erosión Fluvial con Visión Artificial2025-07-15Guiding LLM Decision-Making with Fairness Reward Models2025-07-15