TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/SLURP: A Spoken Language Understanding Resource Package

SLURP: A Spoken Language Understanding Resource Package

Emanuele Bastianelli, Andrea Vanzo, Pawel Swietojanski, Verena Rieser

2020-11-26EMNLP 2020 11Slot FillingSpoken Language UnderstandingIntent Classification
PaperPDFCode(official)

Abstract

Spoken Language Understanding infers semantic meaning directly from audio data, and thus promises to reduce error propagation and misunderstandings in end-user applications. However, publicly available SLU resources are limited. In this paper, we release SLURP, a new SLU package containing the following: (1) A new challenging dataset in English spanning 18 domains, which is substantially bigger and linguistically more diverse than existing datasets; (2) Competitive baselines based on state-of-the-art NLU and ASR systems; (3) A new transparent metric for entity labelling which enables a detailed error analysis for identifying potential areas of improvement. SLURP is available at https: //github.com/pswietojanski/slurp.

Results

TaskDatasetMetricValueModel
Intent ClassificationSLURPAccuracy (%)78.33Multi-SLURP
Slot FillingSLURPF10.642Multi-SLURP

Related Papers

Invocable APIs derived from NL2SQL datasets for LLM Tool-Calling Evaluation2025-06-12MMSU: A Massive Multi-task Spoken Language Understanding and Reasoning Benchmark2025-06-05Leveraging GANs for citation intent classification and its impact on citation network analysis2025-05-27ALAS: Measuring Latent Speech-Text Alignment For Spoken Language Understanding In Multimodal LLMs2025-05-26"KAN you hear me?" Exploring Kolmogorov-Arnold Networks for Spoken Language Understanding2025-05-26Reward-Driven Interaction: Enhancing Proactive Dialogue Agents through User Satisfaction Prediction2025-05-24Exploring the Effect of Segmentation and Vocabulary Size on Speech Tokenization for Speech Language Models2025-05-23Intent Classification on Low-Resource Languages with Query Similarity Search2025-05-23