TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/ExtractGPT: Exploring the Potential of Large Language Mode...

ExtractGPT: Exploring the Potential of Large Language Models for Product Attribute Value Extraction

Alexander Brinkmann, Roee Shraga, Christian Bizer

2023-10-19AttributeAttribute Value Extraction
PaperPDFCode(official)

Abstract

E-commerce platforms require structured product data in the form of attribute-value pairs to offer features such as faceted product search or attribute-based product comparison. However, vendors often provide unstructured product descriptions, necessitating the extraction of attribute-value pairs from these texts. BERT-based extraction methods require large amounts of task-specific training data and struggle with unseen attribute values. This paper explores using large language models (LLMs) as a more training-data efficient and robust alternative. We propose prompt templates for zero-shot and few-shot scenarios, comparing textual and JSON-based target schema representations. Our experiments show that GPT-4 achieves the highest average F1-score of 85% using detailed attribute descriptions and demonstrations. Llama-3-70B performs nearly as well, offering a competitive open-source alternative. GPT-4 surpasses the best PLM baseline by 5% in F1-score. Fine-tuning GPT-3.5 increases the performance to the level of GPT-4 but reduces the model's ability to generalize to unseen attribute values.

Results

TaskDatasetMetricValueModel
Information ExtractionAE-110kF1-score87.5GPT-4-json-val-10-dem
Information ExtractionAE-110kF1-score86ft-GPT-3.5-json-val
Information ExtractionOA-Mine - annotationsF1-score84.5ft-GPT-3.5-json-val
Information ExtractionOA-Mine - annotationsF1-score82.2GPT-4-json-val-10-dem
Attribute Value ExtractionAE-110kF1-score87.5GPT-4-json-val-10-dem
Attribute Value ExtractionAE-110kF1-score86ft-GPT-3.5-json-val
Attribute Value ExtractionOA-Mine - annotationsF1-score84.5ft-GPT-3.5-json-val
Attribute Value ExtractionOA-Mine - annotationsF1-score82.2GPT-4-json-val-10-dem

Related Papers

MGFFD-VLM: Multi-Granularity Prompt Learning for Face Forgery Detection with VLM2025-07-16Non-Adaptive Adversarial Face Generation2025-07-16Attributes Shape the Embedding Space of Face Recognition Models2025-07-15COLIBRI Fuzzy Model: Color Linguistic-Based Representation and Interpretation2025-07-15Ref-Long: Benchmarking the Long-context Referencing Capability of Long-context Language Models2025-07-13Model Parallelism With Subnetwork Data Parallelism2025-07-11Bradley-Terry and Multi-Objective Reward Modeling Are Complementary2025-07-10Evaluating Attribute Confusion in Fashion Text-to-Image Generation2025-07-09