Tasks SotA Datasets Papers Methods Submit About

Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable Benchmarks All SotA Datasets Papers Methods

Community

Submit Results About

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

ERNIE

Natural Language ProcessingIntroduced 200054 papers

Description

ERNIE is a transformer-based model consisting of two stacked modules: 1) textual encoder and 2) knowledgeable encoder, which is responsible to integrate extra token-oriented knowledge information into textual information. This layer consists of stacked aggregators, designed for encoding both tokens and entities as well as fusing their heterogeneous features. To integrate this layer of enhancing representations via knowledge, a special pre-training task is adopted for ERNIE - it involves randomly masking token-entity alignments and training the model to predict all corresponding entities based on aligned tokens (aka denoising entity auto-encoder).

Papers Using This Method

Evaluating Moral Beliefs across LLMs through a Pluralistic Framework2024-11-06 The Potential of LLMs in Medical Education: Generating Questions and Answers for Qualification Exams2024-10-31 Testing Large Language Models on Driving Theory Knowledge and Skills for Connected Autonomous Vehicles2024-07-24 Unlocking the Potential: Benchmarking Large Language Models in Water Engineering and Research2024-07-22 The Solution for the AIGC Inference Performance Optimization Competition2024-07-06 Chumor 1.0: A Truly Funny and Challenging Chinese Humor Understanding Dataset from Ruo Zhi Ba2024-06-18 NewsBench: A Systematic Evaluation Framework for Assessing Editorial Capabilities of Large Language Models in Chinese Journalism2024-02-29 Research about the Ability of LLM in the Tamper-Detection Area2024-01-24 How Robust is Google's Bard to Adversarial Image Attacks?2023-09-21 Robust Multi-Agent Reinforcement Learning via Adversarial Regularization: Theoretical Foundation and Stable Algorithms2023-09-21 The Impact of Artificial Intelligence on the Evolution of Digital Education: A Comparative Study of OpenAI Text Generation Tools including ChatGPT, Bing Chat, Bard, and Ernie2023-09-05 An APT Event Extraction Method Based on BERT-BiGRU-CRF for APT Attack Detection2023-08-04 Towards Effective Ancient Chinese Translation: Dataset, Model, and Evaluation2023-08-01 HouYi: An open-source large language model specially designed for renewable energy and carbon neutrality field2023-07-31 MedGPTEval: A Dataset and Benchmark to Evaluate Responses of Large Language Models in Medicine2023-05-12 Technical Report: Impact of Position Bias on Language Models in Token Classification2023-04-26 Co-Driven Recognition of Semantic Consistency via the Fusion of Transformer and HowNet Sememes Knowledge2023-02-21 ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation Generalization2023-01-09 Vote'n'Rank: Revision of Benchmarking with Social Choice Theory2022-10-11 GLM-130B: An Open Bilingual Pre-trained Model2022-10-05