Description
GPT is a Transformer-based architecture and training procedure for natural language processing tasks. Training follows a two-stage procedure. First, a language modeling objective is used on the unlabeled data to learn the initial parameters of a neural network model. Subsequently, these parameters are adapted to a target task using the corresponding supervised objective.
Papers Using This Method
Making Language Model a Hierarchical Classifier and Generator2025-07-17Generative Click-through Rate Prediction with Applications to Search Advertising2025-07-15Behaviour Space Analysis of LLM-driven Meta-heuristic Discovery2025-07-04Agent-to-Agent Theory of Mind: Testing Interlocutor Awareness among Large Language Models2025-06-28Large Language Models Acing Chartered Accountancy2025-06-26Cat and Mouse -- Can Fake Text Generation Outpace Detector Systems?2025-06-26Large Language Model-Driven Code Compliance Checking in Building Information Modeling2025-06-25InsertRank: LLMs can reason over BM25 scores to Improve Listwise Reranking2025-06-17Toward a Graph Foundation Model: Pre-Training Transformers With Random Walks2025-06-17NeuralNexus at BEA 2025 Shared Task: Retrieval-Augmented Prompting for Mistake Identification in AI Tutors2025-06-12Latent Multi-Head Attention for Small Language Models2025-06-11Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving2025-06-10AraReasoner: Evaluating Reasoning-Based LLMs for Arabic NLP2025-06-10LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimization2025-06-09Generative Voice Bursts during Phone Call2025-06-09RoboCerebra: A Large-scale Benchmark for Long-horizon Robotic Manipulation Evaluation2025-06-07The Lock-in Hypothesis: Stagnation by Algorithm2025-06-06Evolutionary Perspectives on the Evaluation of LLM-Based AI Agents: A Comprehensive Survey2025-06-06Mathematical Reasoning for Unmanned Aerial Vehicles: A RAG-Based Approach for Complex Arithmetic Reasoning2025-06-05Privacy and Security Threat for OpenAI GPTs2025-06-04