TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Methods/Linear Regression

Linear Regression

GeneralIntroduced 20001657 papers

Description

Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most common is least squares, where we minimize the mean square error between the predicted values y^=Xβ^\hat{y} = \textbf{X}\hat{\beta}y^​=Xβ^​ and actual values yyy: (y−Xβ)2\left(y-\textbf{X}\beta\right)^{2}(y−Xβ)2.

We can also define the problem in probabilistic terms as a generalized linear model (GLM) where the pdf is a Gaussian distribution, and then perform maximum likelihood estimation to estimate β^\hat{\beta}β^​.

Image Source: Wikipedia

Papers Using This Method

Wild Bootstrap Inference for Linear Regressions with Many Covariates2025-06-26The Persistent Effects of Peru's Mining MITA: Double Machine Learning Approach2025-06-23Enhancing eLoran Timing Accuracy via Machine Learning with Meteorological and Terrain Data2025-06-18A Simplified Analysis of SGD for Linear Regression with Weight Averaging2025-06-18Uniform Mean Estimation for Heavy-Tailed Distributions via Median-of-Means2025-06-17Optimizing Blood Transfusions and Predicting Shortages in Resource-Constrained Areas2025-06-14Statistical Machine Learning for Astronomy -- A Textbook2025-06-13Standard LSParameter Estimators Ensure Finite Convergence Time for Linear Regression Equations Under an Interval Excitation Assumption2025-06-09Heavy Lasso: sparse penalized regression under heavy-tailed noise via data-augmented soft-thresholding2025-06-09Differentially Private Sparse Linear Regression with Heavy-tailed Responses2025-06-07An Optimized Franz-Parisi Criterion and its Equivalence with SQ Lower Bounds2025-06-06Privacy Amplification Through Synthetic Data: Insights from Linear Regression2025-06-05Counterfactual reasoning: an analysis of in-context emergence2025-06-05Meta-analysis of Life Cycle Assessments for Li-Ion Batteries Production Emissions2025-06-05Modern approaches to building effective interpretable models of the property market using machine learning2025-06-05Visualizing and Controlling Cortical Responses Using Voxel-Weighted Activation Maximization2025-06-04Relational reasoning and inductive bias in transformers trained on a transitive inference task2025-06-04Replay Can Provably Increase Forgetting2025-06-04Retrieval-Augmented Generation as Noisy In-Context Learning: A Unified Theory and Risk Bounds2025-06-03Linear regression with overparameterized linear neural networks: Tight upper and lower bounds for implicit $\ell^1$-regularization2025-06-01