TasksSotADatasetsPapersMethodsSubmitAbout
Papers With Code 2

A community resource for machine learning research: papers, code, benchmarks, and state-of-the-art results.

Explore

Notable BenchmarksAll SotADatasetsPapersMethods

Community

Submit ResultsAbout

Data sourced from the PWC Archive (CC-BY-SA 4.0). Built by the community, for the community.

Papers/Disentangled Interpretable Representation for Efficient Lo...

Disentangled Interpretable Representation for Efficient Long-term Time Series Forecasting

Yuang Zhao, Tianyu Li, Jiadong Chen, Shenrong Ye, Fuxin Jiang, Tieying Zhang, Xiaofeng Gao

2024-11-26Time Series ForecastingTime SeriesMultivariate Time Series Forecasting
PaperPDFCode(official)

Abstract

Industry 5.0 introduces new challenges for Long-term Time Series Forecasting (LTSF), characterized by high-dimensional, high-resolution data and high-stakes application scenarios. Against this backdrop, developing efficient and interpretable models for LTSF becomes a key challenge. Existing deep learning and linear models often suffer from excessive parameter complexity and lack intuitive interpretability. To address these issues, we propose DiPE-Linear, a Disentangled interpretable Parameter-Efficient Linear network. DiPE-Linear incorporates three temporal components: Static Frequential Attention (SFA), Static Temporal Attention (STA), and Independent Frequential Mapping (IFM). These components alternate between learning in the frequency and time domains to achieve disentangled interpretability. The decomposed model structure reduces parameter complexity from quadratic in fully connected networks (FCs) to linear and computational complexity from quadratic to log-linear. Additionally, a Low-Rank Weight Sharing policy enhances the model's ability to handle multivariate series. Despite operating within a subspace of FCs with limited expressive capacity, DiPE-Linear demonstrates comparable or superior performance to both FCs and nonlinear models across multiple open-source and real-world LTSF datasets, validating the effectiveness of its sophisticatedly designed structure. The combination of efficiency, accuracy, and interpretability makes DiPE-Linear a strong candidate for advancing LTSF in both research and real-world applications. The source code is available at https://github.com/wintertee/DiPE-Linear.

Results

TaskDatasetMetricValueModel
Time Series ForecastingETTh2 (720) MultivariateMSE0.375DiPE-Linear
Time Series ForecastingETTh1 (720) MultivariateMSE0.409DiPE-Linear
Time Series ForecastingETTm1 (192) MultivariateMSE0.339DiPE-Linear
Time Series ForecastingWeather (192)MSE0.187DiPE-Linear
Time Series ForecastingWeather (336)MSE0.234DiPE-Linear
Time Series ForecastingETTm2 (96) MultivariateMSE0.162DiPE-Linear
Time Series ForecastingElectricity (336)MSE0.162DiPE-Linear
Time Series ForecastingWeather (720)MSE0.306DiPE-Linear
Time Series ForecastingETTh2 (336) MultivariateMSE0.35DiPE-Linear
Time Series ForecastingETTh1 (192) MultivariateMSE0.407DiPE-Linear
Time Series ForecastingElectricity (192)MSE0.148DiPE-Linear
Time Series ForecastingETTh1 (336) MultivariateMSE0.424DiPE-Linear
Time Series ForecastingETTm2 (336) MultivariateMSE0.268DiPE-Linear
Time Series ForecastingETTm1 (336) MultivariateMSE0.367DiPE-Linear
Time Series ForecastingETTm1 (96) MultivariateMSE0.309DiPE-Linear
Time Series ForecastingETTm1 (720) MultivariateMSE0.416DiPE-Linear
Time Series ForecastingETTh2 (96) MultivariateMSE0.275DiPE-Linear
Time Series ForecastingWeather (96)MSE0.142DiPE-Linear
Time Series ForecastingETTm2 (192) MultivariateMSE0.216DiPE-Linear
Time Series ForecastingETTh1 (96) MultivariateMSE0.369DiPE-Linear
Time Series ForecastingElectricity (96)MSE0.132DiPE-Linear
Time Series ForecastingETTh2 (192) MultivariateMSE0.325DiPE-Linear
Time Series ForecastingElectricity (720)MSE0.198DiPE-Linear
Time Series ForecastingETTm2 (720) MultivariateMSE0.353DiPE-Linear
Time Series AnalysisETTh2 (720) MultivariateMSE0.375DiPE-Linear
Time Series AnalysisETTh1 (720) MultivariateMSE0.409DiPE-Linear
Time Series AnalysisETTm1 (192) MultivariateMSE0.339DiPE-Linear
Time Series AnalysisWeather (192)MSE0.187DiPE-Linear
Time Series AnalysisWeather (336)MSE0.234DiPE-Linear
Time Series AnalysisETTm2 (96) MultivariateMSE0.162DiPE-Linear
Time Series AnalysisElectricity (336)MSE0.162DiPE-Linear
Time Series AnalysisWeather (720)MSE0.306DiPE-Linear
Time Series AnalysisETTh2 (336) MultivariateMSE0.35DiPE-Linear
Time Series AnalysisETTh1 (192) MultivariateMSE0.407DiPE-Linear
Time Series AnalysisElectricity (192)MSE0.148DiPE-Linear
Time Series AnalysisETTh1 (336) MultivariateMSE0.424DiPE-Linear
Time Series AnalysisETTm2 (336) MultivariateMSE0.268DiPE-Linear
Time Series AnalysisETTm1 (336) MultivariateMSE0.367DiPE-Linear
Time Series AnalysisETTm1 (96) MultivariateMSE0.309DiPE-Linear
Time Series AnalysisETTm1 (720) MultivariateMSE0.416DiPE-Linear
Time Series AnalysisETTh2 (96) MultivariateMSE0.275DiPE-Linear
Time Series AnalysisWeather (96)MSE0.142DiPE-Linear
Time Series AnalysisETTm2 (192) MultivariateMSE0.216DiPE-Linear
Time Series AnalysisETTh1 (96) MultivariateMSE0.369DiPE-Linear
Time Series AnalysisElectricity (96)MSE0.132DiPE-Linear
Time Series AnalysisETTh2 (192) MultivariateMSE0.325DiPE-Linear
Time Series AnalysisElectricity (720)MSE0.198DiPE-Linear
Time Series AnalysisETTm2 (720) MultivariateMSE0.353DiPE-Linear

Related Papers

The Power of Architecture: Deep Dive into Transformer Architectures for Long-Term Time Series Forecasting2025-07-17MoTM: Towards a Foundation Model for Time Series Imputation based on Continuous Modeling2025-07-17Data Augmentation in Time Series Forecasting through Inverted Framework2025-07-15D3FL: Data Distribution and Detrending for Robust Federated Learning in Non-linear Time-series Data2025-07-15Towards Interpretable Time Series Foundation Models2025-07-10MoFE-Time: Mixture of Frequency Domain Experts for Time-Series Forecasting Models2025-07-09Foundation models for time series forecasting: Application in conformal prediction2025-07-09Bridging the Last Mile of Prediction: Enhancing Time Series Forecasting with Conditional Guided Flow Matching2025-07-09