Real-world time series often exhibit a non-stationary nature, degrading the performance of pre-trained forecasting models. Test-Time Adaptation (TTA) addresses this by adjusting models during inference, but existing methods typically update the full model, increasing memory and compute costs. We propose PETSA, a parameter-efficient method that adapts forecasters at test time by only updating small calibration modules on the input and output. PETSA uses low-rank adapters and dynamic gating to adjust representations without retraining. To maintain accuracy despite limited adaptation capacity, we introduce a specialized loss combining three components: (1) a robust term, (2) a frequency-domain term to preserve periodicity, and (3) a patch-wise structural term for structural alignment. PETSA improves the adaptability of various forecasting backbones while requiring fewer parameters than baselines. Experimental results on benchmark datasets show that PETSA achieves competitive or better performance across all horizons. Our code is available at: this https URL.
Bibtex
@misc{medeiros2025accurateparameterefficienttesttimeadaptation,
title={Accurate Parameter-Efficient Test-Time Adaptation for Time Series Forecasting},
author={Heitor R. Medeiros and Hossein Sharifi-Noghabi and Gabriel L. Oliveira and Saghar Irandoust},
year={2025},
eprint={2506.23424},
archivePrefix={arXiv},
primaryClass={cs.LG},
url={https://arxiv.org/abs/2506.23424},
}
Related Research
-
Score-based Outlier Generation via Controlling the Radon-Nikodym Derivative
Score-based Outlier Generation via Controlling the Radon-Nikodym Derivative
A. Mukherjee, T. Milne, K. Y. C. Lui, S. Hazlewood, and J. Liu. IEEE Conference on Decision and Control
Publications
-
Investigating Action Embeddings for More Efficient Off-Policy Evaluation
Investigating Action Embeddings for More Efficient Off-Policy Evaluation
M. Wabartha, K. Wilson, R. David Evans, H. Sharifi, and T. Sylvain. RecSys CONSEQUENCES Workshop
Publications
-
FACTS: Fast, Accurate, and Privacy-Compliant TableSummarization via Offline Template Generation
FACTS: Fast, Accurate, and Privacy-Compliant TableSummarization via Offline Template Generation
Y. Yuan, M. Amin Shabani, and S. Liu. Workshop on Generative AI in Finance at NeurIPS
Publications