Powerformer: A Transformer with Weighted Causal Attention for Time-Series Forecasting
Published in AISTATS 2026, 2026
Recommended citation: K. Hegazy, M. W. Mahoney, N. B. Erichson. (2026). "Powerformer: A Transformer with Weighted Causal Attention for Time-Series Forecasting." AISTATS.
A state-of-the-art transformer for time-series forecasting. Weighted causal attention encodes recency bias and local structure, yielding strong long-horizon forecasts.