2605.27286v1 May 26, 2026 cs.LG

Falcon-X: A Time Series Foundation Model for Heterogeneous Multivariate Modeling

Xilin Dai
Xilin Dai
Citations: 60
h-index: 4
Jiangnan Yang
Jiangnan Yang
Citations: 5
h-index: 1
Peiyuan Liu
Peiyuan Liu
Citations: 569
h-index: 10
Yiding Liu
Yiding Liu
Citations: 754
h-index: 8
Yifan Hu
Yifan Hu
Citations: 11
h-index: 1
Hongjie Xia
Hongjie Xia
Citations: 64
h-index: 2
Hongzhou Chen
Hongzhou Chen
Citations: 35
h-index: 3
Zewei Dong
Zewei Dong
Citations: 2
h-index: 1

Time series foundation models (TSFMs) are transforming the forecasting paradigm through large-scale cross-domain pretraining. However, most existing TSFMs remain univariate, and recent efforts to enable cross-variate modeling still operate directly within the raw variate space. This design introduces fundamental limitations in semantic alignment and relational expressivity. Specifically, raw-space group mixing lacks a dedicated mechanism to align heterogeneous physical quantities, while standard non-negative attention fails to capture the complex synergistic and antagonistic interactions ubiquitous in real-world systems. To address these challenges, we propose Falcon-X, decouples variates from the raw space and maps them into a unified latent prototype space. Falcon-X employs a Unified Prototype Diff-Attention mechanism that explicitly evaluates both positive and negative semantic affinities to explicitly align heterogeneous variates. Cross-variate interactions are then efficiently performed within this shared space via Latent Entity Attention, naturally facilitating zero-shot structural transfer. Finally, a Variate Reassembly Router robustly reconstructs variate-specific trajectories via a request-and-dispatch mechanism. Extensive evaluations on the GIFT-Eval and fev-bench benchmarks demonstrate that Falcon-X achieves state-of-the-art forecasting performance, offering a principled and scalable paradigm for complex multivariate environments. Falcon-X is publicly released to support future research.

1 Citations
0 Influential
5 Altmetric
26.0 Score
Original PDF

No Analysis Report Yet

This paper hasn't been analyzed by Gemini yet.

Log in to request an AI analysis.

댓글

댓글을 작성하려면 로그인하세요.

아직 댓글이 없습니다. 첫 번째 댓글을 남겨보세요!