Awesome Multimodal Time Series Analysis

A curated list of paper, code, data, and other resources focus on multimodal time series analysis.

🚀 This repo will be continuously updated.
⭐️ Please Star it if you find it helpful!
🤝 Feel free to submit a PR or open an issue with suggestions or improvements.

---

Table of Contents

• Time Series Forecasting
• Time Series Reasoning
• Time Series Captioning
• Time Series Generation
• Time Series Alignment

---

Time Series Forecasting

Title	Venue	Month	Code
EventTSF: Event-Aware Non-Stationary Time Series Forecasting	arXiv	2025.08	None
Does Multimodality Lead to Better Time Series Forecasting?	arXiv	2025.06	None
FinMultiTime: A Bilingual Multimodal Financial Time-Series Dataset	arXiv	2025.06	HuggingFace
ChronoSteer: Bridging Large Language Model and Time Series Foundation Model via Synthetic Data	arXiv	2025.05	None
Dual-Forecaster: A Multimodal Time Series Model Integrating Descriptive and Predictive Texts	arXiv	2025.05	None
Multimodal Conditioned Diffusive Time Series Forecasting	arXiv	2025.04	Github
Exploring the Effectiveness and Interpretability of Texts in LLM-based Time Series Models	arXiv	2025.04	Github
Explainable Multi-modal Time Series Prediction with LLM-in-the-Loop	arXiv	2025.03	None
Evaluating System 1 vs. 2 Reasoning Approaches for Zero-Shot Time-Series Forecasting: A Benchmark and Insights	arXiv	2025.02	Github
TimeCAP: Learning to Contextualize, Augment, and Predict Time Series Events with Large Language Model Agents	AAAI	2025.02	None
Language in the Flow of Time: Time-Series-Paired Texts Weaved into a Unified Temporal Narrative	arXiv	2025.02	None
ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Data	AAAI	2024.12	Github
Multi-Modal Forecaster: Jointly Predicting Time Series and Textual Data	arXiv	2024.11	Github
Context is Key: A Benchmark for Forecasting with Essential Textual Information	arXiv	2024.10	Github
From News to Forecast: Integrating Event Analysis in LLM-Based Time Series Forecasting with Reflection	NeurIPS	2024.09	Github
Time-MMD: Multi-Domain Multimodal Dataset for Time Series Analysis	NeurIPS	2024.06	Github
Beyond Trend and Periodicity: Guiding Time Series Forecasting with Textual Cues	arXiv	2024.05	Github
Language Models Still Struggle to Zero-shot Reason about Time Series	arXiv	2024.04	Github
Towards Explainable Traffic Flow Prediction with Large Language Models	arXiv	2024.04	Github
GPT4MTS: Prompt-Based Large Language Model for Multimodal Time-Series Forecasting	AAAI	2024.03	Github

Time Series Reasoning

Title	Venue	Month	Code
ITFormer: Bridging Time Series and Natural Language for Multi-Modal QA with Large-Scale Multitask Dataset	arXiv	2025.06	Github
MTBench: A Multimodal Time Series Benchmark for Temporal Reasoning and Question Answering	arXiv	2025.03	Github
Chat-TS: Enhancing Multi-Modal Reasoning Over Time-Series and Natural Language Data	arXiv	2025.03	None
Time-MQA: Time Series Multi-Task Question Answering with Context Enhancement	arXiv	2025.02	HuggingFace
Position: Empowering Time Series Reasoning with Multimodal LLMs	arXiv	2025.02	None
ChatTime: A Unified Multimodal Time Series Foundation Model Bridging Numerical and Textual Data	AAAI	2024.12	Github
ChatTS: Aligning Time Series with LLMs via Synthetic Data for Enhanced Understanding and Reasoning	arXiv	2024.12	Github
A Picture is Worth A Thousand Numbers: Enabling LLMs Reason about Time Series via Visualization	arXiv	2024.11	Github
TimeSeriesExam: A Time Series Understanding Exam	arXiv	2024.10	HuggingFace
Can LLMs Understand Time Series Anomalies?	ICLR	2024.10	Github
Beyond Forecasting: Compositional Time Series Reasoning for End-to-End Task Execution	arXiv	2024.10	None
Towards Time Series Reasoning with LLMs	arXiv	2024.09	None
Evaluating Large Language Models on Time Series Feature Understanding: A Comprehensive Taxonomy and Benchmark	arXiv	2024.04	None
Language Models Still Struggle to Zero-shot Reason about Time Series	arXiv	2024.04	Github

Time Series Captioning

Title	Venue	Month	Code
Time Series Language Model for Descriptive Caption Generation	arXiv	2025.01	None
TADACap: Time-series Adaptive Domain-Aware Captioning	ICAIF	2024.12	None
Decoding Time Series with LLMs: A Multi-Agent Framework for Cross-Domain Annotation	arXiv	2024.10	None
Towards Time Series Reasoning with LLMs	arXiv	2024.09	None

Time Series Generation

Title	Venue	Month	Code
T2S: High-resolution Time Series Generation with Text-to-Series Diffusion Models	IJCAI	2025.05	Github

Time Series Alignment

Title	Venue	Month	Code
CLaSP: Learning Concepts for Time-Series Signals from Natural Language Supervision	arXiv	2024.11	None