How to make a Transformer for time series forecasting with PyTorch

This post will show you how to transform a time series Transformer architecture diagram into PyTorch code step by step

Kasper Groes Albin Ludvigsen
Towards Data Science
10 min readMay 12, 2022

--

A transformer station
A transformer station. Image by WikimediaImages.

Transformer models have shown state of the art performance in a number of time series forecasting problems [1][2][3].

--

--

I write about LLMs, time series forecasting, sustainable data science and green software engineering