Linear Time Series Basics
Linear Time Series Basics
2022-12-04
Introduction
Introduction
Introduction
Introduction
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
Introduction
Time series modelling has its root from Econometrics, where regression,
i.e causal econometric models are dealt with. These models are of the
form
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
0
3
2
-50
1
Y
Y
0
-1
-100
-2
-3
0 200 400 600 800 1000 0 100 200 300 400 500
Time Time
Canadian Lynx (cyclical, no trend or season, stationary) Air Passengers (trend and seasonal, non-stationary)
1000 2000 3000 4000 5000 6000 7000
600
500
AirPassengers
400
lynx
300
200
100
0
1820 1840 1860 1880 1900 1920 1950 1952 1954 1956 1958 1960
Time Time
1.0
2
0.8
1
0.6
4
0
ACF
0.4
Y
2
-1
0.2
0
-2
0.0
-2
-0.2
-3
0 20 40 60 80 100 0 20 40 60 80 100 0 5 10 15 20
0.2
1.0
0.8
0.8
0.1
0.6
0.6
Partial ACF
Partial ACF
0.4
ACF
0.0
0.4
0.2
0.2
-0.1
0.0
0.0
-0.2
-0.2
-0.2
0 5 10 15 20 5 10 15 20 5 10 15 20
1.0
2
0.8
1
0.6
4
0
ACF
0.4
Y
2
-1
0.2
0
-2
0.0
-2
-0.2
-3
0 20 40 60 80 100 0 20 40 60 80 100 0 5 10 15 20
0.2
1.0
0.8
0.8
0.1
0.6
0.6
Partial ACF
Partial ACF
0.4
ACF
0.0
0.4
0.2
0.2
-0.1
0.0
0.0
-0.2
-0.2
-0.2
0 5 10 15 20 5 10 15 20 5 10 15 20
1.0
2
0.8
1
0.6
4
0
ACF
0.4
Y
2
-1
0.2
0
-2
0.0
-2
-0.2
-3
0 20 40 60 80 100 0 20 40 60 80 100 0 5 10 15 20
0.2
1.0
0.8
0.8
0.1
0.6
0.6
Partial ACF
Partial ACF
0.4
ACF
0.0
0.4
0.2
0.2
-0.1
0.0
0.0
-0.2
-0.2
-0.2
0 5 10 15 20 5 10 15 20 5 10 15 20
1.0
2
0.8
1
0.6
4
0
ACF
0.4
Y
2
-1
0.2
0
-2
0.0
-2
-0.2
-3
0 20 40 60 80 100 0 20 40 60 80 100 0 5 10 15 20
0.2
1.0
0.8
0.8
0.1
0.6
0.6
Partial ACF
Partial ACF
0.4
ACF
0.0
0.4
0.2
0.2
-0.1
0.0
0.0
-0.2
-0.2
-0.2
0 5 10 15 20 5 10 15 20 5 10 15 20
1.0
2
0.8
1
0.6
4
0
ACF
0.4
Y
2
-1
0.2
0
-2
0.0
-2
-0.2
-3
0 20 40 60 80 100 0 20 40 60 80 100 0 5 10 15 20
0.2
1.0
0.8
0.8
0.1
0.6
0.6
Partial ACF
Partial ACF
0.4
ACF
0.0
0.4
0.2
0.2
-0.1
0.0
0.0
-0.2
-0.2
-0.2
0 5 10 15 20 5 10 15 20 5 10 15 20
1.0
2
0.8
1
0.6
4
0
ACF
0.4
Y
2
-1
0.2
0
-2
0.0
-2
-0.2
-3
0 20 40 60 80 100 0 20 40 60 80 100 0 5 10 15 20
0.2
1.0
0.8
0.8
0.1
0.6
0.6
Partial ACF
Partial ACF
0.4
ACF
0.0
0.4
0.2
0.2
-0.1
0.0
0.0
-0.2
-0.2
-0.2
0 5 10 15 20 5 10 15 20 5 10 15 20
1.0
2
0.8
1
0.6
4
0
ACF
0.4
Y
2
-1
0.2
0
-2
0.0
-2
-0.2
-3
0 20 40 60 80 100 0 20 40 60 80 100 0 5 10 15 20
0.2
1.0
0.8
0.8
0.1
0.6
0.6
Partial ACF
Partial ACF
0.4
ACF
0.0
0.4
0.2
0.2
-0.1
0.0
0.0
-0.2
-0.2
-0.2
0 5 10 15 20 5 10 15 20 5 10 15 20
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag
2
0
1
-5
0
∆yt
yt
-10
-1
-15
-2
-20
-3
0 20 40 60 80 100 0 20 40 60 80 100
Time Time
1.0
0.8
0.8
0.6
0.6
ACF
ACF
0.4
0.4
0.2
0.2
0.0
0.0
-0.2
-0.2
0 5 10 15 20 0 5 10 15
Lag Lag