Unobserved Components

class dismalpy.ssm.structural.UnobservedComponents(endog, level=False, trend=False, seasonal=None, cycle=False, autoregressive=None, exog=None, irregular=False, stochastic_level=False, stochastic_trend=False, stochastic_seasonal=True, stochastic_cycle=False, damped_cycle=False, cycle_period_bounds=None, mle_regression=True, **kwargs)[source]

Univariate unobserved components time series model

These are also known as structural time series models, and decompose a (univariate) time series into trend, seasonal, cyclical, and irregular components.

Parameters:

level : bool or string, optional

Whether or not to include a level component. Default is False. Can also be a string specification of the level / trend component; see Notes for available model specification strings.

trend : bool, optional

Whether or not to include a trend component. Default is False. If True, level must also be True.

seasonal_period : int or None, optional

The period of the seasonal component. Default is None.

cycle : bool, optional

Whether or not to include a cycle component. Default is False.

ar : int or None, optional

The order of the autoregressive component. Default is None.

exog : array_like or None, optional

Exoenous variables.

irregular : bool, optional

Whether or not to include an irregular component. Default is False.

stochastic_level : bool, optional

Whether or not any level component is stochastic. Default is False.

stochastic_trend : bool, optional

Whether or not any trend component is stochastic. Default is False.

stochastic_seasonal : bool, optional

Whether or not any seasonal component is stochastic. Default is False.

stochastic_cycle : bool, optional

Whether or not any cycle component is stochastic. Default is False.

damped_cycle : bool, optional

Whether or not the cycle component is damped. Default is False.

cycle_period_bounds : tuple, optional

A tuple with lower and upper allowed bounds for the period of the cycle. If not provided, the following default bounds are used: (1) if no date / time information is provided, the frequency is constrained to be between zero and \(\pi\), so the period is constrained to be in [0.5, infinity]. (2) If the date / time information is provided, the default bounds allow the cyclical component to be between 1.5 and 12 years; depending on the frequency of the endogenous variable, this will imply different specific bounds.

Notes

Thse models take the general form (see [R7] Chapter 3.2 for all details)

\[y_t = \mu_t + \gamma_t + c_t + \varepsilon_t\]

where \(y_t\) refers to the observation vector at time \(t\), \(\mu_t\) refers to the trend component, \(\gamma_t\) refers to the seasonal component, \(c_t\) refers to the cycle, and \(\varepsilon_t\) is the irregular. The modeling details of these components are given below.

Trend

The trend component is a dynamic extension of a regression model that includes an intercept and linear time-trend. It can be written:

\[\begin{split}\mu_t = \mu_{t-1} + \beta_{t-1} + \eta_{t-1} \\ \beta_t = \beta_{t-1} + \zeta_{t-1}\end{split}\]

where the level is a generalization of the intercept term that can dynamically vary across time, and the trend is a generalization of the time-trend such that the slope can dynamically vary across time.

Here \(\eta_t \sim N(0, \sigma_\eta^2)\) and \(\zeta_t \sim N(0, \sigma_\zeta^2)\).

For both elements (level and trend), we can consider models in which:

  • The element is included vs excluded (if the trend is included, there must also be a level included).
  • The element is deterministic vs stochastic (i.e. whether or not the variance on the error term is confined to be zero or not)

The only additional parameters to be estimated via MLE are the variances of any included stochastic components.

The level/trend components can be specified using the boolean keyword arguments level, stochastic_level, trend, etc., or all at once as a string argument to level. The following table shows the available model specifications:

Model name Full string syntax Abbreviated syntax Model
No trend ‘irregular’ ‘ntrend’
\[\begin{split}y_t &= \varepsilon_t\end{split}\]
Fixed intercept ‘fixed intercept’  
\[\begin{split}y_t &= \mu\end{split}\]
Deterministic constant ‘deterministic constant’ ‘dconstant’
\[\begin{split}y_t &= \mu + \varepsilon_t\end{split}\]
Local level ‘local level’ ‘llevel’
\[\begin{split}y_t &= \mu_t + \varepsilon_t \\ \mu_t &= \mu_{t-1} + \eta_t\end{split}\]
Random walk ‘random walk’ ‘rwalk’
\[\begin{split}y_t &= \mu_t \\ \mu_t &= \mu_{t-1} + \eta_t\end{split}\]
Fixed slope ‘fixed slope’  
\[\begin{split}y_t &= \mu_t \\ \mu_t &= \mu_{t-1} + \beta\end{split}\]
Deterministic trend ‘deterministic trend’ ‘dtrend’
\[\begin{split}y_t &= \mu_t + \varepsilon_t \\ \mu_t &= \mu_{t-1} + \beta\end{split}\]
Local linear deterministic trend ‘local linear deterministic trend’ ‘lldtrend’
\[\begin{split}y_t &= \mu_t + \varepsilon_t \\ \mu_t &= \mu_{t-1} + \beta + \eta_t\end{split}\]
Random walk with drift ‘random walk with drift’ ‘rwdrift’
\[\begin{split}y_t &= \mu_t \\ \mu_t &= \mu_{t-1} + \beta + \eta_t\end{split}\]
Local linear trend ‘local linear trend’ ‘lltrend’
\[\begin{split}y_t &= \mu_t + \varepsilon_t \\ \mu_t &= \mu_{t-1} + \beta_{t-1} + \eta_t \\ \beta_t &= \beta_{t-1} + \zeta_t\end{split}\]
Smooth trend ‘smooth trend’ ‘strend’
\[\begin{split}y_t &= \mu_t + \varepsilon_t \\ \mu_t &= \mu_{t-1} + \beta_{t-1} \\ \beta_t &= \beta_{t-1} + \zeta_t\end{split}\]
Random trend ‘random trend’ ‘rtrend’
\[\begin{split}y_t &= \mu_t \\ \mu_t &= \mu_{t-1} + \beta_{t-1} \\ \beta_t &= \beta_{t-1} + \zeta_t\end{split}\]

Following the fitting of the model, the unobserved level and trend component time series are available in the results class in the level and trend attributes, respectively.

Seasonal

The seasonal component is modeled as:

\[\begin{split}\gamma_t = - \sum_{j=1}^{s-1} \gamma_{t+1-j} + \omega_t \\ \omega_t \sim N(0, \sigma_\omega^2)\end{split}\]

The periodicity (number of seasons) is s, and the defining character is that (without the error term), the seasonal components sum to zero across one complete cycle. The inclusion of an error term allows the seasonal effects to vary over time (if this is not desired, \(\sigma_\omega^2\) can be set to zero using the stochastic_seasonal=False keyword argument).

This component results in one parameter to be selected via maximum likelihood: \(\sigma_\omega^2\), and one parameter to be chosen, the number of seasons s.

Following the fitting of the model, the unobserved seasonal component time series is available in the results class in the seasonal attribute.

Cycle

The cyclical component is intended to capture cyclical effects at time frames much longer than captured by the seasonal component. For example, in economics the cyclical term is often intended to capture the business cycle, and is then expected to have a period between “1.5 and 12 years” (see Durbin and Koopman).

\[\begin{split}c_{t+1} & = \rho_c (\tilde c_t \cos \lambda_c t + \tilde c_t^* \sin \lambda_c) + \tilde \omega_t \\ c_{t+1}^* & = \rho_c (- \tilde c_t \sin \lambda_c t + \tilde c_t^* \cos \lambda_c) + \tilde \omega_t^* \\\end{split}\]

where \(\omega_t, \tilde \omega_t iid N(0, \sigma_{\tilde \omega}^2)\)

The parameter \(\lambda_c\) (the frequency of the cycle) is an additional parameter to be estimated by MLE.

If the cyclical effect is stochastic (stochastic_cycle=True), then there is another parameter to estimate (the variance of the error term - note that both of the error terms here share the same variance, but are assumed to have independent draws).

If the cycle is damped (damped_cycle=True), then there is a third parameter to estimate, \(\rho_c\).

In order to achieve cycles with the appropriate frequencies, bounds are imposed on the parameter \(\lambda_c\) in estimation. These can be controlled via the keyword argument cycle_period_bounds, which, if specified, must be a tuple of bounds on the period (lower, upper). The bounds on the frequency are then calculated from those bounds.

The default bounds, if none are provided, are selected in the following way:

  1. If no date / time information is provided, the frequency is constrained to be between zero and \(\pi\), so the period is constrained to be in \([0.5, \infty]\).
  2. If the date / time information is provided, the default bounds allow the cyclical component to be between 1.5 and 12 years; depending on the frequency of the endogenous variable, this will imply different specific bounds.

Following the fitting of the model, the unobserved cyclical component time series is available in the results class in the cycle attribute.

Irregular

The irregular components are independent and identically distributed (iid):

\[\varepsilon_t \sim N(0, \sigma_\varepsilon^2)\]

Autoregressive Irregular

An autoregressive component (often used as a replacement for the white noise irregular term) can be specified as:

\[\begin{split}\varepsilon_t = \rho(L) \varepsilon_{t-1} + \epsilon_t \\ \epsilon_t \sim N(0, \sigma_\epsilon^2)\end{split}\]

In this case, the AR order is specified via the autoregressive keyword, and the autoregressive coefficients are estimated.

Following the fitting of the model, the unobserved autoregressive component time series is available in the results class in the autoregressive attribute.

Regression effects

Exogenous regressors can be pass to the exog argument. The regression coefficients will be estimated by maximum likelihood unless mle_regression=False, in which case the regression coefficients will be included in the state vector where they are essentially estimated via recursive OLS.

If the regression_coefficients are included in the state vector, the recursive estimates are available in the results class in the regression_coefficients attribute.

References

[R7](1, 2) Durbin, James, and Siem Jan Koopman. 2012. Time Series Analysis by State Space Methods: Second Edition. Oxford University Press.
class dismalpy.ssm.structural.UnobservedComponentsResults(model, params, smoother_results, cov_type='opg', cov_kwds=None, **kwargs)[source]

Class to hold results from fitting an unobserved components model.

Parameters:

model : UnobservedComponents instance

The fitted model instance

Attributes

specification (dictionary) Dictionary including all attributes from the unobserved components model instance.
autoregressive

Estimates of unobserved autoregressive component

Returns:

out: Bunch

Has the following attributes:

  • filtered: a time series array with the filtered estimate of

    the component

  • filtered_cov: a time series array with the filtered estimate of

    the variance/covariance of the component

  • smoothed: a time series array with the smoothed estimate of

    the component

  • smoothed_cov: a time series array with the smoothed estimate of

    the variance/covariance of the component

  • offset: an integer giving the offset in the state vector where

    this component begins

cycle

Estimates of unobserved cycle component

Returns:

out: Bunch

Has the following attributes:

  • filtered: a time series array with the filtered estimate of

    the component

  • filtered_cov: a time series array with the filtered estimate of

    the variance/covariance of the component

  • smoothed: a time series array with the smoothed estimate of

    the component

  • smoothed_cov: a time series array with the smoothed estimate of

    the variance/covariance of the component

  • offset: an integer giving the offset in the state vector where

    this component begins

level

Estimates of unobserved level component

Returns:

out: Bunch

Has the following attributes:

  • filtered: a time series array with the filtered estimate of

    the component

  • filtered_cov: a time series array with the filtered estimate of

    the variance/covariance of the component

  • smoothed: a time series array with the smoothed estimate of

    the component

  • smoothed_cov: a time series array with the smoothed estimate of

    the variance/covariance of the component

  • offset: an integer giving the offset in the state vector where

    this component begins

plot_components(which=None, alpha=0.05, observed=True, level=True, trend=True, seasonal=True, cycle=True, autoregressive=True, legend_loc='upper right', fig=None, figsize=None)[source]

Plot the estimated components of the model.

Parameters:

which : {‘filtered’, ‘smoothed’}, or None, optional

Type of state estimate to plot. Default is ‘smoothed’ if smoothed results are available otherwise ‘filtered’.

alpha : float, optional

The confidence intervals for the components are (1 - alpha) %

level : boolean, optional

Whether or not to plot the level component, if applicable. Default is True.

trend : boolean, optional

Whether or not to plot the trend component, if applicable. Default is True.

seasonal : boolean, optional

Whether or not to plot the seasonal component, if applicable. Default is True.

cycle : boolean, optional

Whether or not to plot the cyclical component, if applicable. Default is True.

autoregressive : boolean, optional

Whether or not to plot the autoregressive state, if applicable. Default is True.

fig : Matplotlib Figure instance, optional

If given, subplots are created in this figure instead of in a new figure. Note that the grid will be created in the provided figure using fig.add_subplot().

figsize : tuple, optional

If a figure is created, this argument allows specifying a size. The tuple is (width, height).

Notes

If all options are included in the model and selected, this produces a 6x1 plot grid with the following plots (ordered top-to-bottom):

  1. Observed series against predicted series
  2. Level
  3. Trend
  4. Seasonal
  5. Cycle
  6. Autoregressive

Specific subplots will be removed if the component is not present in the estimated model or if the corresponding keywork argument is set to False.

All plots contain (1 - alpha) % confidence intervals.

regression_coefficients

Estimates of unobserved regression coefficients

Returns:

out: Bunch

Has the following attributes:

  • filtered: a time series array with the filtered estimate of

    the component

  • filtered_cov: a time series array with the filtered estimate of

    the variance/covariance of the component

  • smoothed: a time series array with the smoothed estimate of

    the component

  • smoothed_cov: a time series array with the smoothed estimate of

    the variance/covariance of the component

  • offset: an integer giving the offset in the state vector where

    this component begins

seasonal

Estimates of unobserved seasonal component

Returns:

out: Bunch

Has the following attributes:

  • filtered: a time series array with the filtered estimate of

    the component

  • filtered_cov: a time series array with the filtered estimate of

    the variance/covariance of the component

  • smoothed: a time series array with the smoothed estimate of

    the component

  • smoothed_cov: a time series array with the smoothed estimate of

    the variance/covariance of the component

  • offset: an integer giving the offset in the state vector where

    this component begins

trend

Estimates of of unobserved trend component

Returns:

out: Bunch

Has the following attributes:

  • filtered: a time series array with the filtered estimate of

    the component

  • filtered_cov: a time series array with the filtered estimate of

    the variance/covariance of the component

  • smoothed: a time series array with the smoothed estimate of

    the component

  • smoothed_cov: a time series array with the smoothed estimate of

    the variance/covariance of the component

  • offset: an integer giving the offset in the state vector where

    this component begins