This repository holds the Generalized Method of Wavelet Moments (GMWM) R package. This estimation technique was introduces in Guerrier et al. (2013) and uses the wavelet variance in a moment-matching spirit to estimate parameters of time series models such as ARMA or state-space models.
The GMWM was initially motivated by the need to estimate the parameters of complex state-space models used in various engineering applications. In short, this approach uses the quantity called Wavelet Variance (WV) in the spirit of a GMM estimator. This method is often the only feasible estimation approach that can be applied for complex models which are used in engineering and natural sciences. In particular, the GMWM is computationally efficient and, unlike most likelihood-based techniques, it can be applied to massive time dependent datasets which are becoming increasingly common. For example, one of the first applications of this method was in the field of engineering where the GMWM was used to solve “sensor calibration” problems which are of great interest in different domains such as Aerospace, Robotics or Geomatics and entails large amounts of data (typically tens of millions of observations). In this context the GMWM has been demonstrated to represent a considerable improvement compared to benchmark methods (see e.g. Stebler et al. 2014 for details) both in terms of statistical accuracy and computational efficiency.
Building on the generality and flexibility of the GMWM, the estimation framework was enlarged to also include robust estimators, leading to a robust version of GMWM (RGMWM), in Guerrier et al. (2020). Due to its computational efficiency, the GMWM is able to easily estimate complex time series and spatial models in circumstances where traditional methods have considerable computational and numerical issues, adding the robust estimation layer with only a marginal increase in computational complexity.
Below are examples of the features of the gmwm package.
To start, let’s generate a time series from a simple model, which is a AR(1) process with measurement error (white noise):
# Sample size
n = 10^4
# Specify model
model = AR1(phi = .98, sigma2 = .02) + WN(sigma2 = 1)
# Generate Data
Xt = gen_gts(n = n, model = model)Once we have data, we can see what the wavelet variance looks like:
# Compute Haar WV
wv_Xt = wvar(Xt)
plot(wv_Xt)
wv_Yt = wvar(Yt)
In the second time series, we introduce a few (1%) of "extreme" (outliers):
# Copy data and add "outliers"
Yt = Xt
Yt[sample(1:n, round(0.01*n))] = rnorm(round(0.01*n), 0, 3^2)
# Plot the data
plot(wv.classical)
# Calculate robust wavelet variance
wv.robust = wvar(d, robust = TRUE, eff = 0.6)
# Compare both versions
compare_wvar(wv.classical, wv.robust)Now, let’s try to estimate it with specific (e.g. user supplied) and guessed (e.g. program generated) parameters.
## Estimation Modes ##
# Use a specific initial starting value
o.specific = gmwm_imu(AR1(phi=.98,sigma2=.05) + WN(sigma2=.95), data = d)
# Let the program guess a good starting value
o.guess = gmwm_imu(AR1()+WN(), data = d)To run inference or view the parameter estimates, we do:
## View Model Info ##
# Standard summary
summary(o.specific)
# View with asymptotic inference
summary(o.specific, inference = T)
# View with bootstrapped inference
summary(o.specific, inference = T, bs.gof = T)Alternatively, we can let the program try to figure out the best model for the data using the Wavelet Information Criteria (WIC):
## Model selection ##
# Separate Models - Compares 2*AR1() and AR1() + WN() under common model 2*AR1() + WN()
# Note: This function created a shared model (e.g. 2*AR1() + WN()) if not supplied to obtain the WIC.
ms.sep = rank_models(AR1()+WN(), 2*AR1(), data = d, model.type="imu")
# Nested version - Compares AR1() + WN(), AR1(), WN()
ms.nested = rank_models(AR1()+WN(), data = d, nested = TRUE, model.type = "imu")
# Bootstrapped Optimism
ms.bs = rank_models(AR1()+WN(), WN(), data = d, bootstrap = TRUE, model.type = "imu")
# See automatic selection fit
plot(ms.sep)
# View model picked:
summary(ms.sep)Last, but certainly not least, we can also approximate a contaminated sample with robust methodology:
## Data generation ##
# Specify model
model = AR1(phi = .99, sigma2 = .01) + WN(sigma2 = 1)
# Generate Data
set.seed(213)
N = 1e3
sim.ts = gen_gts(n, model)
# Contaminate Data
cont.eps = 0.01
cont.num = sample(1:N, round(N*cont.eps))
sim.ts[cont.num,] = sim.ts[cont.num,] + rnorm(round(N*cont.eps),0,sqrt(100))
# Plot the data
plot(sim.ts)
# Classical Wavelet Variance
wv.classic = wvar(sim.ts)
# Robust Wavelet Variance
wv.robust = wvar(sim.ts, robust = TRUE, eff = 0.6)
# Plot the Classical vs. Robust WV
compare_wvar(wv.classic, wv.robust, split = FALSE)
# Run robust estimation
o = gmwm_imu(model, sim.ts, robust = TRUE, eff = 0.6)
# Robust information
summary(o)The installation process with CRAN is the simplest
install.packages("gmwm")Installing the package this way gives you access to stable features. Furthermore, the installation itself does not require a compiler or preinstalling any dependencies. However, we are limited to updating the package on CRAN to once every month. Thus, there may be some lag between when features are developed and when they are available on this version.
For users who are interested in having the latest and greatest developments withing wavelets or GMWM methodology, this option is ideal. Though, there is considerably more work that a user must do to have a stable version of the package. The setup to obtain the development version is platform dependent.
Specifically, one must have a compiler installed on your system that is compatible with R.
For help on obtaining a compiler consult:
Depending on your operating system, further requirements exist such as:
OS X
Some user report the need to use X11 to suppress shared library errors. To install X11, visit xquartz.org
Linux
Both curl and libxml are required.
For Debian systems, enter the following in terminal:
sudo apt-get install curl libcurl3 libcurl3-dev libxml2 libxml2-devFor RHEL systems, enter the following in terminal:
sudo yum install curl curl-devel libxml2 libxml2-devAll Systems
With the system dependency taken care of, we continue on by installing the R specific package dependencies and finally the package itself by doing the following in an R session:
# Install dependencies
install.packages(c("RcppArmadillo","ggplot2","reshape2","devtools","knitr","rmarkdown"))
# Install the package from GitHub without Vignettes/User Guides
devtools::install_github("SMAC-Group/gmwm")
# Install the package from GitHub with Vignettes/User Guides
# Note: This will be a longer install as the vignettes must be built.
devtools::install_github("SMAC-Group/gmwm", build_vignettes = TRUE)The license this source code is released under is the GNU AFFERO GENERAL PUBLIC LICENSE (AGPL) v3.0. In some cases, the GPL license does apply. However, in the majority of the cases, the license in effect is the GNU AFFERO GENERAL PUBLIC LICENSE (AGPL) v3.0 as the computational code is heavily dependent on Armadilllo, which use the MPL license that enables us to recast our code to use the GNU AFFERO GENERAL PUBLIC LICENSE (AGPL) v3.0. See the LICENSE file for full text. Otherwise, please consult TLDR Legal or GNU which will provide a synopsis of the restrictions placed upon the code. Please note, this does NOT excuse you from talking about licensing with a lawyer!
Guerrier, Stéphane, Roberto Molinari, Maria-Pia Victoria-Feser, and Haotian Xu. 2020. “Robust Two-Step Wavelet-Based Inference for Time Series Models.”
Guerrier, Stéphane, Jan Skaloud, Yannick Stebler, and Maria-Pia Victoria-Feser. 2013. “Wavelet-Variance-Based Estimation for Composite Stochastic Processes.” Journal of the American Statistical Association 108 (503). Taylor & Francis: 1021–30.
Stebler, Yannick, Stephane Guerrier, Jan Skaloud, and Maria-Pia Victoria-Feser. 2014. “Generalized Method of Wavelet Moments for Inertial Navigation Filter Design.” IEEE Transactions on Aerospace and Electronic Systems 50 (3). IEEE: 2269–83.