Generalized additive model
- Generalized additive model
In statistics, the generalized additive model (or GAM) is a statistical model developed by Trevor Hastie and Rob Tibshirani for blending properties of generalized linear models with additive models.
The model specifies a distribution (such as a normal distribution, or a binomial distribution) and a link function "g" relating the expected value of the distribution to the predictors, and attempts to fit functions "fi(xi)" to satisfy::
The functions "fi(xi)" may be fit using parametric or non-parametric means, thus providing the potential for better fits to data than other methods. The method hence is very general - a typical GAM might use a scatterplot smoothing function such as a locally weighted mean for "f1(x1)", and then use a factor model for "f2(x2)". By allowing nonparametric fits, well designed GAMs allow good fits to the training data with relaxed assumptions on the actual relationship, perhaps at the expense of interpretability of results.
Overfitting can be a problem with GAMs. The number of smoothing parameters can be specified, and this number should be reasonably small, certainly well under the degrees of freedom offered by the data. Cross-validation can be used to detect and/or reduce overfitting problems with GAMs (or other statistical methods). Other models such as GLMs may be preferable to GAMs unless GAMs improve predictive ability substantially for the application in question.
References
*cite book|author = Hastie, T. J. and Tibshirani, R. J.|title = Generalized Additive Models|publisher = Chapman & Hall/CRC|year = 1990|isbn=9780412343902
*cite book|author = Wood, S. N.|title = Generalized Additive Models: An Introduction with R|publisher = Chapman & Hall/CRC|year = 2006|isbn=9781584884743
Wikimedia Foundation.
2010.
Look at other dictionaries:
Generalized linear model — In statistics, the generalized linear model (GLM) is a flexible generalization of ordinary least squares regression. It relates the random distribution of the measured variable of the experiment (the distribution function ) to the systematic (non … Wikipedia
Potts model — In statistical mechanics, the Potts model, a generalization of the Ising model, is a model of interacting spins on a crystalline lattice. By studying the Potts model, one may gain insight into the behaviour of ferromagnets and certain other… … Wikipedia
List of statistics topics — Please add any Wikipedia articles related to statistics that are not already on this list.The Related changes link in the margin of this page (below search) leads to a list of the most recent changes to the articles listed below. To see the most… … Wikipedia
List of mathematics articles (G) — NOTOC G G₂ G delta space G networks Gδ set G structure G test G127 G2 manifold G2 structure Gabor atom Gabor filter Gabor transform Gabor Wigner transform Gabow s algorithm Gabriel graph Gabriel s Horn Gain graph Gain group Galerkin method… … Wikipedia
Outline of regression analysis — In statistics, regression analysis includes any technique for learning about the relationship between one or more dependent variables Y and one or more independent variables X. The following outline is an overview and guide to the variety of… … Wikipedia
LogitBoost — is a boosting algorithm formulated by Jerome Friedman, Trevor Hastie, and Robert Tibshirani. The original paper [Jerome Friedman, Trevor Hastie and Robert Tibshirani. Additive logistic regression: a statistical view of boosting. Annals of… … Wikipedia
GAM — may refer to:*GAM (group), or the Great Aya and Miki, a Japanese pop idol duo in Hello!Project, managed by Up Front Agency. *Generalized additive model, a statistical model *General Aggression Model, which attempts to describe the causes of human … Wikipedia
Modèle additif généralisé — En statistiques, Le modèle additif généralisé (GAM) est un modèle statistique développé par Trevor Hastie et Rob Tibshirani pour fusionner les propriétés du modèle linéaire généralisé avec celles du modèle additif. Sommaire 1 Description 2 Notes… … Wikipédia en Français
Multivariate adaptive regression splines — (MARS) is a form of regression analysis introduced by Jerome Friedman in 1991.[1] It is a non parametric regression technique and can be seen as an extension of linear models that automatically models non linearities and interactions. The term… … Wikipedia
Degrees of freedom (statistics) — In statistics, the number of degrees of freedom is the number of values in the final calculation of a statistic that are free to vary.[1] Estimates of statistical parameters can be based upon different amounts of information or data. The number… … Wikipedia
