Graphical model


Graphical model

In probability theory, statistics, and machine learning, a graphical model (GM) is a graph that represents independencies among random variables by a graph in which each node is a random variable, and the missing edges between the nodes represent conditional independencies.

Two common types of GMs correspond to graphs with directed and undirected edges. If the network structure of the model is a directed acyclic graph (DAG), the GM represents a factorization of the joint probability of all random variables. More precisely, if the events are

:"X"1, ..., "X""n",

then the joint probability

:"P"("X"1, ..., "X""n"),

is equal to the product of the conditional probabilities

:P("Xi" | parents of "Xi") for "i" = 1,...,"n".

In other words, the joint distribution factors into a product of conditional distributions. Any two nodes that are not connected by an arrow are conditionally independent given the values of their parents. In general, any two sets of nodes are conditionallyindependent given a third set if a criterion called "d"-separation holds in the graph. It will turn out that the local independencies and global independecies are equivalent in Bayesian networks.

This type of graphical model is known as a directed graphical model, Bayesian network, or belief network. Classic machine learning models like hidden Markov models, neural networks and newer models such as variable-order Markov models can be considered as special cases of Bayesian networks.

Graphical models with undirected edges are generally called Markov random fields or Markov networks. A graphical model with many repeated subunits can be represented with plate notation.

A third type of graphical model is a factor graph, which is an undirected bipartite graph connecting variables and "factor nodes". Each factor represents a probability distribution over the variables it is connected to. In contrast to a Bayesian network, a factor may be connected to more than two nodes.

Applications of graphical models include speech recognition, computer vision, decoding of low-density parity-check codes, modeling of gene regulatory networks, gene finding and diagnosis of diseases.

A good reference for learning the basics of graphical models is written by Neapolitan, "Learning Bayesian networks" (2004) and another is Finn Verner Jensen's "An Introduction to Bayesian Networks" from 1996. [Cite book
author = Finn Verner Jensen
title = An Introduction to Bayesian Networks
year = 1996
publisher = Springer Verlag
location = New York
isbn = 0387915028
] A more advanced and statistically oriented book is by Cowell, Dawid, Lauritzen and Spiegelhalter, "Probabilistic networks and expert systems" (1999).

A computational reasoning approach is provided in Judea Pearl's "Probabilistic Reasoning in Intelligent Systems" from 1988Cite book
author = Judea Pearl
year = 1988
title = Probabilistic Reasoning in Intelligent Systems
edition = Revised Second Printing
location = San Mateo, CA
publisher = Morgan Kaufmann
] where the relationships between graphs andprobabilities were formally introduced.

ee also

*Markov network
*Bayesian network
*Belief propagation
* Structural equation model

References

Others

* [http://research.microsoft.com/%7Ecmbishop/PRML/Bishop-PRML-sample.pdf Graphical models, Chapter 8 of Pattern Recognition and Machine Learning by Christopher M. Bishop]
* [http://www.cs.ubc.ca/~murphyk/Bayes/bnintro.html A Brief Introduction to Graphical Models and Bayesian Networks]
* [ftp://ftp.research.microsoft.com/pub/tr/tr-95-06.pdf Heckerman's Bayes Net Learning Tutorial]
* Cite journal
author = Edoardo M. Airoldi
title = Getting Started in Probabilistic Graphical Models
journal = PLoS Computational Biology
volume = 3
issue = 12
pages = e252
year = 2007
doi = 10.1371/journal.pcbi.0030252
url = http://compbiol.plosjournals.org/perlserv/?request=get-document&doi=10.1371/journal.pcbi.0030252&ct=1


Wikimedia Foundation. 2010.

Look at other dictionaries:

  • Model selection — is the task of selecting a statistical model from a set of candidate models, given data. In the simplest cases, a pre existing set of data is considered. However, the task can also involve the design of experiments such that the data collected is …   Wikipedia

  • Model — Contents 1 Physical 1.1 Human models 2 Nonphysical 2.1 …   Wikipedia

  • Graphical Editing Framework — (GEF) is a framework that was developed for the Eclipse platform. It is known as a framework with a very steep learning curve, but it offers some benefits.GEF consists of the following components *draw2d has to be used for the View components *… …   Wikipedia

  • Model-based design — (MBD) is a mathematical and visual method of addressing problems associated with designing complex control,[1][2] signal processing[3] and communication systems. It is used in many motion control, industrial equipment, aerospace, and automotive… …   Wikipedia

  • Model-view-controller — (MVC) is an architectural pattern used in software engineering. Successful use of the pattern isolates business logic from user interface considerations, resulting in an application where it is easier to modify either the visual appearance of the …   Wikipedia

  • Model-driven architecture — (MDA) is a software design approach for the development of software systems. It provides a set of guidelines for the structuring of specifications, which are expressed as models. Model driven architecture is a kind of domain engineering, and… …   Wikipedia

  • Graphical Editing Framework — Тип фреймворк среды Eclipse для создания графического интерфейса Разработчик …   Википедия

  • Model-based testing — is the application of Model based design for designing and optionally executing the necessary artifacts to perform software testing. Models can be used to represent the desired behavior of the System Under Test (SUT), or to represent the desired… …   Wikipedia

  • Model-driven engineering — (MDE) is a software development methodology which focuses on creating and exploiting domain models (that is, abstract representations of the knowledge and activities that govern a particular application domain), rather than on the computing (or… …   Wikipedia

  • Model based design — The dawn of the electrical age brought with it various novel, innovative and advanced control systems. It was as early as 1920 s when the two strands of technology, control theory and control system, came together to produce large scale… …   Wikipedia


Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”

We are using cookies for the best presentation of our site. Continuing to use this site, you agree with this.