Network information and connected correlations.

TitleNetwork information and connected correlations.
Publication TypeJournal Article
Year of Publication2003
AuthorsSchneidman, E, Still, S, Berry, MJ, Bialek, W
JournalPhys Rev Lett
Volume91
Issue23
Pagination238701
Date Published2003 Dec 5
ISSN0031-9007
KeywordsInformation Services, Models, Genetic, Models, Neurological, Models, Theoretical
Abstract

<p>Entropy and information provide natural measures of correlation among elements in a network. We construct here the information theoretic analog of connected correlation functions: irreducible N-point correlation is measured by a decrease in entropy for the joint distribution of N variables relative to the maximum entropy allowed by all the observed N-1 variable distributions. We calculate the "connected information" terms for several examples and show that it also enables the decomposition of the information that is carried by a population of elements about an outside source.</p>

DOI10.1103/PhysRevLett.91.238701
Alternate JournalPhys. Rev. Lett.
PubMed ID14683220