Module:Complexity

Complex Systems Summer School 2011 Modules Home Schedule Concepts: Nonlinearity Networks Computation Robustness Evolution Complexity Emergence Machine Learning

Organized by Jim Crutchfield

Background

• T. Cover and J.Thomas, Elements of Information Theory, Wiley, Second Edition (2006) Chapters 1 - 7.
• M. Li and P.M.B.Vitanyi, An Introduction to Kolmogorov Complexity and its Applications , Springer, New York (1993).
• J. P. Crutchfield and D. P. Feldman, “Regularities Unseen, Randomness Observed: Levels of Entropy Convergence”,CHAOS 13:1 (2003) 25-54.

Lecture Notes

• Thursday
  1. Processes and Their Models: Complexity Lecture 1A (PDF)
  2. Information Theory: Complexity Lecture 1B (PDF)
  3. Information in Processes: Complexity Lecture 1C (PDF)
  4. Memory in Processes: Complexity Lecture 1D (PDF)
• Friday
  1. The Learning Channel: Complexity Lecture 2A (PDF)
  2. Causal Models: Complexity Lecture 2B (PDF)
  3. Measures of Complexity: Complexity Lecture 2C (PDF)
  4. Applications: Complexity Lecture 2D (PDF)

Ryan's talks

1. Anatomy of an Observation
2. Length Scales in Complex Time Series

Readings

James P. Crutchfield: The Calculi of Emergence

Mikhail Prokopenko, Fabio Boschetti, and Alex J. Ryan: An Information-Theoretic Primer on Complexity, Self-Organisation and Emergence

Cosma Rohilla Shalizi, James P. Crutchfield: Pattern Discovery and Computational Mechanics

Ryan G. James, John R. Mahoney, Christopher J. Ellison, James P. Crutchfield: Many Roads to Synchrony: Natural Time Scales and Their Algorithms

James P. Crutchfield, Christopher J. Ellison, Ryan G. James, John R. Mahoney: Synchronization and Control in Intrinsic and Designed Computation: An Information-Theoretic Analysis of Competing Models of Stochastic Computation

John R. Mahoney, Christopher J. Ellison, James P. Crutchfield: Information Accessibility and Cryptic Processes

Christopher J. Ellison, John R. Mahoney, James P. Crutchfield: Prediction, Retrodiction, and The Amount of Information Stored in the Present

David P. Feldman, Carl S. McTague, James P. Crutchfield: The Organization of Intrinsic Computation: Complexity-Entropy Diagrams and the Diversity of Natural Information Processing

Ryan G. James, Christopher J. Ellison, James P. Crutchfield: Anatomy of a Bit: Information in a Time Series Observation

Joseph T. Lizier, Mikhail Prokopenko, and Albert Y. Zomaya: Information modification and particle collisions in distributed computation

Nicolas Brodu: Reconstruction of Epsilon-Machines in Predictive Frameworks and Decisional States

Samer A. Abdallah, Mark D. Plumbley: A measure of statistical complexity based on predictive information

Łukasz Dęowski: Excess entropy in natural language: present state and perspectives

Online Labs

CMPy Notebook

Complexity Lab 1

Complexity Lab 2

Complexity Lab 3

Complexity Lab 4