Actions

Difference between revisions of "Module:Complexity"

From Santa Fe Institute Events Wiki

(Background)
 
(15 intermediate revisions by 2 users not shown)
Line 6: Line 6:
 
<ul>
 
<ul>
 
<li>
 
<li>
T. Cover and J.Thomas, Elements of Information Theory,
+
T. Cover and J.Thomas, <i>Elements of Information Theory</i>,
 
Wiley, Second Edition (2006) Chapters 1 - 7.
 
Wiley, Second Edition (2006) Chapters 1 - 7.
 
<li>
 
<li>
M. Li and P.M.B.Vitanyi, An Introduction to Kolmogorov Complexity and its Applications,
+
M. Li and P.M.B.Vitanyi, <i>An Introduction to Kolmogorov Complexity and its Applications </i>,
 
Springer, New York (1993).
 
Springer, New York (1993).
 
<li>
 
<li>
Line 16: Line 16:
 
<b>13</b>:1 (2003) 25-54.
 
<b>13</b>:1 (2003) 25-54.
 
</ul>
 
</ul>
 +
 +
==Lecture Notes==
 +
<ul>
 +
<li>Thursday
 +
  <ol>
 +
  <li>Processes and Their Models: [[Media:ComplexityLecture1A.pdf |Complexity Lecture 1A (PDF)]]
 +
  <li>Information Theory: [[Media:ComplexityLecture1B.pdf |Complexity Lecture 1B (PDF)]]
 +
  <li>Information in Processes: [[Media:ComplexityLecture1C.pdf |Complexity Lecture 1C (PDF)]]
 +
  <li>Memory in Processes: [[Media:ComplexityLecture1D.pdf |Complexity Lecture 1D (PDF)]]
 +
  </ol>
 +
<li>Friday
 +
  <ol>
 +
  <li>The Learning Channel: [[Media:ComplexityLecture2A.pdf |Complexity Lecture 2A (PDF)]]
 +
  <li>Causal Models: [[Media:ComplexityLecture2B.pdf |Complexity Lecture 2B (PDF)]]
 +
  <li>Measures of Complexity: [[Media:ComplexityLecture2C.pdf |Complexity Lecture 2C (PDF)]]
 +
  <li>Applications: [[Media:ComplexityLecture2D.pdf |Complexity Lecture 2D (PDF)]]
 +
  </ol>
 +
</ul>
 +
 +
===Ryan's talks===
 +
<ol>
 +
<li> [[Media:Anatomy_talk.pdf | Anatomy of an Observation]]
 +
<li> [[Media:Markov_cryptic_talk.pdf | Length Scales in Complex Time Series]]
 +
</ol>
  
 
==Readings==
 
==Readings==
  
'''[http://tuvalu.santafe.edu/~cmg/compmech/pubs/CalcEmergTitlePage.html The Calculi of Emergence]'''
+
James P. Crutchfield: '''[http://tuvalu.santafe.edu/~cmg/compmech/pubs/CalcEmergTitlePage.html The Calculi of Emergence]'''
  
'''[http://arxiv.org/abs/cs/0001027 Pattern Discovery and Computational Mechanics]'''
+
Mikhail Prokopenko, Fabio Boschetti, and Alex J. Ryan: '''[http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.118.640&rep=rep1&type=pdf An Information-Theoretic Primer on Complexity, Self-Organisation and Emergence]'''
  
'''[http://arxiv.org/abs/1105.2988 Anatomy of a Bit]'''
+
Cosma Rohilla Shalizi, James P. Crutchfield: '''[http://arxiv.org/abs/cs/0001027 Pattern Discovery and Computational Mechanics]'''
  
==Links==
+
Ryan G. James, John R. Mahoney, Christopher J. Ellison, James P. Crutchfield: '''[http://arxiv.org/abs/1010.5545 Many Roads to Synchrony: Natural Time Scales and Their Algorithms]'''
 +
 
 +
James P. Crutchfield, Christopher J. Ellison, Ryan G. James, John R. Mahoney: '''[http://arxiv.org/abs/1007.5354 Synchronization and Control in Intrinsic and Designed Computation: An Information-Theoretic Analysis of Competing Models of Stochastic Computation]'''
 +
 
 +
John R. Mahoney, Christopher J. Ellison, James P. Crutchfield: '''[http://arxiv.org/abs/0905.4787 Information Accessibility and Cryptic Processes]'''
 +
 
 +
Christopher J. Ellison, John R. Mahoney, James P. Crutchfield: '''[http://arxiv.org/abs/0905.3587 Prediction, Retrodiction, and The Amount of Information Stored in the Present]'''
 +
 
 +
David P. Feldman, Carl S. McTague, James P. Crutchfield: '''[http://arxiv.org/abs/0806.4789 The Organization of Intrinsic Computation: Complexity-Entropy Diagrams and the Diversity of Natural Information Processing]'''
 +
 
 +
Ryan G. James, Christopher J. Ellison, James P. Crutchfield: '''[http://arxiv.org/abs/1105.2988 Anatomy of a Bit: Information in a Time Series Observation]'''
 +
 
 +
Joseph T. Lizier, Mikhail Prokopenko, and Albert Y. Zomaya: '''[http://chaos.aip.org/resource/1/chaoeh/v20/i3/p037109_s1?isAuthorized=no Information modification and particle collisions in distributed computation]'''
 +
 
 +
Nicolas Brodu: '''[http://arxiv.org/abs/0902.0600 Reconstruction of Epsilon-Machines in Predictive Frameworks and Decisional States]'''
 +
 
 +
Samer A. Abdallah, Mark D. Plumbley: '''[http://arxiv.org/abs/1012.1890 A measure of statistical complexity based on predictive information]'''
 +
 
 +
Łukasz Dęowski: '''[http://arxiv.org/abs/1105.1306 Excess entropy in natural language: present state and perspectives]'''
 +
 
 +
==Online Labs==
  
 
'''[http://172.29.16.101:8000 CMPy Notebook]'''
 
'''[http://172.29.16.101:8000 CMPy Notebook]'''
 +
 +
[[Media:Complexity_Lab_1.pdf | Complexity Lab 1]]
 +
 +
[[Media:Complexity_Lab_2.pdf | Complexity Lab 2]]
 +
 +
[[Media:Complexity_Lab_3.pdf | Complexity Lab 3]]
 +
 +
[[Media:Complexity_Lab_4.pdf | Complexity Lab 4]]

Latest revision as of 22:08, 30 June 2011

Complex Systems Summer School 2011 Modules

Organized by Jim Crutchfield

Background

  • T. Cover and J.Thomas, Elements of Information Theory, Wiley, Second Edition (2006) Chapters 1 - 7.
  • M. Li and P.M.B.Vitanyi, An Introduction to Kolmogorov Complexity and its Applications , Springer, New York (1993).
  • J. P. Crutchfield and D. P. Feldman, “Regularities Unseen, Randomness Observed: Levels of Entropy Convergence”,CHAOS 13:1 (2003) 25-54.

Lecture Notes

Ryan's talks

  1. Anatomy of an Observation
  2. Length Scales in Complex Time Series

Readings

James P. Crutchfield: The Calculi of Emergence

Mikhail Prokopenko, Fabio Boschetti, and Alex J. Ryan: An Information-Theoretic Primer on Complexity, Self-Organisation and Emergence

Cosma Rohilla Shalizi, James P. Crutchfield: Pattern Discovery and Computational Mechanics

Ryan G. James, John R. Mahoney, Christopher J. Ellison, James P. Crutchfield: Many Roads to Synchrony: Natural Time Scales and Their Algorithms

James P. Crutchfield, Christopher J. Ellison, Ryan G. James, John R. Mahoney: Synchronization and Control in Intrinsic and Designed Computation: An Information-Theoretic Analysis of Competing Models of Stochastic Computation

John R. Mahoney, Christopher J. Ellison, James P. Crutchfield: Information Accessibility and Cryptic Processes

Christopher J. Ellison, John R. Mahoney, James P. Crutchfield: Prediction, Retrodiction, and The Amount of Information Stored in the Present

David P. Feldman, Carl S. McTague, James P. Crutchfield: The Organization of Intrinsic Computation: Complexity-Entropy Diagrams and the Diversity of Natural Information Processing

Ryan G. James, Christopher J. Ellison, James P. Crutchfield: Anatomy of a Bit: Information in a Time Series Observation

Joseph T. Lizier, Mikhail Prokopenko, and Albert Y. Zomaya: Information modification and particle collisions in distributed computation

Nicolas Brodu: Reconstruction of Epsilon-Machines in Predictive Frameworks and Decisional States

Samer A. Abdallah, Mark D. Plumbley: A measure of statistical complexity based on predictive information

Łukasz Dęowski: Excess entropy in natural language: present state and perspectives

Online Labs

CMPy Notebook

Complexity Lab 1

Complexity Lab 2

Complexity Lab 3

Complexity Lab 4