Module:Complexity: Difference between revisions
From Santa Fe Institute Events Wiki
(Created page with '{{Complex Systems Summer School 2011 Modules}} Organized by Simon DeDeo and James O'Dwyer') |
No edit summary |
||
| (25 intermediate revisions by 3 users not shown) | |||
| Line 1: | Line 1: | ||
{{Complex Systems Summer School 2011 Modules}} | {{Complex Systems Summer School 2011 Modules}} | ||
Organized by [[ | Organized by [[Jim Crutchfield]] | ||
==Background== | |||
<ul> | |||
<li> | |||
T. Cover and J.Thomas, <i>Elements of Information Theory</i>, | |||
Wiley, Second Edition (2006) Chapters 1 - 7. | |||
<li> | |||
M. Li and P.M.B.Vitanyi, <i>An Introduction to Kolmogorov Complexity and its Applications </i>, | |||
Springer, New York (1993). | |||
<li> | |||
J. P. Crutchfield and D. P. Feldman, | |||
“Regularities Unseen, Randomness Observed: Levels of Entropy Convergence”,CHAOS | |||
<b>13</b>:1 (2003) 25-54. | |||
</ul> | |||
==Lecture Notes== | |||
<ul> | |||
<li>Thursday | |||
<ol> | |||
<li>Processes and Their Models: [[Media:ComplexityLecture1A.pdf |Complexity Lecture 1A (PDF)]] | |||
<li>Information Theory: [[Media:ComplexityLecture1B.pdf |Complexity Lecture 1B (PDF)]] | |||
<li>Information in Processes: [[Media:ComplexityLecture1C.pdf |Complexity Lecture 1C (PDF)]] | |||
<li>Memory in Processes: [[Media:ComplexityLecture1D.pdf |Complexity Lecture 1D (PDF)]] | |||
</ol> | |||
<li>Friday | |||
<ol> | |||
<li>The Learning Channel: [[Media:ComplexityLecture2A.pdf |Complexity Lecture 2A (PDF)]] | |||
<li>Causal Models: [[Media:ComplexityLecture2B.pdf |Complexity Lecture 2B (PDF)]] | |||
<li>Measures of Complexity: [[Media:ComplexityLecture2C.pdf |Complexity Lecture 2C (PDF)]] | |||
<li>Applications: [[Media:ComplexityLecture2D.pdf |Complexity Lecture 2D (PDF)]] | |||
</ol> | |||
</ul> | |||
===Ryan's talks=== | |||
<ol> | |||
<li> [[Media:Anatomy_talk.pdf | Anatomy of an Observation]] | |||
<li> [[Media:Markov_cryptic_talk.pdf | Length Scales in Complex Time Series]] | |||
</ol> | |||
==Readings== | |||
James P. Crutchfield: '''[http://tuvalu.santafe.edu/~cmg/compmech/pubs/CalcEmergTitlePage.html The Calculi of Emergence]''' | |||
Mikhail Prokopenko, Fabio Boschetti, and Alex J. Ryan: '''[http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.118.640&rep=rep1&type=pdf An Information-Theoretic Primer on Complexity, Self-Organisation and Emergence]''' | |||
Cosma Rohilla Shalizi, James P. Crutchfield: '''[http://arxiv.org/abs/cs/0001027 Pattern Discovery and Computational Mechanics]''' | |||
Ryan G. James, John R. Mahoney, Christopher J. Ellison, James P. Crutchfield: '''[http://arxiv.org/abs/1010.5545 Many Roads to Synchrony: Natural Time Scales and Their Algorithms]''' | |||
James P. Crutchfield, Christopher J. Ellison, Ryan G. James, John R. Mahoney: '''[http://arxiv.org/abs/1007.5354 Synchronization and Control in Intrinsic and Designed Computation: An Information-Theoretic Analysis of Competing Models of Stochastic Computation]''' | |||
John R. Mahoney, Christopher J. Ellison, James P. Crutchfield: '''[http://arxiv.org/abs/0905.4787 Information Accessibility and Cryptic Processes]''' | |||
Christopher J. Ellison, John R. Mahoney, James P. Crutchfield: '''[http://arxiv.org/abs/0905.3587 Prediction, Retrodiction, and The Amount of Information Stored in the Present]''' | |||
David P. Feldman, Carl S. McTague, James P. Crutchfield: '''[http://arxiv.org/abs/0806.4789 The Organization of Intrinsic Computation: Complexity-Entropy Diagrams and the Diversity of Natural Information Processing]''' | |||
Ryan G. James, Christopher J. Ellison, James P. Crutchfield: '''[http://arxiv.org/abs/1105.2988 Anatomy of a Bit: Information in a Time Series Observation]''' | |||
Joseph T. Lizier, Mikhail Prokopenko, and Albert Y. Zomaya: '''[http://chaos.aip.org/resource/1/chaoeh/v20/i3/p037109_s1?isAuthorized=no Information modification and particle collisions in distributed computation]''' | |||
Nicolas Brodu: '''[http://arxiv.org/abs/0902.0600 Reconstruction of Epsilon-Machines in Predictive Frameworks and Decisional States]''' | |||
Samer A. Abdallah, Mark D. Plumbley: '''[http://arxiv.org/abs/1012.1890 A measure of statistical complexity based on predictive information]''' | |||
Łukasz Dęowski: '''[http://arxiv.org/abs/1105.1306 Excess entropy in natural language: present state and perspectives]''' | |||
==Online Labs== | |||
'''[http://172.29.16.101:8000 CMPy Notebook]''' | |||
[[Media:Complexity_Lab_1.pdf | Complexity Lab 1]] | |||
[[Media:Complexity_Lab_2.pdf | Complexity Lab 2]] | |||
[[Media:Complexity_Lab_3.pdf | Complexity Lab 3]] | |||
[[Media:Complexity_Lab_4.pdf | Complexity Lab 4]] | |||
Latest revision as of 22:08, 30 June 2011
| Complex Systems Summer School 2011 Modules |
Organized by Jim Crutchfield
Background
- T. Cover and J.Thomas, Elements of Information Theory, Wiley, Second Edition (2006) Chapters 1 - 7.
- M. Li and P.M.B.Vitanyi, An Introduction to Kolmogorov Complexity and its Applications , Springer, New York (1993).
- J. P. Crutchfield and D. P. Feldman, “Regularities Unseen, Randomness Observed: Levels of Entropy Convergence”,CHAOS 13:1 (2003) 25-54.
Lecture Notes
- Thursday
- Processes and Their Models: Complexity Lecture 1A (PDF)
- Information Theory: Complexity Lecture 1B (PDF)
- Information in Processes: Complexity Lecture 1C (PDF)
- Memory in Processes: Complexity Lecture 1D (PDF)
- Friday
- The Learning Channel: Complexity Lecture 2A (PDF)
- Causal Models: Complexity Lecture 2B (PDF)
- Measures of Complexity: Complexity Lecture 2C (PDF)
- Applications: Complexity Lecture 2D (PDF)
Ryan's talks
Readings
James P. Crutchfield: The Calculi of Emergence
Mikhail Prokopenko, Fabio Boschetti, and Alex J. Ryan: An Information-Theoretic Primer on Complexity, Self-Organisation and Emergence
Cosma Rohilla Shalizi, James P. Crutchfield: Pattern Discovery and Computational Mechanics
Ryan G. James, John R. Mahoney, Christopher J. Ellison, James P. Crutchfield: Many Roads to Synchrony: Natural Time Scales and Their Algorithms
James P. Crutchfield, Christopher J. Ellison, Ryan G. James, John R. Mahoney: Synchronization and Control in Intrinsic and Designed Computation: An Information-Theoretic Analysis of Competing Models of Stochastic Computation
John R. Mahoney, Christopher J. Ellison, James P. Crutchfield: Information Accessibility and Cryptic Processes
Christopher J. Ellison, John R. Mahoney, James P. Crutchfield: Prediction, Retrodiction, and The Amount of Information Stored in the Present
David P. Feldman, Carl S. McTague, James P. Crutchfield: The Organization of Intrinsic Computation: Complexity-Entropy Diagrams and the Diversity of Natural Information Processing
Ryan G. James, Christopher J. Ellison, James P. Crutchfield: Anatomy of a Bit: Information in a Time Series Observation
Joseph T. Lizier, Mikhail Prokopenko, and Albert Y. Zomaya: Information modification and particle collisions in distributed computation
Nicolas Brodu: Reconstruction of Epsilon-Machines in Predictive Frameworks and Decisional States
Samer A. Abdallah, Mark D. Plumbley: A measure of statistical complexity based on predictive information
Łukasz Dęowski: Excess entropy in natural language: present state and perspectives