Complex Systems Summer SChool 2012-Lecture Readings: Difference between revisions

Latest revision as of 20:07, 11 July 2012

Complex Systems Summer School 2012

Liz Bradley

NetLogo Lorenz attractor (Right click - save - open with Netlogo 3D)

Lorenz Water Wheel (Right click - save - open in Netlogo)

TISEAN

TISEAN 3.0.1: Nonlinear Time Series Analysis Software

Jim Crutchfield

Lecture 1.1
Lecture 1.2
Lecture 2.1
Lecture 2.2

Ryan

Information Theory for Tralfamadorians

Simon DeDeo

Thank you for your engagement, your willingness to join an adventure, and your contributions to critical debate. I look forward to following the collective output of CSSS 2012 for many years to come.

Full notes, and a bibliography, for the lectures on Computation in Natural Systems, Statistics and Stochastic Processes, and Emergence can be found at CSSS Lectures.

Josh Garland

Lab 1

Lab 2

Here is a zip archive of data files for your use in this lab:

http://tuvalu.santafe.edu/files/DAT_files.zip

Compiled TISEAN code for Mac OS-X 10.6 can be found here: I had to posted it on my website because the wiki does not accept .zip files.

John Harte

John Harte Lecture Slides

Alfred Hubler

Alfred Hubler Lecture Slides for Talk 1

Alfred Hubler Lecture Slides for Talk 2

Anne Kandler

Anne Kandler Lecture Slides

Mark Newman

Mark Newman Lecture Slides 1

Clauset / Newman Paper

Power laws, Pareto distributions and Zipf's law Paper

Mark Newman Lecture Slides 2

David Wolpert

David Wolpert Lecture Slides

Eli Ben-Naim

Sports as a Model for Competitive Societies

Sander Bais

Sander Bais Welcome Remarks

The Physics of Information, Bais and Farmer

CSSS Week Two Glue Session Slides

Quantum Theory

Cris Moore

Turing's Grand Unification, Moore and Mertens

Slides

Phase Transitions (.pdf)

Algorithms (.pdf)

Quantum computing(.pdf)

Tanmoy Bhattacharya

Inference in Historical Process 2011 CSSS Talk

Infectious Diseases 2012 CSSS Talk

Melanie Mitchell

Biologically Inspired Computing

Jeremy Van Cleve

Multilevel Selection, Evolution, and Emergence

Scott Page

Scott E. Page Lecture Slides

Ole Peters

Ole Peters Slides

Stephanie Forrest

Stephanie Forrest Lecture Slides

@@ Line 47: / Line 47: @@
 Thank you for your engagement, your willingness to join an adventure, and your contributions to critical debate. I look forward to following the collective output of CSSS 2012 for many years to come.
-===''Computation in Natural Systems''===
+Full notes, and a bibliography, for the lectures on ''Computation in Natural Systems'', ''Statistics and Stochastic Processes'', and ''Emergence'' can be found at [http://tuvalu.santafe.edu/~simon/page6/page6.html CSSS Lectures].
-Cris Moore's [http://tuvalu.santafe.edu/~moore/automata-notes.pdf Lecture notes on automata, languages, and grammars] covers, elegantly, all of the basic automata concepts in the lecture, and much more besides. A supplement to [http://www.amazon.com/The-Nature-Computation-Cristopher-Moore/dp/0199233217/ The Nature of Computation].
-Jim Crutchfield & Karl Young's paper, [http://csc.ucdavis.edu/~cmg/papers/CompOnset.pdf Computation at the Onset of Chaos] provides a detailed and compelling account of (among other things) how a naturalistic process (in this case, the logistic map) violates the bounds of both the regular and context-free grammars.
-For an introduction to the connection between (semi)groups and the regular grammars, as well as a preview of the Emergence module, see [http://arxiv.org/abs/1106.5778 Effective Theories for Circuits and Automata].
-'''Data''' on the edit histories of the George Bush wikipedia article, along with ruby code to read in and otherwise play, can be downloaded [http://santafe.edu/~simon/wiki_computation.zip here].
-===''Statistics and Stochastic Processes''===
-Overall book: David J.C. MacKay, ''[http://www.amazon.com/Information-Theory-Inference-Learning-Algorithms/dp/0521642981/ Information Theory, Inference, and Learning Algorithms]''.
-'''Lecture 1''' (Thursday)
-E.T. Jaynes' [http://prola.aps.org/abstract/PR/v106/i4/p620_1 Information Theory and Statistical Mechanics] ([http://www.rpgroup.caltech.edu/courses/aph105c/2006/articles/Jaynes1957.pdf free copy]).
-Elliott W. Montroll [http://www.pnas.org/content/78/12/7839.full.pdf On the entropy function in sociotechnical systems]. Focus on the Sears-Roebuck Catalog; we will read this critically in class. Optional: [http://tuvalu.santafe.edu/~simon/Reiss_1986_SFI.pdf Thermodynamic Treatment of Nonphysical Systems: Formalism and an Example (Single-Lane Traffic)] (with Reiss & Hammerich; see touching "Note in Closing").
-Tkacik, Schneidman, Berry, and Bialek. [http://arxiv.org/abs/q-bio/0611072 Ising Models for Networks of Real Neurons]. Optional (but compelling; see back to Montroll's PNAS paper, top left of pg. 7841): Mora and Bialek, [http://arxiv.org/abs/1012.2242 Are biological systems poised at criticality?]
-'''Lectures 2 & 3''' (Friday)
-''Null models & significance testing''. DeDeo, Krakauer & Flack. [http://rsif.royalsocietypublishing.org/content/8/62/1260 Evidence of strategic periodicities in collective conflict dynamics] ([http://arxiv.org/abs/1101.1556 free copy]). Optional: Weidmann & Toft. [http://cmp.sagepub.com/content/27/2/159 Promises and Pitfalls in the Spatial Prediction of Ethnic Violence] (a critical examination of the claims in [http://www.sciencemag.org/content/317/5844/1540.short this ''Science'' article].)
-''Parameter Estimation and Bayesian Reasoning''. Clauset, Shalizi & Newman [http://arxiv.org/abs/0706.1062 Power-law distributions in empirical data].
-''Model selection''. [http://cscs.umich.edu/~crshalizi/notebooks/model-selection.html Cosma Shalizi on Methods for Selection]. [http://www.youtube.com/watch?v=folTvNDL08A David Deutsch on Scientific Argument]. Optional: [http://www.sortie-nd.org/lme/Statistical%20Papers/Burnham_and_Anderson_2004_Multimodel_Inference.pdf Multi-Model Inference (AIC)].
-'''Data''' and analysis code for the seating of students in the June 14th lecture, including basic code to implement null models for gender and field distribution, is available [http://santafe.edu/~simon/seating_game.zip here].
-'''Additional material''' on the thermodynamics of computation. Bennett, [http://www.springerlink.com/content/jn7x3365386phn46/ the Thermodynamics of Computation—a Review] ([http://www.dna.caltech.edu/courses/cs191/paperscs191/IBMJTheorPhys(21)905.pdf free copy]). Landauer, [http://iopscience.iop.org/1402-4896/35/1/021 Computation: a Fundamental Physical View] ([http://webout.weizmann.ac.il/complex/tlusty/courses/InfoInBio/Papers/Landauer1987.pdf free copy]). Anthology of articles: [http://www.amazon.com/Maxwells-Demon-Classical-Information-Computing/dp/0750307595/ Maxwell's Demon 2]
-==Emergence==
-We gave two accounts of emergence: one dealing largely with the properties of a system under coarse graining, the other dealing with the phenomenon of symmetry breaking.
-The former, discussed in Lectures One and Two is less thought about. [http://chaos.aip.org/resource/1/chaoeh/v21/i3/p037106_s1 Effective Theories for Circuits and Automata] ([http://arxiv.org/abs/1106.5778 free copy]) makes a case for the use of coarse-graining and renormalization (Lecture One) in computational/functional systems using the Krohn-Rhodes theorem (Lecture Two) for the construction of theories that show incommensurate symmetries.
-The latter is much more widely discussed, and has made its way into the literature beyond the physical and mathematical sciences.
-'''Lecture 1''' (Monday morning)
-Aggregation (''i.e.'', considering a system with more and more agents) [http://www.worldscibooks.com/etextbook/4016/4016_chap02.pdf One Particle and Many] (skip Sec. 2.3 unless you are near zero Kelvin.) The [http://www.worldscibooks.com/etextbook/4016/4016_chap03.pdf Central Limit Theorem] as an example of "Universality" (skip Sec. 3.4 on Lattice Green Functions, unless you live in a crystal.) Both from Leo Kadanoff's readable (if you have some background in physics, chemistry or biochemistry) book [http://www.amazon.com/Statistical-Physics-Statics-Dynamics-Remormalization/dp/9810237588 Statistical Physics: Statics, Dynamics and Renormalization].
-The failure of Black-Scholes is discussed from the Mandelbrot point of view in many places, including [http://www.amazon.com/The-Misbehavior-Markets-Financial-Turbulence/dp/0465043577/ The Misbehavior of Markets]. The somewhat ''less'' media (and physicist!) friendly account by Warren Buffet on how the non-stationary variance of the market functions is also worth reading, from [http://www.berkshirehathaway.com/letters/2008ltr.pdf his 2008 letter to shareholders] (page 19.)
-Robert Batterman's book, [http://www.amazon.com/The-Devil-Details-Asymptotic-Explanation/dp/0195314883/ Asymptotic Reasoning in Explanation, Reduction, and Emergence] has a very readable accounts of "explanation" (your lecturer does not follow his latter account of emergence, which we discussed in a very different fashion.)
-Our account of coarse-graining and renormalization group flow draws (hopefully clearly) from the very technical literature. One nice place to look if you have a physics mind-set is Michael Fisher's article, Ch. IV.8, in [http://www.amazon.com/Conceptual-Foundations-Quantum-Field-Theory/dp/0521602726/ Conceptual Foundations of Quantum Field Theory] (which includes a number of amazing articles, if you are of that mindset, on renormalization, effective theories, and emergence.)
-''Lecture 2'' (Monday afternoon)
-Techniques for finding the Bayesian best-match probabilistic finite state machine (a.k.a., Hidden Markov Model) for a particular string of observed behavior are described in [http://www.amazon.com/Numerical-Recipes-3rd-Edition-Scientific/dp/0521880688/ Numerical Recipes, 3rd. Ed.] (Press ''et al.'') Chapter 16.3. [http://www.kanungo.com/software/software.html Tapas Kanungo] has a nice implementation of the E-M algorithm that is (somewhat) industry standard for the simple case.
-We played Contrapunctus XIV in an arrangement for strings by the [http://itunes.apple.com/us/album/bach-the-art-of-fugue/id5754479 Emerson String Quartet]. Then we played it again in MIDI form in Mathematica, then we truncated to the top two voices, and shifted both into a single octave to arrive at the process with only 104 output symbols (some of the 12x12 possible chords Bach did not use.) Then we tried to fit this process by a 12-state Hidden Markov Model. It did not sound very good, and this allowed us to discuss the limitations of finite state machines for processes with multiple timescales, hierarchies of interacting processes, and systems of greater computation complexity (''e.g.'', the parenthesis-matching game.)
-You may want to know how far Machine Learning can be pushed to produce "Bach-like" music, and whether (approximations to) higher-complexity processes might improve it. This is discussed in charming detail in [http://lss.fnal.gov/archive/other/print-93-0456.pdf Baroque Forecasting], by Matthew Durst and Andres S. Weigend, from an early meeting at SFI.
-Group Theory, and the extension of the Jordan-Holder decomposition of groups to semigroups (''i.e.'', the more general class of finite state machines with irreversible operations, such as the ABBA machine), forms a central theme of our discussion. Some very charming introductions to group theory exist (if one is not able to attend Douglas Hofstadter's classes at I.U.!) -- one perhaps suitable for visual thinkers is [http://www.amazon.com/gp/product/088385757X/ Visual Group Theory].
-The Krohn-Rhodes theorem, which proves the consistency of a hierarchy of coarse-grainings for finite state machines, gets complicated. References to excellent papers by Christopher Nehaniv, Attila Egri-Nagy, and others can be found in the Effective Theories paper referenced above. The "Wild Book", photocopied and passed around in the 1970s, that made the case for the importance of the theorem, is now re-issued in a revised and edited version as [http://www.amazon.com/Applications-Automata-Theory-Algebra-Mathematical/dp/9812836977/ Applications of Automata Theory and Algebra: Via the Mathematical Theory of Complexity to Biology, Physics, Psychology, Philosophy, and Games] (just in case you thought there was something it might not apply to.)
-'''Lecture 3''' (Tuesday morning)
-Our account of symmetry breaking as a canonical form of emergence is inspired by the foundational article [http://www.sciencemag.org/content/177/4047/393.citation More is Different] ([http://robotics.cs.tamu.edu/dshell/cs689/papers/anderson72more_is_different.pdf free copy]), by SFI co-founder Phil Anderson.
-The discussion of symmetry breaking in turbulence as one alters the control parameter is described elegantly in the beginning of [http://www.amazon.com/Turbulence-Legacy-N-Kolmogorov/dp/0521457130/ Uriel Frisch's ''Turbulence''].
-[http://www.lassp.cornell.edu/sethna/pubPDF/OrderParameters.pdf Order Parameters, Broken Symmetry, and Topological Defects], by James P. Sethna is a readable and clear account of how this plays out in physics (that gets very advanced by the end!)
-Our major example of a phase transition in a social/decision-making system was that found for the Minority Game when agents build strategies out of a finite-history list, from a paper by [http://pre.aps.org/abstract/PRE/v60/i6/pR6271_1 Damien Challet and Matteo Marsili] ([http://arxiv.org/abs/cond-mat/9904071 free copy]). An excellent summary of what we know about the humble El Farol bar is at [http://www.amazon.com/Minority-Games-Interacting-Financial-Markets/dp/0198566409/ Minority Games: Interacting Agents in Financial Markets].
 ==Josh Garland==
@@ Line 208: / Line 136: @@
 [[Media:scottepagelectureslides.pdf | Scott E. Page Lecture Slides]]
+==Ole Peters==
+[[Media:oleslides.pdf | Ole Peters Slides]]
+==Stephanie Forrest==
+[[Media:stephanieforrestslides.pdf | Stephanie Forrest Lecture Slides]]