The Science of Thinking and Deciding

This whole thing started when I picked up a pink hardbound second-hand copy of The Black Swan by Nassim Nicholas Taleb at the famous Blossoms Book House in Church Street, Bangalore. He minces no words when pouring scorn on the financial sector and the “pseudo-science” that he claims they use to certify risky decisions that are motivated by short-term bonuses. I get that. I think I will change my investment strategies as a result! He summarizes, very well, the impact of events that were unforeseen and helps you with ideas on how to benefit from them while not getting steamrolled. This is a remarkably prescient book that foreshadowed the financial crisis and events such as the Arab Spring even though his philosophy eschews prediction and favours robustness in planning and preparedness in the face of such adversity. A friend of mine who read this book was put off by the amount of mud thrown on to academicians. But I feel that researchers need criticism to constantly improve research methodologies and words need not be minced as long as personal attacks are not made. The process by which research is published today leaves much to be desired and more on this later.

One little thing I liked was the fact that the book started with an Umberto Eco reference where he talks about Eco’s large library, the majority of whose books were unread. Umberto Eco is an old favourite of mine and I have read several of his fiction and non-fiction books. Taleb calls him encyclopaedic and this is visible in every chapter of any of Eco’s books. The reference to Eco made me feel good about all the books I keep buying and don’t end up reading immediately (Fooled by Randomness by Taleb is sitting unread in my bookshelf!). Taleb’s point is that one has a library not to fill it with more and more books as a matter of vanity but rather as a research tool. Having as much content as possible about what you don’t know is great for research and to keep you grounded! So it’s OK if you haven’t read every chapter of every book that you own. Taleb calls this great mountain of unread books the anti-library – a cool term in my opinion.

Reading this book led to several other books that I read thereafter. Thinking, Fast and Slow by Daniel Kahneman, (and the shadow of the posthumous influence of his research partner, Amos Tversky) summarizes a few lifetimes worth of quality research into how people think and how they make decisions. How does our mind think about stuff and store or retrieve memories? How do we arrive at judgements and biases? How do we learn skills and can do some things almost subconsciously (intuition)? How do we make decisions in the face of the choices we have in real life? The difficult questions, an insane amount of experimentation, great anecdotes and good quality writing about the findings will undoubtedly leave an impact on the reader. The book explains the different cognitive systems we use and how we train them. It delves into decision making and how the human mind processes risk. The main link in terms of ideas between these 2 books is that humans don’t deal with randomness, uncertainty and risk very well.¬†Even if those humans are statisticians and trained experts! The other important link is empiricism, which in this context (human behavior, economics etc.) means learn from experimentation and observation rather than established notions or theories. Taleb stresses that empiricism and healthy skepticism are vital for humans in this technology-driven world. Kahneman’s significant body of research uses this principle at every step. I would highly recommend this book. In terms of tone, it is exactly the opposite of Taleb’s! Reverential when talking about good research and politely criticizing the bad.

Taleb refers a lot to Karl Popper who I learned was a very important philosopher of science. I bought some of his masterpieces and they are currently in my anti-library! The writing is all pre-World War II and I am finding it difficult to switch from the more accessible language of the modern books I’ve been reading lately.

My friend (the one who wasn’t so thrilled with Taleb) then pointed me to How Not To Be Wrong by Jordan Ellenberg. Ellenberg was a child prodigy and is an accomplished mathematician. While I cannot judge his research, his ability to teach is amazing and you can experience that throughout this great book.¬† I never realized until I read this book that concepts like non-linearity, regression, correlation, probability, hypothesis testing and randomness could be taught so intuitively and used so powerfully. The concepts that link this to Taleb’s writing is Ellenberg’s critique on how these concepts are misused in when publishing academic research and the lack of importance given to simple things like sample size and repeating an experiment to verify original research. Taleb pours scorn into the gaping holes of academic research and Ellenberg suggests how to cement these voids. That is the difference. Kahneman shows how the typical process of “thinking and deciding” works and Ellenberg shows how you can use math to get better at it. Ellenberg is engaging and funny. He has done a humungous amount of reading and research into how mathematicians codified these concepts and he picks out some absolute gems. There was one anecdote in the section on regression where Hotelling delivers a “statistical smackdown” on the pointlessness of a gigantic research undertaking by Secrist to demonstrate what Hotelling called an “obvious mathematical fact”. This made me laugh for the better part of an hour and I did not expect that from a book written by a mathematician about how math should be used. May be the lack of expectation increased the pleasure (utils as Ellenberg might call it) I felt!

The differences in tone and writing style almost stereotypically correlate with age as I noted that Kahneman is in his 80s, Taleb in his 50s and Ellenberg in the 40s. Taleb’s time spent in hostile environments like the Lebanese civil war or Wall Street probably explains why he is so easily outraged when he thinks he sees incompetence.

I tend to read a series of books on any given topic right from school days. There was a Frederick Forsyth phase, a Robert Ludlum phase, a William Dalrymple phase which led into other engaging travel and history books by Robert Byron, Paul Theroux, Charles Allen, Pico Iyer and the like, a scientific phase with Jared Diamond, Richard Dawkins, Simon Singh, Siddharta Mukherjee, V.S. Ramachandran and others. They have all been rewarding in their own way and this one – the Thinking and Deciding phase – is now up there with some of the most fulfilling series of reading I’ve done.




Asimov’s Psychohistory and Physics

Celebrated Sci-fi writer Isaac Asimov came up with a very intriguing premise for his classic Foundation Series. The character who sets off the events of the series, Hari Seldon, is a Professor of Mathematics who develops a statistical method – the creatively named psychohistory – to predict the future course of “humanity” which is now spread across billions of planets in a Galaxy and is of the order of one quintillion. Using his methods, he predicts that the Galactic Empire will fail (inspired by Edward Gibbon’s History of the Decline and Fall of the Roman Empire). He predicted that the dark age following this event would last thirty thousand years. Presumably using his model’s predictive powers, he creates a plan of interventions (the “Seldon Plan”) that would limit this to a thousand years instead and puts it in action. The method is explained to be a marriage of statistics and sociology assuming a huge population and some sociological precepts like Mass Action.

What has this got to do with Physics? I recently read a few interesting popular science books – In Search of Schrodinger’s Cat by John Gribbin, Albert Einstein’s Relativity: The Special and the General Theory and Cycles of Time by Roger Penrose. The first was written in very simple language and left me with a decent grasp of the ideas of Quantum Theory without delving into the Math. The relevant point to this topic from this book was the fact that the mathematics told us weird things like an electron moving forward in time was equivalent to a positron moving backward in time! What meaning then does time have? The second was a surprisingly lucid book as well and provided a good understanding of Relativity theory. The third I suspect is a brilliant book but I barely understood it. The concept was that Entropy increases with time and ultimately the Universe is filled with mass-less red-shifted photons where distance loses all meaning and this state can become the starting point of a new Big Bang (which is supposed to be a very low entropy state). Gravity plays a huge part in these sequence of events (like smashing black-holes together for example). The mathematics and the geometry were easily beyond me. But what I learned using these readings is that apparently Entropy is the only physical concept that gives meaning to the concept of time.

Further to this I came across an interesting article – A New Physics Theory of Life – from about a year ago on research by Jeremy England from MIT. I then read the original paper that triggered the media hype – Statistical Physics of Self-replication – which basically tries to explain that a biological process like self-replication is inevitable if we follow through with the ideas of Entropy and Thermodynamics in a statistical sense. It seems to say that, in its inexorable march towards higher and higher entropy, the Universe inevitably gives rise to life because life is a system that can work very close to perfect thermodynamic efficiency and give rise to disorder much more effectively! The questions this research raises are several. Intelligent life is capable of increasing entropy much faster than the lazy mammals! Is that why we evolved? Where then do we go from here? Can we predict the broad contours of our future using the statistics of entropy and thermodynamics? Especially with billions on humans on our planet and may be several other intelligent species across other planets in our galaxy? Is Interstellar travel then fated to happen! Wars between planets, the power to harness the energy of several stars, all ensuring that the march towards a high entropy state continues and is probably even sped up!

Now try telling me this doesn’t sound a bit like Asimov’s psychohistory!


Interstellar and the Interest in Science

For many viewers like me, I am sure Interstellar was a flash-back to the days of wonder. What is our place in the Universe? What is a black hole? Space travel! Given there hasn’t been a shortage of space-themed movies, what is different about this one? I think it is because most of the mainstream space-themed movies have a general lack of respect for real science. Scientific themes that are either uncool or difficult to visualize are completely dropped by the way-side. Understandably, it is difficult to hold the attention of an audience while grappling with relativity theory or the realities of space travel.

2001: A Space Odyssey was acclaimed as a movie that got the Physics reasonably right but never ended up getting a mass audience. Therefore, the science in main-stream science-fiction movies is truly “fictional” in nature. Great cinema stimulates the audience and the fact that no one really googled the science behind science-fiction movies says a great deal about these run-of-the-mill space-age entertainers. Interstellar though was different.

The reality of interstellar travel was made stark. Some improbable concepts (eg. wormholes) were cleverly used but the beauty of the movie is in how it embraces a difficult concept (General Relativity) and helps an audience visualize multi-dimensional space-time. I don’t know about others but I trawled Wikipedia’s dense articles on the theory soon after watching the movie. I stumbled on and got reminded of the Annus Mirabilis papers that Einstein published in 1905. When you think of the problems Einstein explained in one year, it boggles the mind. I never truly understood the implications of Brownian-motion or the Twin-paradox when I was made to read them at school but I remained in awe. This time I was more patient and finally got some of my concepts reasonably right. I also found that Einstein wrote a popular science book on Relativity. The explanations were extremely lucid in simple language. Einstein also later added an Appendix V that contextualizes Relativity theory in the overall multi-epoch human effort to understand natural phenomena. In fact, I got so interested that an otherwise banned thought entered my head – a career in research specializing in Physics! While research as a career does interest me, my thinking has always been to pursue social sciences like economics or a multi-disciplinary study of history.

When I interact with friends and colleagues, I don’t believe I am alone in getting caught up in this sudden bug to understand the Universe! My science teachers couldn’t really do that for me. This in my opinion is the biggest contribution of Nolan’s Interstellar and why I rate it as great cinema. Only regret – I couldn’t see it on IMAX!