Friday, November 15, 2024
Emergence and protein folding
Tuesday, October 22, 2024
Colloquium on 2024 Nobel Prizes
This friday I am giving a colloquium for the UQ Physics department.
2024 Nobel Prizes in Physics and Chemistry: from biological physics to artificial intelligence and back
The 2024 Nobel Prize in Physics was awarded to John Hopfield and Geoffrey Hinton “for foundational discoveries and inventions that enable machine learning with artificial neural networks.” Half of the 2024 Chemistry prize was awarded to Dennis Hassabis and John Jumper for “protein structure prediction” using artificial intelligence. I will describe the physics background needed to appreciate the significance of the awardees work.
Hopfield proposed a simple theoretical model for how networks of neurons in a brain can store and recall memories. Hopfield drew on his background in and ideas from condensed matter physics, including the theory of spin glasses, the subject of the 2021 Physics Nobel Prize.
Hinton, a computer scientist, generalised Hopfield’s model, using ideas from statistical physics to propose a “Boltzmann machine” that used an artificial neural network to learn to identify patterns in data, by being trained on a finite set of examples.
For fifty years scientists have struggled with the following challenge in biochemistry: given the unique sequence of amino acids that make up a particular protein can the native structure of the protein be predicted? Hassabis, a computer scientist, and Jumper, a theoretical chemist, used AI methods to solve this problem, highlighting the power of AI in scientific research.
I will briefly consider some issues these awards raise, including the blurring of boundaries between scientific disciplines, tensions between public and corporate interests, research driven by curiosity versus technological advance, and the limits of AI in scientific research.
Here is my current draft of the slides.
Sunday, September 15, 2024
Biology is about emergence in subtle ways
Biology is a field that is all about emergence. It exhibits a hierarchy of structures from DNA to proteins to cells to organs to organisms. Phenotypes emerge from genotypes. At each level of the hierarchy (stratum) there are unique entities, phenomena, principles, methods, theories, and sub-fields. But there is more to the story.
Philip Ball is probably my favourite science writer. Earlier this year, he gave a beautiful lecture at The Royal Institution, What is Life and How does it Work?
Wednesday, April 3, 2024
Is biology better at computing than supercomputers?
Stimulated by discussions about the physics of learning machines with Gerard Milburn, I have been wondering about biomolecular machines such as proteins that do the transcription and translation of DNA in protein synthesis. These are rather amazing machines.
I found an article which considers a problem that is simpler than learning, computation.
The thermodynamic efficiency of computations made in cells across the range of life
Christopher P. Kempes, David Wolpert, Zachary Cohen and Juan Pérez-Mercader
It considers the computation of translating a random set of 20 amino acids into a specific string for a specific protein. Actual thermodynamic values are compared to a generalised Landauer bound for computation. Below is the punchline. (page 9)
Given that the average protein length is about 325 amino acids for 20 unique amino acids, we have that pi=p=1/20325=1.46×10−423, where there are 20325 states, such that the initial entropy is
, which gives the free energy change of kT(SI−0)=4.03×10−18 (J) or 1.24×10−20 (J per amino acid). This value provides a minimum for synthesizing a typical protein.
We can also calculate the biological value from the fact that if four ATP equivalents are required to add one amino acid to the polymer chain with a standard free energy of 47.7 (kJ mol−1) for ATP to ADP, then the efficiency is 1.03×10−16 (J) or 3.17×10−19 (J per amino acid).
This value is about 26 times larger than the generalized Landauer bound.
These results illustrate that translation operates at an astonishingly high efficiency, even though it is still fairly far away from the Landauer bound. To put these results in context, it is interesting to note that the best supercomputers perform a bit operation at approximately 5.27×10−13 (J per bit). In other words, the cost of computation in supercomputers is about eight orders of magnitude worse than the Landauer bound of
(J) for a bit operation, which is about six orders of magnitude less efficient than biological translation when both are compared to the appropriate Landauer bound. Biology is beating our current engineered computational thermodynamic efficiencies by an astonishing degree.
Thursday, November 2, 2023
Diversity is a common characteristic of emergent properties
Consider a system composed of many interacting parts. I take the defining characteristic of an emergent property is novelty. That is, the whole has a property not possessed by the parts alone. I argue that there are five other characteristics of emergent properties. These characteristics are common but they are neither necessary nor sufficient for novelty.
1. Discontinuities
2. Unpredictability
3. Universality
4. Irreducibility
5. Modification of parts and their relations
I now add another characteristic.
6. Diversity
Although a system may be composed of only a small number of different components and interactions, the large number of possible emergent states that the system can take is amazing. Every snowflake is different. Water is found in 18 distinct solid states. All proteins are composed of linear chains of 20 different amino acids. Yet in the human body there are more than 100,000 different proteins and all perform specific biochemical functions. We encounter an incredible diversity of human personalities, cultures, and languages.
A related idea is that "simple models can describe complex behaviour". Here "complex" is often taken to mean diverse. Examples, how simple Ising models with a few competing interactions can describe a devil's staircase of states or the multitude of atomic orderings found in binary alloys.
Perhaps the most stunning case of diversity is life on earth. Billions of different plant and animal species are all an expression of different linear combinations of the four base pairs of DNA: A, G, T, and C.
One might argue that this diversity is just a result of combinatorics. For example, if one considers a chain of just ten amino acids there are 10^13 different possible linear sequences. But this does not mean that all these sequences will produce a functional protein, i.e., one that will fold rapidly (one the timescale of milliseconds) into a stable tertiary structure, and one that can perform a useful biochemical function.
Friday, October 20, 2023
Opening the door for women in science
I really liked reading Transcendent Kingdom by Yaa Gyasi. She is an amazing writer. I recently reread some of it for an extended family book club. Just check out some of these quotes.
A colleague suggested I might like Lessons in Chemistry, a novel by Bonnie Garmus. I have not read the book yet, but I have watched the first two episodes of the TV version on AppleTV. I watched the first episode for free.
The show contains a good mix of humour, love of science, and feminism. The chemistry dialogue seems to be correct. The show chronicles just how in the 1950s how awful life was for a young woman who aspired to be a scientist. Things have improved. But there is still a long way to go...
Friday, January 27, 2023
Science and the universe are awesome
Since we are surrounded by scientific knowledge. We are so used to it that we can take science for granted and not reflect on how amazing science truly is. And how amazing the universe is that science reveals. Things that we know, learn, and do today in science would have been inconceivable decades ago, let alone centuries ago.
What specific things do you think are particularly awesome? This question was stimulated by Frank Wilczek's recent book, Fundamentals: Ten Keys to Reality. In writing the book, he says "what began as an exposition grew into a contemplation."
My answer to the question has some significant overlap with Wilczek's ten.
Below I list some of the things that I find awesome. I consider two classes: what science can do and what we learn about the universe from science.
Science works! It is amazing what science can do.
We can understand the material world.
Einstein said, "The most incomprehensible thing about the world is that it is comprehensible." In a previous post, I explored some different dimensions of the fact that the universe is comprehensible. The mystery includes human capabilities, both intellectual and physical, and the malleability of the material world.
We can make precise measurements.
Scientists have created incredibly powerful and specialised instruments for making very precise measurements such as spectrometers, telescopes and microscopes. Scientists can measure the tension in a single strand of DNA, the magnetic moment of an electron to a precision of one part in one billion billion, the spectrum of light emitted by a galaxy that is ten billion light years away, ...
We can predict the outcome of new experiments.
Scientists construct theories in their minds, on pieces of paper, in mathematical equations, and in computers. One way to evaluate the possible validity of a theory is to propose new experiments and predict the outcome. Famous examples include the existence of the chemical element aluminium, the existence of the planet Neptune, radio waves, a specific excited quantum state of the atomic nucleus of carbon atoms, the pollinator moth for Darwin's orchid, the deflection of the path of light from a distant star by our sun, gravitational waves, the Cosmic Microwave Background, quarks, the Higgs boson, the Berezinskii-Kosterlitz-Thouless phase transition, the hexatic phase, edge states in integer spin antiferromagnetic chains, topological insulators, ... Predictions are particularly impressive when they are unexpected and controversial.
We can use mathematics.
Eugene Wigner received the Nobel Prize in Physics in 1963. In 1960 he published an essay "The Unreasonable Effectiveness of Mathematics in the Natural Sciences that concludes
The miracle of the appropriateness of the language of mathematics for the formulation of the laws of physics is a wonderful gift which we neither understand nor deserve.
We can manipulate and control nature.
Scientists and engineers can move single atoms, design drugs, make computers, build atom bombs, heart pacemakers, and mobile phones, manipulate genes, ......
We know so much but we know so little.
On the one hand, the achievements of science are amazing. Yet, in spite of this, there are still significant mysteries and challenges. Examples include the nature of dark matter or human consciousness, a quantum theory of gravity, fine-tuning of fundamental constants, the quantum-classical boundary, protein folding, the nature of glasses, and how to calculate the properties of complex systems.
It is awesome what science reveals to us about the universe.
The immense scales of the observable universe
Our sun is just one star among the more than two hundred billion that make up our galaxy, the Milky Way. And that is just one of one trillion galaxies in the whole universe. It takes light from the most distant galaxies tens of billions of years to travel to us.
Length, time, and energy scales over many many orders of magnitude
These go far beyond our everyday experience and what we can see with the naked eye (from a millimetre to a kilometre). On the large scale, the visible universe involves distances of billions of light years (10^25 metres). On the small scale, there is the sub-structure of nucleons, which is smaller than femtometres (10^-15 m). This wide range of length scales is nicely illustrated in the wonderful movie Powers of Ten and its update, The Cosmic Eye. There are corresponding time, energy, and temperature scales varying over many many orders of magnitude. For example, as one goes from ultracold atomic gases to quark-gluon plasmas, the relevant energy and temperature scales vary over more than 20 orders of magnitude! At every scale, there are distinct phenomena and structures.
Universal laws that are simple to state
The universe exhibits a diversity of rich and complex behaviour. Yet it can understand much of it in terms of simple universal laws that are easy to state, e.g., Newton's laws of motion, the laws of thermodynamics, Maxwell's equations of electromagnetism, Schrodinger's equation of quantum mechanics, the genetic code, .... And, these are just a few of these laws. One does not need a multitude of laws to describe a multitude of instances of a multitude of phenomena.
Just a few building blocks
There are just a few fundamental particles in the standard model (leptons, neutrinos, and gauge bosons). Everything is made of them. They are the building blocks of atoms. They each have just a few physical properties: charge, spin, mass, and colour. Every single particle of a particular type in the universe has exactly the same properties. Exactly. As far as we know, they have been exactly the same throughout time, going back to the beginning of the universe, and whether they are in your body, or in a star in a distant galaxy.
Atoms are the building blocks of chemical compounds. Every single atom of a particular chemical element (and nuclear isotope) is absolutely identical. This allows astronomers to determine the chemical composition of distant stars, galaxies, and dust clouds.
Humans, plants, and animals all have the same molecular building blocks and there are just a few of them. Any DNA molecule is composed of just four different base pairs (denoted A, G, T, C) and proteins are composed of just twenty different amino acids.
There are two amazing things here. First, there are just so few building blocks. Second, every one of these building blocks is absolutely identical.
Emergence: simple rules produce complex behaviour
Humans, cells, and crystals can be viewed as systems composed of many interacting components. The components and their interactions can often be understood and described in simple terms. Nevertheless, from these interactions complex structures and properties can emerge.
Nature appears to be fine-tuned for life
This covers not just the values of fundamental physical constants that lead to the notion of fine-tuning and the anthropic principle. Water has unique physical and chemical properties that allow it to play a crucial role in life, such as the surface of lakes freezing before the bottom and aiding protein folding.
The intricate and subtle "machinery" of biomolecules
Proteins have very unique structures that are intimately connected to their specific functions, whether as catalysts or light sensors.
Friday, December 9, 2022
The wonders and mysteries of bioluminescence
Members of my family have been reading Phosphorescence: On awe, wonder, and things that sustain you when the world goes dark, a personal memoir by Julia Baird.
This reminded me of how amazing and fascinating bioluminescence is, stimulating me to read more on the science side. One of the first things is to distinguish between bioluminescence, fluorescence, and phosphorescence.
Bioluminescence is chemical luminescence whereby a biomolecule emits a photon through the radiative decay of a singlet excited state that is produced by a chemical reaction.
In contrast, fluorescence occurs when the singlet excited state is produced by the molecule absorbing a photon.
Phosphorescence occurs when a molecule emits a photon through the radiative decay of an excited triplet state, that was produced by the absorption of a photon.
Bioluminescence can occur in the dark. Fluorescence cannot as there are no photons to absorb. Phosphorescence is sometimes seen in the dark but this is because the molecule absorbs invisible UV light which produces the triplet state which has a very long radiative lifetime.
Baird gives beautiful and enchanted descriptions of seeing "phosphorescence" on her daily early morning ocean swim. She acknowledges that this is actually bioluminescence not phosphorescence. I should stress that in pointing this out I am not "unweaving the rainbow", as for literary purposes using "bioluminescent" would be clunky.
There is a useful webpage from a research group at UC Santa Barbara. They also have a detailed review article from which I took the image above.
A much shorter review that I read this morning is
Bioluminescence in the Ocean: Origins of Biological, Chemical, and Ecological Diversity, by E.A. Widder
An article in Quanta magazine, In the Deep, Clues to How Life Makes Light by Stephanie Yin
So what is the underlying photophysics and quantum chemistry? The following review is helpful.
The Chemistry of Bioluminescence: An Analysis of Chemical Functionalities
Isabelle Navizet, Ya-Jun Liu, Nicolas Ferré, Daniel Roca-Sanjuán, Roland Lindh
Almost all currently known chemiluminescent substrates have the peroxide bond, -O-O-, in common as a chemiluminophore. This chemical system facilitates the essential mechanism of chemiluminescence—providing a route for a thermally activated chemical ground-state reaction to produce a product in an electronically excited state. The basics of this process can be understood from studies of ... dioxetanone. [it] contains a peroxide bond, [and] fragments like the firefly luciferin system to carbon dioxide.
Much of this photophysics can be understood in terms of a "two-site Hubbard model" discussed in this classic paper that I love.
Vlasta Bonačić-Koutecký, Jaroslav Koutecký, Josef Michl
In simple terms, all that is different in the biomolecular system is that the enzyme and the larger chromophore tune energy levels so that the energy barriers are much smaller so that the steps needed for bioluminescence become accessible at room temperature.
This highlights two fundamental things.
Chemistry is local. This is relevant to understanding Wannier orbitals in solid state physics, to hydrogen bonding, and how protein structure aids function.
"Biochemistry is the search for the chemistry that works" [in water at room temperature].
Thursday, November 25, 2021
Role of quantum nuclear motion in biomolecular systems
Total I am giving a talk, "Effect of quantum nuclear motion on hydrogen bonds in complex molecular materials" at Light-matter Interactions from scratch: Theory and Experiments at the Border with Biology
Here are the slides
The talk provides a concrete example of the tutorial on constructing simple model Hamiltonians for complex materials that I give before the talk. It relates to the bio theme of the meeting through work on isotopic fractionation in proteins and the recent paper below. It makes use of the simple model that I talk about.
Chi-Yun Lin and Steven G. Boxer
Tuesday, November 23, 2021
Tutorial on modelling quantum dynamics in biomolecules
This week I am giving two (virtual) talks at a meeting
Light-matter Interactions from scratch: Theory and Experiments at the Border with Biology
supported by the ICTP (International Center for Theoretical Physics) in Trieste.
In the ICTP tradition, one talk is a tutorial and the second talk is about my research.
Here are the slides for the tutorial on Effective Model Hamiltonians for Quantum Dynamics in Complex Molecular Materials. Feedback is welcome.
The research talk is about hydrogen bonding. I will post slides for that later.
Wednesday, October 13, 2021
The biochemical basis of mental health basics
Yesterday the UQ Brain Institute had an excellent webinar Brain Health for Mental Health. Four researchers discussed the scientific basis for some simple strategies to reduce the likelihood of mental illness and/or to aid its treatment. These include
eat well
exercise regularly
sleep well
reduce screen time
drink less caffeine
minimise international travel (because of the associated jet lag).
I was fascinated to see the biological and biochemical basis for these strategies. I try to implement them myself and often emphasise the importance of these basic disciplines to others.
Some of the science is fascinating in itself. Did you know you can study sleep in fruit flies?
The webinar also provides a nice example of a public engagement activity. Rather than having one person give a long talk, four different researchers speak, and each for only five minutes with about five slides each. Each talk is followed by a question from the chair. Then at the end there are questions from the live online audience.
Tuesday, September 21, 2021
Nanoscale machines in nature
Part two of the Biology brief in The Economist is Cells and how to run them: All life is made of cells, and cells depend on membranes
A few of the main ideas are the following. Cells are either prokaryotic (bacterium) or eukaryotic (animals). Cell membranes are made of lipids that spontaneously form structures due to an interplay between hydrophobic and hydrophilic interactions. The boundary of prokaryotic cells is the membrane. Eukaryotic cells are more complex, containing many organelles (mitochondria), whose boundary are membranes.
The electron transfer chains are driven either by respiration or photosynthesis.
Energy for processes in the cell is provided by breaking ATP down to ADP. The reverse process is driven by the kinetic energy of rotation (at about 6000 rpm) of the part of the ATP synthase protein. ATP is Adenosine triphosphate.
To me the amazing/awesome/cool/miraculous thing is what the hardware can do. These are nanoscale chemical machines and factories. The video below shows a simulation of the ATP synthase protein that is located within cell membranes. It acts as a proton pump to maintain the concentration imbalance between the outside and inside of the cell and to convert ADP to ATP.
Tuesday, September 7, 2021
Biology in a nutshell: emergence at many levels
One of the many great things about The Economist magazine is that they run "Briefing" articles that give brief readable introductions and analyses to important topics, ranging from racism to taxation to climate change. Last year they ran a series about new ideas in economics.
They are currently running a series, Biology Briefs. Each week, for six weeks, there is a two-page article on one key topic in modern biology. They are naturally divided by different scales: molecules, cells, organs, individual lives, species, and living planets.
The most important idea in molecular biology: DNA encodes information that is used to make specific proteins.
Replication: the protein DNA polymerase makes new DNA molecules with the same sequence of base pairs
Transcription: the protein RNA polymerase makes single strands of RNA that have the same genetic information.
Translation: the protein ribosome reads the information in the mRNA and uses it to make chains of amino acids (with specific sequences determined by the RNA sequence). These polymers then fold spontaneously into proteins with specific functions.
There is much that is amazing and awesome about this, including that people have been able to figure all this out. What I find most amazing/miraculous/awesome/cool is not the software but rather the hardware, i.e. the proteins that act as nanoscale biochemical factories, particularly the ribosome.
Monday, May 11, 2020
Talk on mathematics and physics of virions
Tonight I will be giving my first seminar via zoom.
Here are the slides.
It is for the Pandemic Seminar of the UQ School of Mathematics and Physics.
Here is the recording.
Tuesday, May 5, 2020
The beautiful mathematics and physics of virions
The past month I have taken a crash course in what is known about the structure and properties of virions (single virus nanoparticles). There is some fascinating and beautiful mathematics and condensed matter physics involved. A nice place to start is this short animation video that shows how the Dengue fever virus replicates itself.
Three important questions for any virus are the following.
1. What is the structure of the virion?
In particular, what is the structure of the viral capsid, i.e. the protein shells that encapsulate the genome of the virus?
2. How does the capsid self assemble?
3. How is the genetic material packaged inside the capsid?
Handwashing with sanitiser works because hydrophobic interactions cause the breakup of the membrane that encases the virion. This is the same soft matter physics as when soap removes dirt.
The role of anti-viral drugs is to interrupt/sabotage any of the steps in the multi-step process of the action or duplication of the virion. Thus, finding answers to any of the three questions above may facilitate the development of anti-viral drugs or vaccines.
Here are a few of the articles I have found fascinating and helpful.
Geometry as a Weapon in the Fight Against Viruses
Reidun Twarock
On Virus Growth and Form
Roya Zandi, Bogdan Dragnea, Alex Travesset, Rudolf Podgornik
TRIM5α self-assembly and compartmentalization of the HIV-1 viral capsid
Alvin Yu, Katarzyna A. Skorupka, Alexander J. Pak, Barbie K. Ganser-Pornillos, Owen Pornillos, Gregory A. Voth
The figure below (taken from the second article above) shows the structure of the capsid of five different virions. The number of proteins in all of them is an integer multiple of 60.
Left to right: Satellite Tobacco Mosaic virus (composed of 60 proteins); L-A virus (120 proteins); Dengue virus (180 proteins); Chlorosome Vigna virus (180 proteins); Sindbis virus (240 proteins).
In the next post, I will explain the geometric origin of this quantisation.
Monday, April 6, 2020
Emergence and the pandemic
This is what Laughlin and Pines call the ``protectorate''.
The role of superconductivity in development of the Standard Model
In 1986, Steven Weinberg published an article, Superconductivity for Particular Theorists , in which he stated "No one did more than N...

-
Is it something to do with breakdown of the Born-Oppenheimer approximation? In molecular spectroscopy you occasionally hear this term thro...
-
Nitrogen fluoride (NF) seems like a very simple molecule and you would think it would very well understood, particularly as it is small enou...
-
I welcome discussion on this point. I don't think it is as sensitive or as important a topic as the author order on papers. With rega...