Monday, May 30, 2022

The financial state of Australian universities

On Saturday the Australian Financial Review had a good, but disturbing, article, Uni chiefs reap million-dollar salaries, record surpluses as jobs cut. It is behind a paywall, but a hard copy photo is below.


Of particular note is how the Vice Chancellors (Presidents) of regional universities (which are like community colleges in rural parts of the USA), which most readers outside of Australia will never even have heard of, are given salaries around one million AUD. Given the relatively low cost of living in their locations, those salaries are even more spectacular.


An issue that is not discussed in the article is how at each university there is a whole cabal of senior managers, not just the VC, who are on exorbitant salaries and packages. For example, if you look at this organisational chart for UQ, I count four deputy VCs and 8 pro-VCs. In addition, there are more than ten Executive Deans and Directors of Institutes. That means there are probably about twenty people on packages in the range of $500K to $1M. None of this is public information, as far as I am aware, even though these are public institutions. For comparison, the Prime Minister of Australia receives a salary of around $600K.

One VC whose salary is not listed in the table is Brian Schmidt from ANU (Australian National University). This is because, last year he negotiated his salary down to $484,000, about half that of the other VCs. Refreshing!

Saturday, May 14, 2022

Emergence matters (in a nutshell)

Emergence is one of the most important concepts in the sciences: from physics to biology to sociology. Most of the big questions in science involve emergence. Yet there is no consensus about what emergence is, how to define it, or why it matters. This is my attempt to clarify some of the important issues and questions. For reasons of brevity, I give no references and only a few examples. They can come later. Here I am trying to take a path that is intermediate between the precision of philosophers and the looseness of condensed matter physicists' discussion of emergence. My goals are clarity and brevity.

Characteristics of emergent phenomena

Consider a system that is composed of many interacting parts. If the properties of the system are compared with the properties of the individual parts, a property of the whole system is an emergent property if it has the following characteristics.

1. Novelty 

An emergent property of the system is a property that is not present in the individual parts of the system.

2. Modification of parts 

An emergent property of the system is associated with a modification of the properties of and the relationships between the parts of the system. 

3. Universality

An emergent property is universal in the sense that it is independent of many of the details of the parts. As a consequence, there are many systems that can have the emergent property.

4. Irreducibility

An emergent property cannot be reduced to properties of the parts.

5. Limited predictability

An emergent property is difficult to predict solely from knowledge of the properties of the parts and how they interact with one another.

Here are a few issues to consider about the five characteristics above. 

First, “emergent property” could possibly be replaced with emergent phenomenon, object, or state.

Second, for each of the five characteristics is it necessary and/or sufficient for the system property to be emergent?

Third, one of the most contested characteristics concerns predictability. “Difficult to predict” is sometimes replaced with “impossible”, “almost impossible”, “extremely difficult”, or “possible in principle, but impossible in practice.” After an emergent property has been observed sometimes it can be understood in terms of the properties of the parts. An example is the BCS theory of superconductivity, which provided a posteriori, rather than a priori, understanding. A keyword in the statement above is “solely”.

Examples of properties of a system that are not emergent are volume, mass, charge, and number of atoms. These are additive properties. The property of the system is simply the sum of the properties of the parts.

Scales and hierarchies

Central to emergence is the idea of different scales. Emergent properties only occur when scales become larger. Scales that are simply defined, and might be called extrinsic, are the number of parts, length scale, and time scale. A more subtle scale, which might be called intrinsic, is a scale associated with the emergent property. This emergent scale is intermediate between that of the parts and that of the whole system.

Emergent scales lead naturally to hierarchies, such as those associated with different scientific disciplines, as shown below. Hierarchies also occur within individual disciplines.

At each level there are distinct phenomena, concepts, theories, and scientific methods.

Another important scale is that of complexity. Generally, as one goes up the hierarchy one says that the level of complexity increases. Giving a precise version of such statements is not simple.

Complexity

Simple rules can lead to complex behaviour. This is nicely illustrated by cellular automata. It is also seen in other systems with emergent properties. For example, the laws describing the properties of electrons and ions in a crystal or a large molecule are quite simple (Schrodinger’s equation plus Coulomb’s law). Yet from these simple rules, complex phenomena emerge: all of chemistry and condensed matter physics!

There is no agreed universal measure for the complexity of a system or with many components. One possibility is the Kolmogorov measure. Using such measures to elucidate emergence, such as how complexity changes with other scales, is an important challenge.

Other issues

There are a host of other issues and topics that enter discussions about emergence. Some of these are of a more philosophical nature. Here I just list them: robustness, quality vs. quantity, objective vs. subjective, universality vs. particularity, ontology vs. epistemology, discontinuities, incommensurability, theory reduction, asymptotic singularities, top-down causation, supervenience, differentiation and integration (not calculus) of system parts, reductionism, foundationalism, fundamentalism, strong versus weak emergence, and criteria for theory acceptance.

Discussion of some of these issues can be quite abstract but to make the discussion above more precise they may need to be considered. 

Emergence is relevant to practical matters such as scientific strategy, priorities, allocation of resources, and our dispositions as scientists. Too often views on these issues are implicit and not reflected upon. 

The practical matter of scientific strategy

When studying a system, the first choice that must be made is what scale or scales to focus on. For example, in materials science, the options range from the atomic scale to the macroscopic. This choice determines the tools and methods, both experimental and theoretical, that can be used to study the system. In different words, the scientist is making a choice of ontology: the object they choose to study. This then determines epistemology: the concepts, theories, and organising principles a scientist may use or hope to discover. Effective theories and toy models enter here. 

When systems have been studied by a range of methods and at a range of scales, a challenge is the synthesis of the results of these studies. Value-laden judgements are made about the priority, importance, and validity of such attempts at synthesis. Often synthesis is relegated to a few sentences in the introductions and conclusions of papers.

For known systems and emergent properties, there is the possibility of creating new methods and probes to investigate them at appropriate scales.

New systems can be created and investigated in the hope of discovering new emergent properties (e.g., new states of matter) or more modestly, that manifest an emergent property that is more amenable to scientific study or technological application.

As emergent properties involve multiple scales they are often of interest to and amenable to study by more than one scientific discipline. This creates opportunities and challenges for interdisciplinary collaboration.

Individual scientists must and do make decisions about the relative priority of the different strategies outlined above. Research groups, departments, institutions, professional societies, and funding agencies must and do also make decisions about such priorities. The decision outcomes are also emergent properties of a system with multiple scales from that of the individual scientist to global politics. I claim that too often these weighty decisions are made implicitly, rather than explicitly following debate and deliberation.

The disposition of the scientist

All scientists are human. In our professional life, we have hopes, aspirations, values, fears, attitudes, expectations, and prejudices. These are shaped by multiple influences from the personal to the cultural to the institutional. We should reflect on the past century of our study of emergent systems from physics to biology to sociology. If we honestly evaluate our successes and failures I think this may lead us to have certain dispositions that are interrelated.

Humility. There is so much we do not understand. Furthermore, we fail abjectly at predicting emergent properties. This is not surprising. Unpredictability is one of the characteristics of emergent properties. There is a hubris associated with grand initiatives such as “the theory of everything”, the Human Genome Project, “materials by design”, and macroeconomic modelling. 

Expect surprises. There are many exciting discoveries waiting. They will be found by curiosity and serendipity.

Wonder. Emergent phenomena are incredibly rich and beautiful to behold, from physics to biology to sociology. Furthermore, the past century has seen amazing levels of understanding. But this is a “big picture” and “coarse-grained” understanding, not the description that the reductionists lust for and claim possible. 

Realistic expectations. Given the considerations above I think we should have modest expectations of the levels of understanding possible, and what research programs, from that of individual scientists to billion-dollar initiatives, can achieve. We need to stop the hype. Modest expectations are particularly appropriate with respect to our ability to control emergent properties.

The holy grail

“The philosophers have only interpreted the world, in various ways. The point, however, is to change it.”

Karl Marx

Understanding complex systems with emergent properties is an ambitious scientific challenge. This enterprise has intrinsic intellectual merits. But a whole other dimension and challenge is to use this understanding to modify, manipulate, and control the properties of systems with emergent properties. This enticing prospect appeals to technologists, activists, and governments. Such promises feature prominently in grant applications, press releases, and reports from funding agencies. Diverse examples of this control goal include chemical modification of known superconductors to produce room-temperature superconductivity, drug design, social activism, the leadership of business corporations, and governments attempting to manage the economy. 

However, we should honestly reflect on decades of “scientifically informed” and “evidence-based” initiatives in materials science, medicine, poverty alleviation, government economic policy, business management, and political activism. Unfortunately, the fruit from these initiatives is disappointing, particularly compared to what has often been promised.

My goal is not to promote despair but rather to prevent it.  With more realistic expectations, based on reality rather than fantasy, we are more likely to make significant progress in finding ways to make some progress (albeit modest but worthwhile) in learning how to manipulate these complex systems.

This post contains many claims that require discussion, refinement or abandonment. I welcome suggestions on how to improve these ideas.

Tuesday, April 26, 2022

The Story of Science is a nice video series

 I am on the lookout for good video resources about science that I can recommend to others, particularly non-scientists. By chance, I recently came across the BBC production, The Story of Science: Power, Proof, and Passion, hosted by Michael Mosley.

There is also a beautiful book that goes with the series, containing more detail, including colour illustrations. I was able to get the DVDs and the book from my local public library.

I particularly appreciate that science is presented as a human endeavour and progress is influenced by local contexts (economic, political, religious, ...). That can be acknowledged and enjoyed without descending into a social constructivist view of scientific knowledge. In a similar vein, the series does not have an ideological edge, or embrace some common tropes that too often popular video treatments may promote such as science the saviour, science the moneymaker, science the spoiler, science the monster-maker, ... or that science is uncontrollable, is inscrutable, or is the domain of evil/eccentric geniuses,....

The series introduced me to several colourful characters who played key roles in the history of science, including Hennig Brand, Hans Sloan, Georges Cuvier, Horace-Benedict de Saussure, Simon Sevin, Richard Trevithick, ...

Thursday, April 14, 2022

Elite imitation and flailing universities

The mission of universities is thinking: teaching students to think and enabling scholars to think about the world we live in. Yet, it is debatable whether most universities in the world achieve these goals. Arguably, things are getting worse. Universities are flailing. Why?

Most universities desperately want to be elite. They want to be like Harvard, Caltech, Oxford, Princeton, Berkeley, Stanford, ...
But non-elite universities do not have the necessary resources to be elite. Yet they are controlled by elites (management on high salaries, faculty educated at elite universities) who want to be elite and so settle for elite imitation.

"A flailing university is what happens when the principal cannot control its agents. The flailing university cannot implement its own plans and may have its plans actively subverted when its agents work at cross-purposes. The non-elite university flails because it is simultaneously too large and too small: too large because the non-elite university attempts to legislate and regulate every aspect of the work of faculty and students and too small because it lacks the resources and personnel to achieve its ambitions. 

To explain the mismatch between the non-elite universities' ambitions and their abilities, consider the premature demands by elites in non-elite universities for goals, policies, curricula, infrastructure, and outcomes more appropriate to an elite university. 

In order to satisfy external actors (government, business, parents, ...) non-elite universities often take on tasks that overwhelm institutional capacity, leading to premature load bearing. As these authors put it, “By starting off with unrealistic expectations of the range, complexity, scale, and speed with which organizational capability can be built, external actors set both themselves and (more importantly) the students and researchers that they are attempting to assist to fail”. 

The expectations of external actors are only one source of imitation, however. Who people read, listen to, admire, learn from, and wish to emulate is also key. Another factor driving inappropriate imitation is that the elites in non-elite universities—senior management and high-profile faculty—are closely connected with business elites and elite universities, usually more closely than they are to the students and faculty at their own university. As a result, this elite initiates and supports policies that appear to it to be normal even though such policies may have little relevance to the student and faculty as a whole and may be wildly at odds with the university capacity. This kind of mimicry of what appear to be the best elite university policies and practices is not necessarily ill intentioned. It is simply one by-product of the background within which the elites operates. University managers engage with business elites and managers at other non-elite universities."

I actually did not write most of the text above, I just took the text from the first two pages of the article below and replaced some words (e.g. Indian state with non-elite university, Indian citizens with students and faculty). 

Premature Imitation and India’s Flailing State 
Shruti Rajagopalan, Alexander T. Tabarrok

I came across the article after listening to a podcast episode that interviews the two authors, recommended by my son.

I also recommend Shutri's own podcast, Ideas of India, including a recent episode, Where did development economics go wrong?


What do you think? Are universities like a flailing state? Is the problem elite imitation?

Friday, April 8, 2022

Why is there so much symmetry in biological systems?

 One of the biggest questions in biology is, What is the relationship between genotypes and phenotypes? In different words, how does a specific gene (DNA sequence) encode information that allows a very specific biological structure with a unique function to emerge?

Like big questions in many fields, this is a question about emergence.

In biology, this mapping from genotype to phenotype occurs at many levels from protein structure to human personality. An example is how the RNA encodes the structure of a SARS-CoV2 virion.

A fascinating thing about biological structures is that many have a certain amount of symmetry. The human body has reflection symmetry and many virions have icosahedral symmetry. What is the origin of this tendency to symmetry? Could evolution produce it?

Scientists will sometimes make statements such as the following about evolution.

Symmetric structures preferentially arise not just due to natural selection but also because they require less specific information to encode and are therefore much more likely to appear as phenotypic variation through random mutations.

How do we know this is true? Can such a statement be falsified? Or at least, can we produce concrete models or biological systems that are consistent with this statement?

There is a fascinating paper in PNAS that addresses the questions above.

Symmetry and simplicity spontaneously emerge from the algorithmic nature of evolution 
Iain G. Johnston, Kamaludin Dingle, Sam F. Greenbury, Chico Q. Camargo, Jonathan P. K. Doye, Sebastian E. Ahnert, and Ard A. Louis 

Here are a few highlights from the article. First, how one gets specific about information content and algorithms.
Genetic mutations are random in the sense that they occur independently of the phenotypic variation they produce. This does not, however, mean that the probability P(p) that a Genotype-Phenotype [GP] map produces a phenotype p upon random sampling of genotypes will be anything like a uniformly random distribution. 
Instead, ... arguments based on the coding theorem of algorithmic information theory (AIT) (7) predict that the P(p) of many GP maps should be highly biased toward phenotypes with low Kolmogorov complexity K(p) (8). 
High symmetry can, in turn, be linked to low K(p) (6911). An intuitive explanation for this algorithmic bias toward symmetry proceeds in two steps: 
1) Symmetric phenotypes typically need less information to encode algorithmically, due to repetition of subunits. This higher compressibility reduces constraints on genotypes, implying that more genotypes will map to simpler, more symmetric phenotypes than to more complex asymmetric ones (23). 
2) Upon random mutations these symmetric phenotypes are much more likely to arise as potential variation (1213), so that a strong bias toward symmetry may emerge even without natural selection for symmetry.
The authors consider several concrete models and biological systems that illustrate this bias toward symmetry. The first involves the structure of protein complexes, as given in the Protein Data Base (PDB).


A) Protein complexes self-assemble from individual units. 

(B) Frequency of 6-mer protein complex topologies found in the PDB versus the number of interface types, a measure of complexity 
K˜(p). 
Symmetry groups are in standard Schoenflies notation: C6D3C3C2, and C1. There is a strong preference for low-complexity/high-symmetry structures. 

(C) Histograms of scaled frequencies of symmetries for 6-mer topologies found in the PDB (dark red) versus the frequencies by symmetry of the morphospace of all possible 6-mers illustrate that symmetric structures are hugely overrepresented in the PDB database. 

Note the logarithmic scales for the probabilities (frequencies), meaning that the probabilities span four orders of magnitude. The authors claim that "many genotype–phenotype maps are exponentially biased toward phenotypes with low descriptional complexity. "
This intuition that simpler outputs are more likely to appear upon random inputs into a computer programming language can be precisely quantified in the field of AIT (7), where the Kolmogorov complexity K(p) of a string p is formally defined as a shortest program that generates p on a suitably chosen universal Turing machine (UTM). 

From AIT the authors produce a bound (equation 1, and below), that exhibits the exponential decay of probability with complexity, similar to that seen in their graphs, such as the one shown below, for a model gene regulatory network that is modeled by 60 ordinary differential equations (ODEs). The red dashed line is the bound below.

𝑃(𝑝)2𝑎𝐾˜(𝑝)𝑏,  [1


Scaled frequency vs. complexity for the budding yeast ODE cell cycle model (30). Phenotypes are grouped by complexity of the time output of the key CLB2/SIC1 complex concentration. Higher frequency means a larger fraction of parameters generate this time curve. The red circle denotes the wild-type phenotype, which is one of the simplest and most likely phenotypes to appear. The dashed line shows a possible upper bound from Eq. 1. There is a clear bias toward low-complexity outputs.

One minor comment is that I was surprised that the authors did not reference the classic 1956 paper by Crick and Watson. They introduced the concept of "genetic economy". Prior to any knowledge of the actual structure of virions, they predicted that virions would have icosahedral symmetry because that reduced the cost of the genome coding for the structure of the virion.

Hence, it would be interesting to explore the relationship between the PNAS paper and this one.
There is a nice New York Times article about the PNAS paper. I thank Sophie van Houtryve for bringing that to my attention leading me to the PNAS paper.

Friday, March 25, 2022

Anthony Jacko (1985-2022): condensed matter theorist

I was very sad when last week I learned of the death of Anthony Jacko, a former member of the Condensed Matter Theory group at UQ. He was only 36 years old, having been diagnosed with stage 4 cancer at the end of last year.

Jacko's funeral was this week. Family and friends spoke warmly of his intelligence, humour, faithfulness, passion for life, and endearing quirkiness. There were both tears and laughs.

I will say something here about his scientific contributions, though at times like this what we achieve professionally does not really seem that important.

I first met Jacko as an undergraduate at UQ when he took an advanced undergraduate condensed physics course with me in 2006. That year he did an undergraduate honours (fourth year) project with Ben Powell and John Fjaerestad, on the Kadowaki-Woods ratio. This work eventually led to a Nature Physics paper, that I discussed in this blog post.

In 2007 I was quite happy when Jacko decided to do a Ph.D. with me and Ben Powell. We tried to come up with simple effective Hamiltonians for organometallic complexes that are used in organic LEDs and solar cells. Although we made some progress, I think the questions we tried to address have still not been answered definitively. The most progress has subsequently been made by Ben Powell.

For a postdoc, Jacko moved to Frankfurt to work with Roser Valenti and Harald Jeschke (now at Okayama University). I was really impressed how Jacko learned how to do reliable DFT-based electronic structure calculations and to use Wannier orbitals to extract tight-binding model parameters. Jacko brought this expertise back to Ben Powell's group at UQ, where he worked from 2013 to 2018.

During that time Jacko co-authored a string of really nice papers that inspired me to write multiple blog posts, such as those below. Looking back over that work I see how careful, solid, and systematic it is. Basically, good science, that we do not see enough of these days.

The broad issue is as follows. Understanding strong electron correlations in complex molecular materials requires effective Hamiltonians that are a realistic representation of the essential physics and chemistry. Sometimes next-nearest-neighbour interactions and subtleties in crystal structure really do matter. Other times they do not. The methods used by Jacko provided a robust way of doing this.





Faculty hope that former students will come to their funeral. We also hope that we won't have to attend the funeral of any of our students. It is very sad.

An endowment is being created at The University of Queensland, to fund an undergraduate physics prize that will be awarded each year in honour of Jacko.

My condolences to Jacko's partner, Alana, and to family and friends.

Thursday, March 17, 2022

Predicting new states of quantum matter is highly unlikely

Last year New Scientist published a nice article by Jon Cartwright

States of matter: The unthinkable forms beyond solid, liquid and gas

From time crystals to supersolids, we keep discovering extraordinary new kinds of matter – now the true challenge is being able to predict what we'll find next

Unlike the typical New Scientist article, this one is a measured and reasonable discussion about reality, rather than the latest wild and breathless speculations that the magazine is rife with. Unfortunately, it is behind a paywall.

I was interviewed for the article, which ends (see below) by contrasting my pessimism with the optimism of Andrei Bernevig. His optimism is based on this recent paper that reports a systematic identification of stoichiometric compounds that have topological bands and so can support topological states of matter. That is important and wonderful work. But, it is looking at what can be considered a "one-electron" problem, and so does not shake my pessimism. I do hope I am wrong.



What does this movie tell us about the modern university?

Last night, my wife and I watched the movie, Wit. You can watch the full movie here  (free with ads). I should warn that some of the conten...