Four scientific reasons to be skeptical of AI hype

The hype about AI continues, whether in business or science. Undoubtedly, there is a lot of potential in machine learning, big data, and large language models. But that does not mean that the hype is justified. It is more likely to limit real scientific progress and waste a lot of resources.

My innate scepticism receives concrete support from an article from 2018 that gives four scientific reasons for concern.

Big data: the end of the scientific method? 

Sauro Succi and Peter V. Coveney

The article might be viewed as a response to a bizarre article in 2008 by Chris Anderson, editor-in-chief at Wired, The End of Theory: The Data Deluge Makes the Scientific Method Obsolete

‘With enough data, the numbers speak for themselves, correlation replaces causation, and science can advance even without coherent models or unified theories’.

Here are the four scientific reasons for caution about such claims given by Succi and Coveney.

(i) Complex systems are strongly correlated, hence they do not (generally) obey Gaussian statistics.

The law of large numbers (central limit theorem) may not apply and rare events may dominate behaviour. For example, consider the power law decays observed in many complex systems. They are in sharp contrast to the rapid exponential decay in the Gaussian distribution. The authors state, "when rare events are not so rare, convergence rates can be frustratingly slow even in the face of petabytes of data."

(ii) No data are big enough for systems with strong sensitivity to data inaccuracies.

Big data and machine learning involve fitting data to a chosen function, such as a "cost function" with many parameters. That fitting involves a minimisation routine which acts on some sort of "landscape." If the landscape is smooth and minima are well-separated and not separated by too large of maxima then the routine may work. However, if the landscape is rough or the routine gets stuck in some metastable state there will be problems, such as over-fitting.

(iii) Correlation does not imply causation, the link between the two becoming exponentially fainter at increasing data size.  

(iv) In a finite-capacity world, too much data is just as bad as no data.

In other words, it is all about curve fitting. The more parameters used the less likely for insight to be gained. Here the authors quote the famous aphorism, attributed to von Neumann and Fermi, "with four parameters I can fit an elephant and with five I can make his tail wiggle."

Aside: an endearing part of the article is the inclusion of tow choice quotes from C.S. Lewis
‘Once you have surrendered your brain, you've surrendered your life’ (paraphrased)

‘When man proclaims conquest of power of nature, what it really means is conquest of power of some men over other men’.

I commend the article to you and look forward to hearing your perspective. Is the criticism of AI hype fair? Are these four scientific reasons good grounds for concern. 

Comments

Post a Comment

Popular posts from this blog

Is it an Unidentified Superconducting Object (USO)?

If you look on the arXiv and in Nature journals there is a continuing stream of people claiming to observe superconductivity in some new material. There is a long history of this and it is worth considering the wise observations of Robert Cava , back in 1997, contained in a tutorial lecture. It would have been useful indeed in the early days of the field [cuprate superconductors] to have set up a "commission" to set some minimum standard of data quality and reproducibility for reporting new superconductors. An almost countless number of "false alarms" have been reported in the past decade, some truly spectacular. Koichi Kitazawa from the University of Tokyo coined these reports "USOs", for Unidentified Superconducting Objects , in a clever cross-cultural double entendre likening them to UFOs (Unidentified Flying Objects, which certainly are their equivalent in many ways) and to "lies" in the Japanese translation of USO.   These have caused g
Read more

What is Herzberg-Teller coupling?

Image
Is it something to do with breakdown of the Born-Oppenheimer approximation? In molecular spectroscopy you occasionally hear this term thrown around. Google scholar yields more than 3000 hits. But I have found its precise meaning and the relevant physics hard to pin down. Quantum mechanics in chemistry by Schatz and Ratner is an excellent book , but the discussion on page 204 did not help me. "Herzberg-Teller" never appears in Atkins' Molecular quantum mechanics. So here is my limited understanding. Herzberg and Teller wanted to understand why one observed certain vibronic (combined electronic and vibrational) transitions that were not expected, particularly some that were expected to be forbidden on symmetry grounds. " Intensity borrowing " occurred. Herzberg and Teller pointed out that his could be understood if the dipole transition moment for the electronic transition depended on the nuclear co-ordinate associated with the vibration. In the Franck-Condo
Read more

What should be the order of authors on a conference poster or talk?

I welcome discussion on this point. I don't think it is as sensitive or as important a topic as the author order on papers. With regard to paper authorship my general rule is that the person who does the bulk of the work, including actually writing the paper should be the first author. Doug Natelson has a good post on co-authorship , that I largely agree with. My only difference is that I am not really convinced that good practice prevails in the majority of circumstances. I fear there are increasing numbers of co-authors, particularly senior ones, with marginal contributions. But, what about conference talks and posters? Many of these are based on work that is already or about to be published. Should the author order be identical as the associated papers? I am not sure it should necessarily be. My tentative view is that the person who writes and submits the abstract and actually prepares and presents the post/talk should be the first author. Perhaps they should also highlig
Read more