It amazes and frustrates me that this basic point is so often neglected.
Comparisons are central to science in two respects.
Control variables.
As you vary just ONE parameter [pressure, electron-phonon coupling, temperature, isotope, Planck's constant] how do the results of the experiment or calculation vary.
People seem to often vary more than one parameter.
Or, they don't vary any. For example, they do some complicated calculation and get "an answer", i.e. a number, but don't investigate or report how that answer depends on the parameters or approximations in their calculation.
Comparison with earlier work.
Many people don't seem to feel a need or obligation to report how their results compare to those of others who did related experiments or simulations.
Earlier I made the case for why Tables are wonderful in papers for these reasons.
I also considered the astonishing case of a widely downloaded paper about the theory of hydrogen bonding that tried to make a case that there was no reason to compare the calculations to experiment.
It is interesting to me how often people neglect to make such comparisons. Yet after they give a talk these are often the first questions that are asked.
Do you agree this is a problem?
If so, why are people so reluctant to make comparisons?
Are they just lazy? Or scared?
Subscribe to:
Post Comments (Atom)
What is your experience of using AI for research in condensed matter theory?
I have been dabbling a little with using AI (at a very basic level) to help me with some research problems. For example, in a recent prepr...
-
This week Nobel Prizes will be announced. I have not done predictions since 2020 . This is a fun exercise. It is also good to reflect on w...
-
The Ising model is a paradigm in both statistical mechanics and condensed matter physics. Today for most theorists it is so familiar that so...
-
Some of my colleagues and I have started an interesting discussion about how to teach quantum theory to undergraduates. We have courses in t...
No comments:
Post a Comment