Wednesday, February 18, 2015

The case against citation metrics

This year I am on a committee that looks at funding applications from all areas of science. Inevitably, this will lead to problematic comparisons of the track records of mathematicians versus physicists versus biologists. The quick, lazy, and unjustified recourse is to start invoking impact factors and publications in luxury journals.

There is a very thorough and helpful report Citation Statistics from the International Mathematical Union that clearly shows how problematic citation metrics are.
Of particular interest is the graph below.
Note that mathematicians are cited three times less than physicists and six times less than life scientists.

Aside: I am not clear what the distinction is between life sciences and biological sciences. Is the latter more oriented to humans [e.g. medicine] and the latter plants and animals?

This report is cited in the San Francisco Declaration on Research Assessment, initiated by biologists, that is attracting significant interest and mentioned by Carl Caves on High Impact Factor Syndrome.

1 comment:

  1. I think the graph has a misleading title. Since the average number of citations per article must be the same as the average number of references per article, all the numbers given are far too low. They must mean citations in a certain period of time, but too often this isn't made clear at all.

    ReplyDelete

From Leo Szilard to the Tasmanian wilderness

Richard Flanagan is an esteemed Australian writer. My son recently gave our family a copy of Flanagan's recent book, Question 7 . It is...