The challenge of assessing academic books: The UK and Lithuanian cases through the ISBN lens

Abstract

Books are an important output in many fields of research. However, they pose a significant challenge for research assessment systems, partly because of the limited availability of information to support the assessment of books. To inform book assessment practices, I present a systematic examination of the ISBN Manual and the Global Register of Publishers (GRP). I evaluate the extent to which these two sources can be used to determine the genre and publisher of a book as well as the country in which a book was issued. My analysis focuses on books submitted to the research assessment systems in Lithuania and the UK from 2008 to 2020. I show how the ISBN Manual captures the complex interactions between publishers, their imprints, and other organisations active in academic publishing, revealing the pitfalls of measuring books’ quality by their publisher’s prestige. The results also indicate that the ISBN standard provides no basis for the book genres mandated by research assessment systems in some countries. Finally, I demonstrate how the ISBN Manual and metadata accumulated in the GRP are convenient tools for designers of research assessment systems and are suitable for identifying ISBN registrants and performing bibliometric analysis.