Dagienė, Eleonora
The challenge of assessing academic books: The UK and Lithuanian cases through the ISBN lensItem type:Publication, research article[2024][S1][S008][30]Quantitative Science Studies., 2024, p. 98-127Books are an important output in many fields of research. However, they pose a significant challenge for research assessment systems, partly because of the limited availability of information to support the assessment of books. To inform book assessment practices, I present a systematic examination of the ISBN Manual and the Global Register of Publishers (GRP). I evaluate the extent to which these two sources can be used to determine the genre and publisher of a book as well as the country in which a book was issued. My analysis focuses on books submitted to the research assessment systems in Lithuania and the UK from 2008 to 2020. I show how the ISBN Manual captures the complex interactions between publishers, their imprints, and other organisations active in academic publishing, revealing the pitfalls of measuring books’ quality by their publisher’s prestige. The results also indicate that the ISBN standard provides no basis for the book genres mandated by research assessment systems in some countries. Finally, I demonstrate how the ISBN Manual and metadata accumulated in the GRP are convenient tools for designers of research assessment systems and are suitable for identifying ISBN registrants and performing bibliometric analysis.
53 24Scopus© Citations 7 Prestige of scholarly book publishers - An investigation into criteria, processes, and practices across countriesItem type:Publication, research article[2023][S1][S008][15]Research evaluation, 2023, vol. 32, no. 2, p. 356-370Numerous national research assessment policies aim to promote ‘excellence’ and incentivize scholars to publish their research in the most prestigious journals or with the most prestigious book publishers. We investigate the practicalities of assessing book outputs in different countries, concentrating on evaluation based on the prestige of book publishers (e.g. Denmark, Finland, Lithuania, Norway, Poland, and Spain). Additionally, we test whether such judgments are transparent and yield consistent results. We show inconsistencies in the levelling of publishers, such as cases where the same publisher is ranked as prestigious and not-so-prestigious in different states or within the same country in consequent years. Likewise, we find that verification of compliance with the mandatory prerequisites is not always possible because of the lack of transparency. Our findings support doubts about whether the assessment of books based on a judgement about their publishers yields acceptable outcomes. Even more, currently used rankings of publishers focus on evaluating the gatekeeping role of publishers but do not assess other essential stages in scholarly book publishing (e.g. dissemination or preservation). Our suggestion for future research is to develop approaches to evaluate books by accounting for the value added to every book at every publishing stage, which is vital for the quality of book outputs from research assessment and scholarly communication perspectives.
29Scopus© Citations 10