Special track 1. Dataset harmonization and indicator development on Science Technology and Innovation. Insights from the RISIS project.
Benedetto Lepori, Daniel Wagner-Schuster, Thomas Scherngell, Patricia Laurens and Antoine Schoen
Impressive developments have taken place in the development of Science and Technology Indicators in the last few decades, including advanced bibliometric indicators on scientific output, patents for technological output, as well as indicators on research investment and higher education institutions. The focus shifted rapidly form aggregated indicators at the level of whole national systems to more disaggregated indicators displaying the positioning of actors within the research system. This proliferation generated the challenge of interoperability and of developing specific indicators tailored to diverse user and policy needs.
This panel will report the experience of the RISIS infrastructure project in addressing these challenges. This session will aim at presenting the state of development of S&T indicators as one of the main RISIS activities and to present the services currently available. The program is a follows:
General introduction on indicators in RISIS (Benedetto Lepori).
The OrgReg indicators module: status and issues (Benedetto Lepori)
Demo of the OrgReg indicators module (Daniel Wagner-Schuster)
Regional indicators: status and prospects (incl. KNOWMAK; Thomas Scherngell)
Indicators on large firms (Antoine Schön and Patricia Laurens)
Q&A and open discussion.
Special track 2. Beyond Gender – Tracking Ethnic Diversity Through Publications.
Ryan Beardsley and Gali Halevi
Promoting diversity and inclusion in STEM has been a topic of public and research discussions in the past few years especially on gender inequality. Research on ethnic diversity in STEM is mostly based on institutional surveys or employment records that shed a light on the topic but do not provide an insight into the research publications arena.
This special track welcomes submissions related to bibliometric methods and studies on gender and racial inequalities in science.
Special track 3. Responsible research assessment: Moving from rhetoric to reality Interactive closed panel discussion with audience Q&A.
Alex Rushforth, Wolfgang Kaltenbrunner and Sarah de Rijcke
The publication of principles, guidance and manifestos setting out values and good practice norms for research assessment practitioners to aspire to have been growing exponentially over the past decade. Alongside calls for responsible metrics, various campaigns to reform research culture (including moves to promote open science; research integrity; diversity, equity and inclusion; and broaden the social impacts of research) have recently been coalescing under the umbrella term ‘responsible research assessment’.
This session consists of three presentations on the introduction of novel ‘responsible’ assessment practices in funding or research performing organisations from four pre-selected speakers: Gunnar Sivertsen (NIFU); Rochelle Fritch (Science Foundation Ireland); De Rijcke and Kaltenbrunner (joint presentation). Each presentation will last up to ten minutes and focus on: lessons speakers have learnt about opportunities and challenges associated with achieving and sustaining changes in research assessment practices; what kinds of resources and infrastructure can support such efforts. The moderator (Rushforth) will then invite Q&A discussion with the audience, asking how the STI research community can best inform and shape responsible research assessment practices going forwards.
Special track 4. Language bias in evaluative metrics.
Janne Pölönen*, Zehra Taskin** and Emanuel Kulczycki
This track addresses the specific issue of language bias in research assessment resulting from application of global metrics in local evaluation and funding procedures for institutions and individual researchers. In many non-Anglophone countries internationality is equated with scholarly communication in English even if researchers use other international languages as, among others, Spanish in Latin America or Arab and French in Africa. International excellence is commonly measured by publications and citations in international English language outlets indexed in databases such as the Web of Science or Scopus. Also, the most promising altmetrics sources mainly cover research published in English.
This special track aims to highlight ongoing research into language bias in evaluative metrics and how it is recognized and addressed in different countries and local evaluation contexts, thus stimulating the exchange of expertise and mutual learning. We invite both empirical and conceptual contributions to the discussion.
Special track 5. The significance of rejections and retractions in the saturation state of the peer review process.
Juan Gorraiz, Nicolas Robinson Garcia, Ursula Ulrych, Thed N. van Leeuwen, Janne Pölönen and Vincent Larivière
It is becoming increasingly difficult to find reviewers and there is growing dissatisfaction with the quality and value of reviews, many of which are carried out in a rush at the last minute. Under these circumstances, it is logical questioning the value and significance of an acceptance or rejection. On the other hand, the retraction of an article has recently provoked a wide discussion in the international scientometric community, and has raised many questions and doubts.
After a brief introduction to the topic provided by the authors (10 minutes), the workshop will start with short statements (around 5-10 minutes) of the invited participants sharing their personal view on the five key questions suggested before.
Finally, the audience will be invited to ask questions via the Chat or Q&A section and the most relevant issues will be summarized in a final wrap up.
Special track 6. Advanced Representations of Scholarly Knowledge (ASK).
Angelo Salatino, Sahar Vahdati, and Francesco Osborne
The main objective of this special track is to bring together researchers and practitioners from different fields (including, but not limited to, Digital Libraries, Information Extraction, Machine Learning, Semantic Web, Knowledge Engineering, Natural Language Processing, Scholarly Communication, and Bibliometrics) to explore innovative solutions and ideas for generating and leveraging advanced representations of scholarly knowledge (SK).
This special track welcomes submissions on the following topics:
development of classification schemes, taxonomies, ontologies, and knowledge graphs for describing and organising scholarly knowledge;
advanced representations of scientific documents and their metadata;
(semi-)automatic extraction of entities, concepts, and relations from text;
development of relevant services for facilitating the description and the exploration of research knowledge, measuring impact, and supporting researchers;
use of advanced representation learning methods (e.g., language models) over scholarly KGs;
interactive interfaces for exploring representations of research knowledge.
Special track 7. Present and future of research metadata: where do we want to go from here?
Alberto Martín-Martín, Benjamín Vargas-Quesada, Zaida Chinchilla-Rodríguez and Manuel Jesús Cobo
The topics of the contributions to this special track can include:
Analyses of the suitability of research metadata sources for specific use cases
Sustainability and governance of research metadata
Innovations in research metadata
Downstream applications of open research metadata
Surveillance through research metadata
We welcome submissions related to any of the topics selected above. The format of the session would be 15-20 minutes per presentation, with time for questions after each presentation.
