We use a few cookies

Essential cookies keep the library working. With your permission, we'd also like to use analytics to see what's useful and improve the experience. Read our Privacy Policy or Cookie Policy.

Skip to main content
Home/e-Resources/Life Sciences/Living Lab Evaluation for Life and Social Sciences Search Platforms -- LiLAS at CLEF 2021
PeriodicalsLife Sciences

Living Lab Evaluation for Life and Social Sciences Search Platforms -- LiLAS at CLEF 2021

arXiv2023

Checking your access to this record.

Abstract & Overview

Meta-evaluation studies of system performances in controlled offline evaluation campaigns, like TREC and CLEF, show a need for innovation in evaluating IR-systems. The field of academic search is no exception to this. This might be related to the fact that relevance in academic search is multilayered and therefore the aspect of user-centric evaluation is becoming more and more important. The Living Labs for Academic Search (LiLAS) lab aims to strengthen the concept of user-centric living labs for the domain of academic search by allowing participants to evaluate their retrieval approaches in two real-world academic search systems from the life sciences and the social sciences. To this end, we provide participants with metadata on the systems' content as well as candidate lists with the task to rank the most relevant candidate to the top. Using the STELLA-infrastructure, we allow participants to easily integrate their approaches into the real-world systems and provide the possibility to compare different approaches at the same time.

Cite this record

Philipp Schaer, Johann Schaible, Leyla Jael Castro (2023). Living Lab Evaluation for Life and Social Sciences Search Platforms -- LiLAS at CLEF 2021. arXiv. https://library.shubhaarti.com/content/3459ca81-8fb3-4acb-91b4-6e07c6b4cf26

Copy in another style

Schaer, P., Schaible, J., & Castro, L. J. (2023). Living Lab Evaluation for Life and Social Sciences Search Platforms -- LiLAS at CLEF 2021. arXiv. https://library.shubhaarti.com/content/3459ca81-8fb3-4acb-91b4-6e07c6b4cf26
Author names are used as deposited, so check their order before you submit.

Metadata is harvested from open-access indexes and can be incomplete. Check a citation against the published version before relying on it — see our open access & attribution policy.