<html><head><meta http-equiv="Content-Type" content="text/html; charset=utf-8"></head><body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div dir="auto" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><span style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class="">[Apologies for cross posting]</span></div><div dir="auto" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><span style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class=""><br class=""></span></div><div dir="auto" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><span style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class="">Please find below a Phd position offer (3 years) in the LIG in Grenoble (France), starting in February 2020, in a bilateral research project between the University of Grenoble Alpes and the Vienna Technical Unversity (Austria) (</span><a href="https://kodicare.imag.fr/" class="">https://kodicare.imag.fr/</a><span style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class="">).</span><br class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);"><br class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);"><span style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class="">Best regards.</span><br class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);"><br class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);"><span style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);" class="">Philippe Mulhem et Lorraine Goeuriot.</span><br class="" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0);"><br class="">———————</div><div dir="auto" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><br class=""><font color="#000000" class=""><span style="caret-color: rgb(0, 0, 0);" class="">Title: Information retrieval evaluation framework: towards continuous evaluation for industrial search engines<br class=""><br class="">Supervision: P. Mulhem and L. Goeuriot<br class=""><br class="">Starting date: February 2020<br class=""><br class="">Duration: 36 months<br class=""><br class="">Keywords: information retrieval, continuous evaluation, explainability<br class=""><br class="">Evaluating search systems requires setting up an evaluation environment: select a paradigm, metrics, a dataset, etc. The choice of an environment is rarely motivated objectively, and the impact of its variations (choosing a dataset against another, altering one, etc.) is rarely measured. Such objectivity comes from a quantifiable understanding of the differences between datasets, documents, or test queries. In KoDicare, we generically call such difference “knowledge delta”. Evaluation of several environments, knowing their knowledge deltas, leads to measuring and qualifying “results deltas”. Online systems require continuous evaluation with a stable and meaningful environment that guarantees the reproducibility and explainability of systems results. A controlled environment quantifying both “knowledge deltas” and “result deltas” will support such continuous evaluation, and enable the provision of explanations for system engineers through the analysis of related changes in the two “deltas”. The theoretical results will be confronted to real cases defined by a French company that deploys a web search engine (Qwant). Currently, no such framework dedicated to real continuous evaluation of information retrieval systems exists, due to the numerous parameters that must be handled.<br class=""><br class="">Objectives:<br class=""><br class=""></span></font><div class=""><font color="#000000" class=""><span style="caret-color: rgb(0, 0, 0);" class=""><span class="Apple-tab-span" style="white-space:pre"> </span>• Definition and formalization of knowledge deltas<br class=""></span></font></div><div class=""><font color="#000000" class=""><span style="caret-color: rgb(0, 0, 0);" class=""><span class="Apple-tab-span" style="white-space:pre"> </span>• Creation of use cases<br class=""></span></font></div><div class=""><font color="#000000" class=""><span style="caret-color: rgb(0, 0, 0);" class=""><span class="Apple-tab-span" style="white-space:pre"> </span>• Creation of a framework allowing the measure of the results delta<br class=""></span></font></div><div class=""><font color="#000000" class=""><span style="caret-color: rgb(0, 0, 0);" class=""><span class="Apple-tab-span" style="white-space:pre"> </span>• Evaluation and analysis: correlations between knowledge delta and result delta<br class=""></span></font></div><div class=""><font color="#000000" class=""><span style="caret-color: rgb(0, 0, 0);" class=""><span class="Apple-tab-span" style="white-space:pre"> </span>• Revision of the framework, towards continuous evaluation of search engines<br class=""></span></font></div><font color="#000000" class=""><span style="caret-color: rgb(0, 0, 0);" class="">Required skills:<br class=""><br class=""></span></font><div class=""><font color="#000000" class=""><span style="caret-color: rgb(0, 0, 0);" class=""><span class="Apple-tab-span" style="white-space:pre"> </span>• Knowledge in IR and its experimental evaluation<br class=""></span></font></div><div class=""><font color="#000000" class=""><span style="caret-color: rgb(0, 0, 0);" class=""><span class="Apple-tab-span" style="white-space:pre"> </span>• Knowledge in ML for IR<br class=""></span></font></div><div class=""><font color="#000000" class=""><span style="caret-color: rgb(0, 0, 0);" class=""><span class="Apple-tab-span" style="white-space:pre"> </span>• Strong development skills, preferably in Python, Java<br class=""></span></font></div><font color="#000000" class=""><span style="caret-color: rgb(0, 0, 0);" class="">Hosting institution:<br class=""><br class="">University Grenoble Alpes is, in France, the top-1 University for computer sciences according to Shangai 2019 ranking. It enjoys an international reputation in many scientific fields, as confirmed by international rankings. The dynamic ecosystem, grounded on a close interaction between research, education and companies, has earned Grenoble to be ranked as the 5th most innovative city in the world. Surrounded by mountains, the campus benefits from a natural environment and a high quality of life and work environment. With 7000 foreign students and the annual visit of more than 8000 researchers from all over the world, Univ. Grenoble Alpes is an internationally engaged university. A personalized Welcome Center for international students, PhDs and researchers facilitates your arrival and installation.<br class=""><br class="">Grenoble Informatics Laboratory (LIG) is one of the largest laboratories in Computer Science in France. It is structured as a Joint Research Center (French Unité Mixte de Recherche – UMR) founded by the following institutions: CNRS, Grenoble Institute of Technology (Grenoble INP), Inria Grenoble Rhône-Alpes, Grenoble Alpes University. The mission of LIG is to contribute to the development of fundamental aspects of Computer Science (models, languages, methodologies, algorithms) and address conceptual, technological, and societal challenges.<br class=""><br class="">Gross salary: 2000€/month<br class=""><br class="">Application: <br class="">Candidates should send their application (CV, cover letter, transcripts…) by the 8th of December to <a href="mailto:philippe.mulhem@imag.fr" class="">philippe.mulhem@imag.fr</a> and lorraine.goeuriot@imag.fr </span></font></div><div dir="auto" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><font color="#000000" class=""><span style="caret-color: rgb(0, 0, 0);" class=""><br class=""></span></font></div><div dir="auto" style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><font color="#000000" class=""><span style="caret-color: rgb(0, 0, 0);" class=""><br class=""></span></font><div class="">
<div dir="auto" style="caret-color: rgb(0, 0, 0); color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; text-decoration: none; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div dir="auto" style="color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div style="color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div style="color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div style="color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div style="color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div style="color: rgb(0, 0, 0); letter-spacing: normal; text-align: start; text-indent: 0px; text-transform: none; white-space: normal; word-spacing: 0px; -webkit-text-stroke-width: 0px; word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class=""><div class="">Lorraine Goeuriot</div><div class="">Maître de conférences</div><div class="">LIG - IUT1</div><div class="">Université Grenoble Alpes</div></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"></div><br class="Apple-interchange-newline"><br class="Apple-interchange-newline">
</div>
<br class=""></div></body></html>