[CPM-SPIRE-L] PhD position in Grenoble (France) on continuous evaluation of web search engines

[Lorraine Goeuriot]

[Apologies for cross posting]

Please find below a Phd position offer (3 years) in the LIG in Grenoble (France), starting in February 2020, in a bilateral research project between the University of Grenoble Alpes and the Vienna Technical Unversity (Austria) (https://kodicare.imag.fr/ <https://kodicare.imag.fr/>).

Best regards.

Philippe Mulhem et Lorraine Goeuriot.

———————

Title: Information retrieval evaluation framework: towards continuous evaluation for industrial search engines

Supervision: P. Mulhem and L. Goeuriot

Starting date: February 2020

Duration: 36 months

Keywords: information retrieval, continuous evaluation, explainability

Evaluating search systems requires setting up an evaluation environment: select a paradigm, metrics, a dataset, etc. The choice of an environment is rarely motivated objectively, and the impact of its variations (choosing a dataset against another, altering one, etc.) is rarely measured. Such objectivity comes from a quantifiable understanding of the differences between datasets, documents, or test queries. In KoDicare, we generically call such difference “knowledge delta”. Evaluation of several environments, knowing their knowledge deltas, leads to measuring and qualifying “results deltas”. Online systems require continuous evaluation with a stable and meaningful environment that guarantees the reproducibility and explainability of systems results. A controlled environment quantifying both “knowledge deltas” and “result deltas” will support such continuous evaluation, and enable the provision of explanations for system engineers through the analysis of related changes in the two “deltas”. The theoretical results will be confronted to real cases defined by a French company that deploys a web search engine (Qwant). Currently, no such framework dedicated to real continuous evaluation of information retrieval systems exists, due to the numerous parameters that must be handled.

Objectives:

	• Definition and formalization of knowledge deltas
	• Creation of use cases
	• Creation of a framework allowing the measure of the results delta
	• Evaluation and analysis: correlations between knowledge delta and result delta
	• Revision of the framework, towards continuous evaluation of search engines
Required skills:

	• Knowledge in IR and its experimental evaluation
	• Knowledge in ML for IR
	• Strong development skills, preferably in Python, Java
Hosting institution:

University Grenoble Alpes is, in France, the top-1 University for computer sciences according to Shangai 2019 ranking. It enjoys an international reputation in many scientific fields, as confirmed by international rankings. The dynamic ecosystem, grounded on a close interaction between research, education and companies, has earned Grenoble to be ranked as the 5th most innovative city in the world. Surrounded by mountains, the campus benefits from a natural environment and a high quality of life and work environment. With 7000 foreign students and the annual visit of more than 8000 researchers from all over the world, Univ. Grenoble Alpes is an internationally engaged university. A personalized Welcome Center for international students, PhDs and researchers facilitates your arrival and installation.

Grenoble Informatics Laboratory (LIG) is one of the largest laboratories in Computer Science in France. It is structured as a Joint Research Center (French Unité Mixte de Recherche – UMR) founded by the following institutions: CNRS, Grenoble Institute of Technology (Grenoble INP), Inria Grenoble Rhône-Alpes, Grenoble Alpes University. The mission of LIG is to contribute to the development of fundamental aspects of Computer Science (models, languages, methodologies, algorithms) and address conceptual, technological, and societal challenges.

Gross salary: 2000€/month

Application: 
Candidates should send their application (CV, cover letter, transcripts…) by the 8th of December to philippe.mulhem at imag.fr and lorraine.goeuriot at imag.fr 


Lorraine Goeuriot
Maître de conférences
LIG - IUT1
Université Grenoble Alpes









-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://fenris.cs.ucr.edu/pipermail/cpm-spire-l/attachments/20191129/b03a898d/attachment.html>