Dans le cadre de l’axe transverse IA-Science des données, le LIRMM accueillera le Lundi 18 Novembre à 15h, le Professeur Preslav Nakov qui donnera un séminaire dans l’Amphi St Priest (JJ Moreau - Bât 2).

François Grolleau

This talk examines two critical aspects of data-driven medicine: personalized treatment strategies using causal inference and the robust evaluation of large language models (LLMs) for clinical applications.

In the first part, we present a novel approach to personalized medicine, applying causal statistical learning to observational data to develop individualized treatment rules. We focus on optimizing the timing of renal replacement therapy initiation in acute kidney injury, demonstrating: (i) the estimation and validation of an optimal dynamic strategy, and (ii) a comprehensive framework for evaluating individualized rules using observational data.

In the second part, we tackle the challenge of evaluating LLMs in medicine, focusing on the generation of hospital course summaries. Current evaluation methods are often either unscalable (physician-led) or untrustworthy for clinical settings (LLM-as-a-judge). We propose a rubric-based approach to LLM evaluation that combines the scalability of automated methods with the trustworthiness demanded by medical applications, paving the way for responsible deployment of LLMs in healthcare.

Data-driven medicine, LLMs, clinical applications, LabéliséHallesIA

Inria Montpellier, St-Priest Campus, Building 5, Room 01/124
Machine Learning in Montpellier, Theory & Practice

Data.table is one of the most efficient open-source in-memory data manipulation packages available today. First released to CRAN by Matt Dowle in 2006, it continues to grow in popularity, and now over 1500 other CRAN packages depend on data.table. This talk will start with data reading from CSV, discuss basic and advanced data manipulation topics, and finally will end with a discussion about how you can contribute to data.table.
https://github.com/tdhock/2023-10-LatinR-data.table?tab=readme-ov-file#source-files-for-latinr-datatable-tutorial-slides

LabéliséHallesIA

Inria Montpellier, St-Priest Campus, Building 5, Room 02/022
Machine Learning in Montpellier, Theory & Practice

Machine learning classifiers often produce probabilistic predictions that are critical for accurate and interpretable decision-making in various domains. The quality of these predictions is generally evaluated with proper losses like cross-entropy, which decompose into two components: calibration error assesses general under/overconfidence, while refinement error measures the ability to distinguish different classes.
In this paper, we provide theoretical and empirical evidence that these two errors are not minimized simultaneously during training. Selecting the best training epoch based on validation loss thus leads to a compromise point that is suboptimal for both calibration error and, mostimportantly, refinement error. To address this, we introduce a new metric for early stopping and hyperparameter tuning that makes it possible to minimize refinement error during training. The calibration error is minimized after training, using standard techniques. Our method integrates seamlessly with any architecture and consistently improves performance across diverse classification tasks.

LabéliséHallesIA