Interpretable Machine Learning with Bitonic Generalized Additive Models and Automatic Feature Construction

Noëlie Cherrier (1, 2) , Michael Mayo (3) , Jean-Philippe Poli (1) , Maxime Defurne (2) , Franck Sabatié (2)

1 LI3A (CEA, LIST) - Intelligence Artificielle et Apprentissage Automatique (CEA, LIST)
2 IRFU - Institut de Recherches sur les lois Fondamentales de l'Univers
3 University of Waikato [Hamilton]

In many machine learning applications, interpretable models are necessary for the sake of trust or for further understanding the patterns in the data. In particular, scientists often want models that elucidate knowledge and therefore may lead to new discoveries. Currently, Generalized Additive Models (GAM) are gaining interest in other application domains because of their ability to fit the data well while at the same time being intelligible. Moreover, prior domain-specific knowledge is often valuable to guide the learning. In this work, extensions and generalizations of GAM are proposed to incorporate prior knowledge during the learning phase. Specifically, the fitting method for GAM is modified so that it can fit the data with bitonic functions. In physics for instance, the most discriminative variables often present specific distributions with respect to the target variable, especially peaking (i.e. bitonic) distributions. An algorithm is also described to build automatically bitonic high-level features to be used in the GAM terms. Experiments on three physics datasets are used to validate these ideas in conjunction with physics scientists.

Keywords: artificial intelligence; machine learning; online learning; interpretable model; Trustworthy Artificial intelligence; pattern understanding; interpretability; Generalized Additive Models (GAM); prior domain-specific knowledge; learning guiding; GAM extension; GAM generalization; fitting method; bitonic function; discriminative variable; specific distribution; target variable; bitonic distribution; bitonic high-level features

Domains: Machine Learning [stat.ML]; Artificial Intelligence [cs.AI]; Machine Learning [cs.LG]

Noëlie Cherrier, Michael Mayo, Jean-Philippe Poli, Maxime Defurne, Franck Sabatié. Interpretable Machine Learning with Bitonic Generalized Additive Models and Automatic Feature Construction. 23rd International Conference, Discovery Science 2020, Oct 2020, Thessaloniki, Greece. pp.386-402, ⟨10.1007/978-3-030-61527-7_26⟩. ⟨cea-04564475⟩