8–10 May 2023
University of Pittsburgh
US/Eastern timezone

Feature selection using distance correlation

8 May 2023, 18:00
15m
Lawrence Hall 203

Lawrence Hall 203

Speaker

Ranit Das (Rutgers University)

Description

Choosing which properties of the data to use as input to multivariate decision algorithms -- a.k.a. feature selection -- is an important step in solving any problem with machine learning. While there is a clear trend towards training sophisticated deep networks on large numbers of relatively unprocessed inputs (so-called automated feature engineering), for many tasks in physics, sets of theoretically well-motivated and well-understood features already exist. Working with such features can bring many benefits, including greater interpretability, reduced training and run time, and enhanced stability and robustness. We develop a new feature selection method based on Distance Correlation (DisCo), and demonstrate its effectiveness on the tasks of boosted top- and W-tagging. Using our method to select features from a set of over 7,000 energy flow polynomials, we show that we can match the performance of much deeper architectures, by using only ten features and two orders-of-magnitude fewer model parameters.

Authors

David Shih Gregor Kasieczka (Hamburg University (DE)) Ranit Das (Rutgers University)

Presentation materials