JUNIPR: a framework for unsupervised machine learning in particle physics

Abstract In applications of machine learning to particle physics, a persistent challenge is how to go beyond discrimination to learn about the underlying physics. To this end, a powerful tool would be a framework for unsupervised learning, where the machine learns the intricate high-dimensional cont...

Full description

Bibliographic Details
Main Authors: Anders Andreassen, Ilya Feige, Christopher Frye, Matthew D. Schwartz
Format: Article
Language:English
Published: SpringerOpen 2019-02-01
Series:European Physical Journal C: Particles and Fields
Online Access:http://link.springer.com/article/10.1140/epjc/s10052-019-6607-9
id doaj-f0e37ae3be0148a0b2124a5e367626a7
record_format Article
spelling doaj-f0e37ae3be0148a0b2124a5e367626a72020-11-25T01:17:48ZengSpringerOpenEuropean Physical Journal C: Particles and Fields1434-60441434-60522019-02-0179212410.1140/epjc/s10052-019-6607-9JUNIPR: a framework for unsupervised machine learning in particle physicsAnders Andreassen0Ilya Feige1Christopher Frye2Matthew D. Schwartz3Department of Physics, Harvard UniversityASI Data ScienceDepartment of Physics, Harvard UniversityDepartment of Physics, Harvard UniversityAbstract In applications of machine learning to particle physics, a persistent challenge is how to go beyond discrimination to learn about the underlying physics. To this end, a powerful tool would be a framework for unsupervised learning, where the machine learns the intricate high-dimensional contours of the data upon which it is trained, without reference to pre-established labels. In order to approach such a complex task, an unsupervised network must be structured intelligently, based on a qualitative understanding of the data. In this paper, we scaffold the neural network’s architecture around a leading-order model of the physics underlying the data. In addition to making unsupervised learning tractable, this design actually alleviates existing tensions between performance and interpretability. We call the framework Junipr: “Jets from UNsupervised Interpretable PRobabilistic models”. In this approach, the set of particle momenta composing a jet are clustered into a binary tree that the neural network examines sequentially. Training is unsupervised and unrestricted: the network could decide that the data bears little correspondence to the chosen tree structure. However, when there is a correspondence, the network’s output along the tree has a direct physical interpretation. Junipr models can perform discrimination tasks, through the statistically optimal likelihood-ratio test, and they permit visualizations of discrimination power at each branching in a jet’s tree. Additionally, Junipr models provide a probability distribution from which events can be drawn, providing a data-driven Monte Carlo generator. As a third application, Junipr models can reweight events from one (e.g. simulated) data set to agree with distributions from another (e.g. experimental) data set.http://link.springer.com/article/10.1140/epjc/s10052-019-6607-9
collection DOAJ
language English
format Article
sources DOAJ
author Anders Andreassen
Ilya Feige
Christopher Frye
Matthew D. Schwartz
spellingShingle Anders Andreassen
Ilya Feige
Christopher Frye
Matthew D. Schwartz
JUNIPR: a framework for unsupervised machine learning in particle physics
European Physical Journal C: Particles and Fields
author_facet Anders Andreassen
Ilya Feige
Christopher Frye
Matthew D. Schwartz
author_sort Anders Andreassen
title JUNIPR: a framework for unsupervised machine learning in particle physics
title_short JUNIPR: a framework for unsupervised machine learning in particle physics
title_full JUNIPR: a framework for unsupervised machine learning in particle physics
title_fullStr JUNIPR: a framework for unsupervised machine learning in particle physics
title_full_unstemmed JUNIPR: a framework for unsupervised machine learning in particle physics
title_sort junipr: a framework for unsupervised machine learning in particle physics
publisher SpringerOpen
series European Physical Journal C: Particles and Fields
issn 1434-6044
1434-6052
publishDate 2019-02-01
description Abstract In applications of machine learning to particle physics, a persistent challenge is how to go beyond discrimination to learn about the underlying physics. To this end, a powerful tool would be a framework for unsupervised learning, where the machine learns the intricate high-dimensional contours of the data upon which it is trained, without reference to pre-established labels. In order to approach such a complex task, an unsupervised network must be structured intelligently, based on a qualitative understanding of the data. In this paper, we scaffold the neural network’s architecture around a leading-order model of the physics underlying the data. In addition to making unsupervised learning tractable, this design actually alleviates existing tensions between performance and interpretability. We call the framework Junipr: “Jets from UNsupervised Interpretable PRobabilistic models”. In this approach, the set of particle momenta composing a jet are clustered into a binary tree that the neural network examines sequentially. Training is unsupervised and unrestricted: the network could decide that the data bears little correspondence to the chosen tree structure. However, when there is a correspondence, the network’s output along the tree has a direct physical interpretation. Junipr models can perform discrimination tasks, through the statistically optimal likelihood-ratio test, and they permit visualizations of discrimination power at each branching in a jet’s tree. Additionally, Junipr models provide a probability distribution from which events can be drawn, providing a data-driven Monte Carlo generator. As a third application, Junipr models can reweight events from one (e.g. simulated) data set to agree with distributions from another (e.g. experimental) data set.
url http://link.springer.com/article/10.1140/epjc/s10052-019-6607-9
work_keys_str_mv AT andersandreassen junipraframeworkforunsupervisedmachinelearninginparticlephysics
AT ilyafeige junipraframeworkforunsupervisedmachinelearninginparticlephysics
AT christopherfrye junipraframeworkforunsupervisedmachinelearninginparticlephysics
AT matthewdschwartz junipraframeworkforunsupervisedmachinelearninginparticlephysics
_version_ 1725145816609325056