Context, goals, overview, logistics for PyGamma19
The [Astropy Project][1] is a community effort to develop a single core package for Astronomy in Python and foster interoperability between Python astronomy packages. In this talk I will give an introduction to the project, including an overview of progress so far, and I will outline our current plans for the future. I will also describe the Astropy coordinated and affiliated package...
CASA, the Common Astronomy Software Applications, is a package for radio astronomical telescopes that is developed by an international consortium of institutions from America, Asia, Australia and Europe. It is used to manipulate and process both interferometric and single dish data, and is the primary data processing software for the Karl G. Jansky Very Large Array (VLA) as well as the Atacama...
After a brief presentation of HEALPix, I will discuss the specificities of the CDS implementation.
This implementation has been natively coded in both Java and Rust. Wrappers make the Rust library accessible in Javascript/WebAssembly and Python.
Particular emphasis will be placed on the exact solution of cone/polygon coverage queries and on MOCs in which each cell contains a boolean flag.
I will give a brief presentation about the new Rust system programming langage:
- the compiler rules enabling memory safety
- how one can interface Rust code with Python
Then, regarding to what has been currently done in cdshealpix I will talk about the CI pipeline I used for generating and deploying binary wheels for different platforms.
I will present MOC (Multi Order Coverage maps), a Virtual Observatory standard allowing one to describe and compare spatial coverage of astronomical datasets.
After presenting the MOC format (based on HEALPix tessellation), I will show some practical applications of MOC usage, using the MOCPy library developed at CDS.
In several branches of astrophysics, high-level data format consists of event lists - containing the reconstructed energy, direction and arrival time (and some other informations, eg: event type) of each event. For analysis and visualisation, maps are made by astronomers with a pixelisation and binning chosen to suit the use case. FITS maps, using either a WCS or a HEALPix format, are commonly...
I will summarize two software suites used for analysis of Fermi-LAT data: the fermitools (formerly ScienceTools), and the fermipy python-based software package.
The Fermi-LAT instrument differs in a fundamental way from its predecessors, particularly EGRET, in having a much larger field of view and energy range. With also having a much larger effective area, the data volume is also substantially larger. The design of pointlike took these factors into account in contrast to the more standard software tools based on the EGRET experience. I will explain...
The Fermi Gamma-ray Burst Monitor (GBM), with its broad energy range and instantaneous coverage of 2/3 of the sky, observes a wide variety of flaring or transient phenomena. These capabilities make it ideally suited for the search of transient events and to contribute to the new era of multi-messenger astrophysics. The GBM team has recently released the GSPEC analysis package, a modern...
This talk focuses on three frameworks developed by the KM3NeT collaboration: KM3Pipe, aanet and OrcaNet.
KM3Pipe is a Python-based pipeline framework which is used to modularise different kinds of processes and workflows like data analysis, detector monitoring and ML training in the KM3NeT neutrino telescope experiment. Although it contains many implementations of project specific data formats...
I will present the history, general design considerations and challenges related to the prototype data processing framework ctapipe. The purpose of creating ctapipe was to provide an API and standard algorithms for creating low-level (reconstruction level) data processing pipelines for Atmospheric Cherenkov Telescopes---specifically for CTA, but also supporting other existing instruments. ...
An overview of past and current efforts to establish high-level data analysis with open-source tools (i.e. Gammapy or ctools) for the H.E.S.S. experiment will be presented. A focus will be given to ongoing work about the validation of these tools on public H.E.S.S. data (see https://www.mpi-hd.mpg.de/hfm/HESS/pages/dl3-dr1), as well as to the exploration of a 3D likelihood analysis...
MAGIC is one of the current Imaging Atmospheric Cherenkov Telescope (IACT) located at the Roque of los Muchachos Observatory on La Palma, one of the Canary Islands. It started to operate in 2003 and is still currently running. Since 2009, MAGIC operates in a stereoscopic mode with two telescopes. A Major hardware upgrade was performed in 2012 for both camera. I will present the status on the...
As the multi-messenger era is now fully active, it is crucial that the community has a framework within which to analyze data from multiple messengers, wavelengths, and instruments in a statistically robust, common way. 3ML (https://threeml.readthedocs.io) provides an abstract, plugin-based data interface for instruments to combine analysis through each instrument's own unique likelihood. As a...
Plenary discussion on gamma-ray data, IRFs and science tools
In the context of Cherenkov astronomy, the data processing stages imply both assumptions and comparison to dedicated simulation. Those data can be misleading if not documented. This has implications on the format specification for the data that will be exposed to be used in relation with other frequencies for modeling.
Provenance information in astronomy is important to enable scientists to trace back the origin of a dataset, a document or a device, learn about the people and organizations involved in a project and assess the quality as well as the usefulness of the dataset, document or device for their scientific work. Current efforts to model the Provenance information in Astronomy led to the development...
Since the begin of its operation in 2003, the MAGIC telescopes collected data from more than 60 TeV emitters. The collaboration distributes public FITS files with high-level data such as spectral energy distributions, light curves and skymaps for every published result. Here we report on the efforts to complement this products with more ample information (data quality, fit models, etc) and...
JetSeT is an open source Python framework with a C numerical engine, to reproduce radiative and accelerative processes acting in relativistic jets, allowing to fit the numerical models to observed data([https://jetset.readthedocs.io/en/latest/][1] [https://github.com/andreatramacere/jetset][2])
The main features of this framework are:
- handling observed data (rebinning, definition of...
Python is now the dominant language in scientific computing. Especially astroparticle physics and astronomy experiments have embraced Python enthusiastically, for example, the IceCube Neutrino Observatory. CERN experiments are also moving analysis steadily towards Python. ROOT is the foundational library in many HEP experiments, so I will give a brief summary on current developments in ROOT....
I will present examples of python code optimization. First we will focus on wrapped C++ code to speed up significantly analysis. Secondly, I will talk about function minimization with PyTorch and how it can be used through two examples: likelihood minimization on GPU for ImPACT optimization and deep learning with the gamma-learn project.
An introduction to Numba, a Python package which compiles Python code on-the-fly to produce efficient machine code, potentially providing huge improvements in execution time.
What are good choices / pros and cons of the various high-performance computing options in Python for our codes?
The Fermi Science Tools are a software suite provided by the Fermi Science Support Center (FSSC) to facilitate analysis of data gathered by the Fermi Gamma-Ray Space Telescope. In the past the software was distributed via compiled binaries or compile-able source code downloads from the FSSC’s website. While this system was effective, it relied on a large amount of developer hours from the FSSC...
Jupyter notebooks have arrived to stay as a means to document the scientific analysis protocol, as well as to provide executable recipes shared seamlessly among the community. This has triggered the rise of a plethora of complementary tools and services associated to them. This talk will cover different possibilities to use Jupyter notebooks and JupyterLab interface. We will start with the...
PyGamma19 summary and group discussion
ASTErIsM is a flexible python open-source framework for detection, morphometry and shape classification of astronomical sources, bases on clustering algorithm and machine learning. ASTErIsM works both on ccd images and photon list (e.g. Fermi). This framework is currently used as deblending algorithm for the Euclid pipeline. I will present the capabilities of the algorithm for:
1)...
We try to build a working physically motivated background model which can be fitted to the data of the Gamma-Ray Burst Monitor. This would yield several interesting applications, like searching for ultra long GRBs and fitting the cosmic gamma ray background spectrum. This poster shows the progress we have made so far.
Through the use of the BALROG code's improved statistical treatment (https://arxiv.org/abs/1610.07385 , https://arxiv.org/abs/1902.01082), it is now possible to achieve superior localization performance for the Gamma-ray Burst Monitor (GBM) on-board the Fermi space telescope. The code is currently being used to rapidly...
