Large Elasticsearch cluster management

The Centralised Elasticsearch Service at CERN runs the infrastructure to provide Elasticsearch clusters for more than 100 different use cases. This contribution presents how the infrastructure is managed, covering the resource distribution, instance creation, cluster monitoring and user support. The...

Full description

Bibliographic Details
Main Authors: Saiz Pablo, Schwickerath Ulrich
Format: Article
Language:English
Published: EDP Sciences 2020-01-01
Series:EPJ Web of Conferences
Online Access:https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_07021.pdf
id doaj-7256842e26d34301867debea854ae7aa
record_format Article
spelling doaj-7256842e26d34301867debea854ae7aa2021-08-02T16:11:00ZengEDP SciencesEPJ Web of Conferences2100-014X2020-01-012450702110.1051/epjconf/202024507021epjconf_chep2020_07021Large Elasticsearch cluster managementSaiz Pablo0Schwickerath Ulrich1CERN Esplanade des Particules 1CERN Esplanade des Particules 1The Centralised Elasticsearch Service at CERN runs the infrastructure to provide Elasticsearch clusters for more than 100 different use cases. This contribution presents how the infrastructure is managed, covering the resource distribution, instance creation, cluster monitoring and user support. The contribution will present the components that have been identified as critical in order to share resources and minimise the amount of clusters and machines needed to run the service. In particular, all the automation for the instance configuration, including index template management, backups and visualisation settings, will be explained in detail.https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_07021.pdf
collection DOAJ
language English
format Article
sources DOAJ
author Saiz Pablo
Schwickerath Ulrich
spellingShingle Saiz Pablo
Schwickerath Ulrich
Large Elasticsearch cluster management
EPJ Web of Conferences
author_facet Saiz Pablo
Schwickerath Ulrich
author_sort Saiz Pablo
title Large Elasticsearch cluster management
title_short Large Elasticsearch cluster management
title_full Large Elasticsearch cluster management
title_fullStr Large Elasticsearch cluster management
title_full_unstemmed Large Elasticsearch cluster management
title_sort large elasticsearch cluster management
publisher EDP Sciences
series EPJ Web of Conferences
issn 2100-014X
publishDate 2020-01-01
description The Centralised Elasticsearch Service at CERN runs the infrastructure to provide Elasticsearch clusters for more than 100 different use cases. This contribution presents how the infrastructure is managed, covering the resource distribution, instance creation, cluster monitoring and user support. The contribution will present the components that have been identified as critical in order to share resources and minimise the amount of clusters and machines needed to run the service. In particular, all the automation for the instance configuration, including index template management, backups and visualisation settings, will be explained in detail.
url https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_07021.pdf
work_keys_str_mv AT saizpablo largeelasticsearchclustermanagement
AT schwickerathulrich largeelasticsearchclustermanagement
_version_ 1721229898214801408