Large Elasticsearch cluster management
The Centralised Elasticsearch Service at CERN runs the infrastructure to provide Elasticsearch clusters for more than 100 different use cases. This contribution presents how the infrastructure is managed, covering the resource distribution, instance creation, cluster monitoring and user support. The...
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
EDP Sciences
2020-01-01
|
Series: | EPJ Web of Conferences |
Online Access: | https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_07021.pdf |
id |
doaj-7256842e26d34301867debea854ae7aa |
---|---|
record_format |
Article |
spelling |
doaj-7256842e26d34301867debea854ae7aa2021-08-02T16:11:00ZengEDP SciencesEPJ Web of Conferences2100-014X2020-01-012450702110.1051/epjconf/202024507021epjconf_chep2020_07021Large Elasticsearch cluster managementSaiz Pablo0Schwickerath Ulrich1CERN Esplanade des Particules 1CERN Esplanade des Particules 1The Centralised Elasticsearch Service at CERN runs the infrastructure to provide Elasticsearch clusters for more than 100 different use cases. This contribution presents how the infrastructure is managed, covering the resource distribution, instance creation, cluster monitoring and user support. The contribution will present the components that have been identified as critical in order to share resources and minimise the amount of clusters and machines needed to run the service. In particular, all the automation for the instance configuration, including index template management, backups and visualisation settings, will be explained in detail.https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_07021.pdf |
collection |
DOAJ |
language |
English |
format |
Article |
sources |
DOAJ |
author |
Saiz Pablo Schwickerath Ulrich |
spellingShingle |
Saiz Pablo Schwickerath Ulrich Large Elasticsearch cluster management EPJ Web of Conferences |
author_facet |
Saiz Pablo Schwickerath Ulrich |
author_sort |
Saiz Pablo |
title |
Large Elasticsearch cluster management |
title_short |
Large Elasticsearch cluster management |
title_full |
Large Elasticsearch cluster management |
title_fullStr |
Large Elasticsearch cluster management |
title_full_unstemmed |
Large Elasticsearch cluster management |
title_sort |
large elasticsearch cluster management |
publisher |
EDP Sciences |
series |
EPJ Web of Conferences |
issn |
2100-014X |
publishDate |
2020-01-01 |
description |
The Centralised Elasticsearch Service at CERN runs the infrastructure to provide Elasticsearch clusters for more than 100 different use cases.
This contribution presents how the infrastructure is managed, covering the resource distribution, instance creation, cluster monitoring and user support. The contribution will present the components that have been identified as critical in order to share resources and minimise the amount of clusters and machines needed to run the service. In particular, all the automation for the instance configuration, including index template management, backups and visualisation settings, will be explained in detail. |
url |
https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_07021.pdf |
work_keys_str_mv |
AT saizpablo largeelasticsearchclustermanagement AT schwickerathulrich largeelasticsearchclustermanagement |
_version_ |
1721229898214801408 |