The NOTED software tool-set improves efficient network utilization for Rucio data transfers via FTS

• Main Authors: Busse-Grawitz Coralie, Martelli Edoardo, Lassnig Mario, Manzi Andrea, Keeble Oliver, Cass Tony
• Format: Article
• Language: English
• Published: EDP Sciences 2020-01-01
• Series: EPJ Web of Conferences
• Online Access: https://www.epj-conferences.org/articles/epjconf/pdf/2020/21/epjconf_chep2020_07022.pdf

We present NOTED, a project to better exploit WAN bandwidth for Rucio and FTS data transfers. We describe the developed software tool-box and a successful demonstration of automated load-balancing in the production network. The first component is the Transfer Broker: It identifies large data transfers for which network reconfiguration is both possible and beneficial, and translates the transfer information into parameters that can be used by network controllers. It will make this information available via a public interface. The second component is a demonstration of a Network Controller. It periodically reads the parameters provided by the Transfer Broker, and so decides which actions to apply to improve the network utilisation for a given transfer.