Efficient Time Frame Building for Online Data Reconstruction in ALICE Experiment. Issue 8 (December 2015)

• Record Type: Journal Article
• Authors: Rybalchenko, A.; Al-Turany, M.; Kouzinopoulos, C.; Winckler, N.
• Is Part Of: Journal of physics. Volume 664:Issue 8(2015)
• Publication Date: 2015-12
• Subjects: Physics -- Congresses; 530.5
• DOI: 10.1088/1742-6596/664/8/082048
• Languages: English
• ISSNs: 1742-6588

Abstract

Abstract: After the Long Shutdown 2 period, the upgraded ALICE detector at the LHC will produce more than a terabyte of data per second. The data, constituted from a continuous un-triggered stream data, have to be distributed from about 250 First Level Processor nodes (FLPs) to about 1500 Event Processing Nodes (EPNs). Each FLP receives a small subset of the detector data that is chopped in sub-time frames. One EPN needs all the fragments from the 250 FLPs to build a full time frame. An algorithm has been implemented on the FLPs with the aim of optimizing the usage of the network connecting the FLPs and EPNs. The algorithm minimizes contention when several FLPs are sending to the same EPN. An adequate traffic shaping is implemented by delaying the sending time of each FLP by a unique offset. The payloads are stored in a buffer large enough to accommodate the delay provoked by the maximum number of FLPs. As the buffers are queued for sending, the FLPs can operate with the highest efficiency. Using the time information embedded in the data any further FLP synchronization can be avoided. Moreover, zero-copy and multipart messages of ZeroMQ are used to create full time frames on the EPNs without the overhead of copying the payloads. The concept and the performance measurement of the implementation on a reference computing cluster are presented.