Execution Repair for Spark Programs by Active Maintenance of Partition Dependency

Spark programs typically codify to reuse some of their generated datasets, called partition instances, to make their subsequent computations complete in a reasonable time. At runtime, however, the underlying Spark platform may independently delete such instances or accidentally cause these instances...

Full description

Bibliographic Details
Main Authors: Xiupei Mei, Imran Ashraf, Xiaoxue Ma, Hao Zhang, Zhengyuan Wei, Haipeng Wang, W. K. Chan
Format: Article
Language:English
Published: IEEE 2021-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/9488244/