Effective Data Skew Handling for Parallel Sorting in Multiprocessor Database Systems

• Main Authors: Yu-Chen Huang, 黃渝臻
• Other Authors: Yu-lung Lo
• Format: Others
• Language: zh-TW
• Published: 2003
• Online Access: http://ndltd.ncl.edu.tw/handle/ufb72n

碩士 === 朝陽科技大學 === 資訊管理系碩士班 === 91 === A consensus on parallel architecture for very large database management has emerged. This architecture is based on a shared-nothing hardware organization. The computation model is very sensitive to skew in tuple distribution, however. Sorting operation is frequently used for database processing. For example sorting may be requested by users through the use of Distinct, Order By and Group By clauses in SQL. Although load balancing incurs processing costs, and therefore can have a profound influence on the optimized execution plan of a query, only few of the existing parallel sorting execution consider this factor. In this report, we present four parallel sorting algorithms using the dynamic load balancing technique to address the data skew problem. Our performance study indicates that the proposed parallel sorting techniques can provide very impressive performance improvement over conventional approaches.