Description
split and rowgroup prefetch plays the main factor of performance boost in Gluten today, but the cost is high memory consumption. We should enahnce table scan to either pause the prefetch once memory is full or support spill in table scan.
Gluten version
None
Description
split and rowgroup prefetch plays the main factor of performance boost in Gluten today, but the cost is high memory consumption. We should enahnce table scan to either pause the prefetch once memory is full or support spill in table scan.
Gluten version
None