Describe the enhancement requested
Currently parquet only stores fields for predicate pushdown for scan pruning, but we can also keep sum in metadata field, while this won't help in predicate pushdown, but it can act as a pre-aggregation for sum and avg queries.
While this may be challenging and bit complex because we would need to handle sum/overflow etc. But this can be optional just like bloom filters and would be helpful for many usecases. And shouldn't have much of a overhead due to it being a stateless operation.
Describe the enhancement requested
Currently parquet only stores fields for predicate pushdown for scan pruning, but we can also keep
sumin metadata field, while this won't help in predicate pushdown, but it can act as a pre-aggregation for sum and avg queries.While this may be challenging and bit complex because we would need to handle sum/overflow etc. But this can be optional just like bloom filters and would be helpful for many usecases. And shouldn't have much of a overhead due to it being a stateless operation.