Add benchmark to the CI

[Fokko]

Feature Request / Improvement

Would be great to have a benchmark to detect regression in the CI. I think this can be part of the integration tests, where we create a table with multiple partitions. It would also be great to capture the number of requests to minio by tracking the logs.

Migrated from apache/iceberg#8550

[github-actions]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[github-actions]

This issue has been closed because it has not received any activity in the last 14 days since being marked as 'stale'

[sungwy]

bump - not stale

[sungwy]

I think this will be important for us to implement before a 1.0.0 release to benchmark performances of certain operations before and after proposed changes. This will help us guard against introducing unexpected performance regressions in new releases.

[github-actions]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.

[github-actions]

This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.