Ashin Gau
5bfdfac387
[feature-wip](parquet-reader) add parquet reader profile (#12797)
Add profile for parquet reader. New counters:
- ParquetFilteredGroups: Filtered row groups by `RowGroup` min-max statistics
- ParquetReadGroups: The number of row groups to read
- ParquetFilteredRowsByGroup: The number of filtered rows by `RowGroup` min-max statistics
- ParquetFilteredRowsByPage: The number of filtered rows by page min-max statistics
- ParquetFilteredBytes: The filtered bytes by `RowGroup` min-max statistics
- ParquetReadBytes: The total bytes in `ParquetReadGroups`, may be further filtered If a page is skipped as a whole
## Result
```
┌──────────────────────────────────────────────────────┐
│[0: VFILE_SCAN_NODE] │
│(Active: 1s29ms, non-child: 96.42) │
│ - Counters: │
│ - BytesRead: 0.00 │
│ - FileReadCalls: 1.826K (1826) │
│ - FileReadTime: 510.627ms │
│ - FileRemoteReadBytes: 65.23 MB │
│ - FileRemoteReadCalls: 1.146K (1146) │
│ - FileRemoteReadRate: 128.29331970214844 MB/sec │
│ - FileRemoteReadTime: 508.469ms │
│ - NumDiskAccess: 0 │
│ - NumScanners: 1 │
│ - ParquetFilteredBytes: 0.00 │
│ - ParquetFilteredGroups: 0 │
│ - ParquetFilteredRowsByGroup: 0 │
│ - ParquetFilteredRowsByPage: 6.600003M (6600003)│
│ - ParquetReadBytes: 2.13 GB │
│ - ParquetReadGroups: 20 │
│ - PeakMemoryUsage: 0.00 │
│ - PredicateFilteredRows: 3.399797M (3399797) │
│ - PredicateFilteredTime: 133.302ms │
│ - RowsRead: 3.399997M (3399997) │
│ - RowsReturned: 200 │
│ - RowsReturnedRate: 194 │
│ - TotalRawReadTime(*): 726.566ms │
│ - TotalReadThroughput: 0.0 /sec │
│ - WaitScannerTime: 1s27ms │
└──────────────────────────────────────────────────────┘
```
2022-09-23 18:42:14 +08:00
..
2022-08-29 12:06:01 +08:00
2022-08-29 12:06:01 +08:00
2022-04-12 15:30:40 +08:00
2022-08-31 17:08:12 +08:00
2022-09-16 09:08:53 +08:00
2022-04-12 15:30:40 +08:00
2022-04-12 15:30:40 +08:00
2022-04-12 15:30:40 +08:00
2022-09-17 11:29:36 +08:00
2022-09-21 09:20:41 +08:00
2022-09-21 15:47:10 +08:00
2022-08-12 13:40:32 +08:00
2022-08-29 12:06:01 +08:00
2022-09-15 10:59:46 +08:00
2022-09-23 18:42:14 +08:00
2022-08-08 10:21:24 +08:00