Ashin Gau
8f5aed27ec
[feature-wip](parquet-reader)read and decode parquet physical type ( #11637 )
...
# Proposed changes
Read and decode parquet physical type.
1. The encoding type of boolean is bit-packing, this PR introduces the implementation of bit-packing from Impala
2. Create a parquet including all the primitive types supported by hive
## Remaining Problems
1. At present, only physical types are decoded, and there is no corresponding and conversion methods with doris logical.
2. No parsing and processing Decimal type / Timestamp / Date.
3. Int_8 / Int_16 is stored as Int_32. How to resolve these types.
2022-08-11 10:17:32 +08:00
..
2022-07-02 18:58:23 +08:00
2022-07-11 12:15:35 +08:00
2022-05-10 09:25:59 +08:00
2022-06-29 10:26:42 +08:00
2022-07-29 16:49:40 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2022-04-13 11:23:37 +08:00
2022-07-20 16:37:27 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 09:25:59 +08:00
2022-02-12 15:17:28 +08:00
2022-05-10 09:25:59 +08:00
2022-07-28 10:41:27 +08:00
2022-08-11 10:17:32 +08:00
2022-08-11 10:17:32 +08:00
2022-08-11 10:17:32 +08:00
2022-08-11 10:17:32 +08:00
2022-08-11 10:17:32 +08:00
2022-06-17 08:48:41 +08:00
2022-07-27 21:46:47 +08:00
2022-04-20 12:29:57 +08:00
2022-05-10 09:25:59 +08:00
2022-08-08 12:44:06 +08:00
2022-08-08 12:44:06 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 21:25:35 +08:00
2022-06-08 15:07:39 +08:00
2022-05-10 09:25:59 +08:00
2022-07-02 18:58:23 +08:00
2022-04-29 16:14:22 +08:00
2022-02-08 09:25:09 +08:00
2022-06-13 20:41:48 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2022-07-02 18:58:23 +08:00
2020-11-28 18:36:49 +08:00
2022-02-19 11:29:02 +08:00
2022-05-10 09:25:59 +08:00
2022-07-19 11:08:39 +08:00
2021-12-22 22:58:23 +08:00
2021-12-22 22:58:23 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2022-04-12 15:30:40 +08:00
2022-05-10 09:25:59 +08:00
2022-04-29 16:14:22 +08:00
2022-05-10 09:25:59 +08:00
2022-04-20 12:29:57 +08:00
2022-05-10 09:25:59 +08:00
2022-06-14 09:17:09 +08:00
2022-05-10 09:25:59 +08:00
2022-07-23 16:07:59 +08:00
2022-07-23 16:07:59 +08:00
2022-05-10 09:25:59 +08:00
2021-10-15 13:03:04 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2022-05-10 09:25:59 +08:00
2022-08-02 11:34:06 +08:00
2022-08-02 11:34:06 +08:00
2022-05-10 09:25:59 +08:00
2022-07-02 18:58:23 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2020-11-28 18:36:49 +08:00
2022-03-02 17:26:44 +08:00
2022-03-02 17:26:44 +08:00
2022-05-10 21:25:35 +08:00
2022-05-10 09:25:59 +08:00
2022-04-20 12:29:57 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2020-11-28 18:36:49 +08:00
2022-07-08 12:18:39 +08:00
2022-07-08 12:18:39 +08:00
2022-07-21 17:11:28 +08:00
2022-06-24 08:57:54 +08:00
2022-07-02 18:58:23 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2022-05-10 09:25:59 +08:00
2022-06-14 09:17:09 +08:00
2022-06-19 10:26:20 +08:00
2022-06-19 10:26:20 +08:00
2022-06-19 10:26:20 +08:00
2022-06-19 10:26:20 +08:00
2022-05-10 21:25:35 +08:00
2022-05-10 21:25:35 +08:00
2022-05-10 09:25:59 +08:00
2022-07-05 17:43:01 +08:00
2022-07-05 17:43:01 +08:00
2022-07-02 18:58:23 +08:00
2022-07-02 18:58:23 +08:00
2022-05-26 15:09:21 +08:00
2022-07-27 14:17:56 +08:00
2022-07-02 18:58:23 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 21:25:35 +08:00
2022-05-10 21:25:35 +08:00
2020-11-28 18:36:49 +08:00
2022-05-10 21:25:35 +08:00
2022-04-20 12:29:57 +08:00
2022-07-19 11:08:39 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 09:25:59 +08:00
2022-04-12 15:30:40 +08:00
2022-07-08 12:18:39 +08:00
2020-11-28 18:36:49 +08:00
2022-05-10 09:25:59 +08:00
2022-04-29 16:14:22 +08:00
2022-02-19 11:29:02 +08:00
2022-05-10 09:25:59 +08:00
2022-08-01 22:52:19 +08:00
2022-08-01 22:52:19 +08:00
2022-07-02 18:58:23 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 09:25:59 +08:00
2022-04-20 12:29:57 +08:00
2022-05-10 09:25:59 +08:00
2022-04-20 12:29:57 +08:00
2022-05-10 09:25:59 +08:00
2022-04-20 12:29:57 +08:00
2022-05-10 09:25:59 +08:00
2022-04-20 12:29:57 +08:00
2022-05-10 09:25:59 +08:00
2022-04-29 16:14:22 +08:00
2021-12-22 22:58:23 +08:00
2021-12-22 22:58:23 +08:00
2022-07-19 11:08:39 +08:00
2022-07-19 11:08:39 +08:00
2022-07-02 18:58:23 +08:00
2022-06-24 15:30:05 +08:00
2022-05-10 09:25:59 +08:00
2022-05-18 07:40:57 +08:00
2022-05-18 07:40:57 +08:00
2022-04-29 16:14:22 +08:00
2022-05-10 09:25:59 +08:00
2022-07-02 18:58:23 +08:00
2022-03-28 10:50:41 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2022-08-08 12:44:06 +08:00
2022-07-09 15:50:40 +08:00
2022-07-09 15:50:40 +08:00
2022-07-02 18:58:23 +08:00
2022-04-29 16:14:22 +08:00
2022-07-08 12:18:39 +08:00
2022-04-29 16:14:22 +08:00
2022-07-23 16:06:29 +08:00
2022-07-23 16:06:29 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 21:25:35 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2022-08-02 10:56:13 +08:00
2022-01-29 01:00:38 +08:00
2022-01-29 01:00:38 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2020-11-28 18:36:49 +08:00
2022-05-10 09:25:59 +08:00
2022-04-20 12:29:57 +08:00
2022-05-10 09:25:59 +08:00
2022-07-02 18:58:23 +08:00
2022-04-04 17:49:06 +08:00
2022-04-29 16:14:22 +08:00
2022-05-10 09:25:59 +08:00
2022-07-14 10:50:50 +08:00
2022-07-14 10:50:50 +08:00
2021-05-09 22:00:48 +08:00
2022-01-30 16:47:22 +08:00
2022-07-23 16:07:59 +08:00
2022-05-10 09:25:59 +08:00
2022-06-10 19:45:31 +08:00
2022-06-10 19:45:31 +08:00
2022-05-10 09:25:59 +08:00
2022-04-13 09:55:29 +08:00
2022-08-07 16:21:57 +08:00
2022-08-07 16:21:57 +08:00
2022-07-02 18:58:23 +08:00
2022-05-10 09:25:59 +08:00
2022-04-13 09:55:29 +08:00
2022-05-10 09:25:59 +08:00
2022-05-14 10:03:55 +08:00
2020-11-28 18:36:49 +08:00
2021-11-17 10:18:35 +08:00
2022-05-10 09:25:59 +08:00
2022-04-13 09:55:29 +08:00
2022-07-02 18:58:23 +08:00
2022-07-19 08:23:29 +08:00
2022-07-19 08:23:29 +08:00
2022-04-20 12:29:57 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2020-11-28 18:36:49 +08:00
2022-06-16 10:59:31 +08:00
2022-05-10 21:25:35 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2020-11-28 18:36:49 +08:00
2020-11-28 18:36:49 +08:00
2020-11-28 18:36:49 +08:00
2020-11-28 18:36:49 +08:00
2022-05-10 09:25:59 +08:00
2022-04-29 16:14:22 +08:00
2022-05-10 09:25:59 +08:00
2022-06-14 15:32:58 +08:00
2021-11-17 10:18:35 +08:00
2022-05-10 09:25:59 +08:00
2022-01-18 10:07:15 +08:00
2022-05-10 09:25:59 +08:00
2021-11-17 10:18:35 +08:00
2022-05-10 09:25:59 +08:00
2022-01-30 16:47:22 +08:00
2022-05-10 09:25:59 +08:00
2021-05-09 22:00:48 +08:00
2022-07-02 18:58:23 +08:00
2022-05-10 09:25:59 +08:00
2022-07-02 18:58:23 +08:00
2020-11-28 18:36:49 +08:00