Mingyu Chen
05db6e9b55
[refactor](file-system)(step-2) remove env, file_utils and filesystem_utils ( #18009 )
...
Follow #17586 .
This PR mainly changes:
Remove env/
Remove FileUtils/FilesystemUtils
Some methods are moved to LocalFileSystem
Remove olap/file_cache
Add s3 client cache for s3 file system
In my test, the time of open s3 file can be reduced significantly
Fix cold/hot separation bug for s3 fs.
This is the last PR of #17764 .
After this, all IO operation should be in io/fs.
Except for tests in #17586 , I also tested some case related to fs io:
clone
concurrency query on local/s3/hdfs
load error log create and clean
disk metrics
2023-03-29 09:00:52 +08:00
..
2023-03-19 14:05:02 +08:00
2023-01-10 16:10:49 +08:00
2022-11-18 21:02:54 +08:00
2023-01-10 16:10:49 +08:00
2023-03-13 11:11:59 +08:00
2022-09-19 09:18:04 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2023-03-21 21:08:38 +08:00
2022-05-10 09:25:59 +08:00
2023-01-15 10:40:35 +08:00
2022-05-10 09:25:59 +08:00
2023-03-20 16:27:08 +08:00
2022-10-20 08:56:01 +08:00
2023-03-13 11:11:59 +08:00
2023-03-12 20:09:58 +08:00
2023-03-13 11:11:59 +08:00
2022-10-21 08:32:16 +08:00
2023-03-14 20:40:37 +08:00
2023-03-25 09:40:04 +08:00
2023-03-08 10:42:20 +08:00
2022-04-20 12:29:57 +08:00
2022-05-10 09:25:59 +08:00
2023-01-15 10:40:35 +08:00
2022-10-20 08:56:01 +08:00
2023-02-28 17:10:05 +08:00
2023-02-13 14:06:36 +08:00
2022-02-08 09:25:09 +08:00
2023-02-14 21:43:10 +08:00
2020-11-28 18:36:49 +08:00
2023-03-29 09:00:52 +08:00
2020-11-28 18:36:49 +08:00
2023-02-14 21:43:10 +08:00
2023-02-14 21:43:10 +08:00
2023-03-29 09:00:52 +08:00
2021-12-22 22:58:23 +08:00
2023-03-13 11:11:59 +08:00
2023-02-13 20:30:10 +08:00
2020-11-28 18:36:49 +08:00
2022-10-18 13:10:13 +08:00
2022-05-10 09:25:59 +08:00
2023-03-08 10:42:20 +08:00
2022-10-18 13:10:13 +08:00
2022-08-29 12:06:01 +08:00
2022-10-18 13:10:13 +08:00
2022-05-10 09:25:59 +08:00
2023-03-20 16:27:08 +08:00
2022-12-30 00:28:51 +08:00
2022-05-10 09:25:59 +08:00
2023-03-08 12:41:15 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 09:25:59 +08:00
2023-03-29 09:00:52 +08:00
2023-03-29 09:00:52 +08:00
2022-05-10 09:25:59 +08:00
2023-03-29 09:00:52 +08:00
2023-02-23 08:33:30 +08:00
2022-07-02 18:58:23 +08:00
2022-05-10 09:25:59 +08:00
2022-10-18 13:10:13 +08:00
2020-11-28 18:36:49 +08:00
2022-09-14 21:25:22 +08:00
2022-09-14 21:25:22 +08:00
2022-10-18 13:10:13 +08:00
2022-05-10 09:25:59 +08:00
2022-04-20 12:29:57 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2020-11-28 18:36:49 +08:00
2023-01-15 10:40:35 +08:00
2023-03-13 11:11:59 +08:00
2023-03-19 14:05:02 +08:00
2023-03-29 09:00:52 +08:00
2023-03-21 21:08:38 +08:00
2022-10-20 08:56:01 +08:00
2022-05-10 21:25:35 +08:00
2023-03-13 11:11:59 +08:00
2022-07-05 17:43:01 +08:00
2023-02-04 22:51:55 +08:00
2023-02-04 22:51:55 +08:00
2023-03-09 23:27:15 +08:00
2023-03-09 11:30:07 +08:00
2022-05-26 15:09:21 +08:00
2023-01-20 13:33:01 +08:00
2022-12-29 09:29:09 +08:00
2022-12-29 09:29:09 +08:00
2022-12-16 09:41:43 +08:00
2023-01-20 13:33:01 +08:00
2022-10-20 08:56:01 +08:00
2023-01-20 13:33:01 +08:00
2023-01-20 13:33:01 +08:00
2022-07-27 14:17:56 +08:00
2022-11-04 13:49:46 +08:00
2022-10-28 08:45:12 +08:00
2023-02-09 10:24:56 +08:00
2022-11-12 16:06:15 +08:00
2020-11-28 18:36:49 +08:00
2022-05-10 21:25:35 +08:00
2023-03-08 14:00:57 +08:00
2023-02-20 00:00:40 +08:00
2022-05-10 09:25:59 +08:00
2022-04-12 15:30:40 +08:00
2022-07-08 12:18:39 +08:00
2023-02-15 15:58:43 +08:00
2022-05-10 09:25:59 +08:00
2023-01-20 13:33:01 +08:00
2023-03-20 16:27:08 +08:00
2023-03-20 16:27:08 +08:00
2023-02-14 21:43:10 +08:00
2023-02-14 21:43:10 +08:00
2023-02-09 10:24:56 +08:00
2022-04-20 12:29:57 +08:00
2022-05-10 09:25:59 +08:00
2023-03-29 09:00:52 +08:00
2023-03-29 09:00:52 +08:00
2022-04-20 12:29:57 +08:00
2022-05-10 09:25:59 +08:00
2022-04-20 12:29:57 +08:00
2022-05-10 09:25:59 +08:00
2023-02-03 11:28:48 +08:00
2021-12-22 22:58:23 +08:00
2023-03-29 09:00:52 +08:00
2022-10-18 13:10:13 +08:00
2023-03-08 12:41:15 +08:00
2022-09-21 09:20:41 +08:00
2023-03-29 09:00:52 +08:00
2022-06-24 15:30:05 +08:00
2022-05-10 09:25:59 +08:00
2023-02-28 17:10:05 +08:00
2023-02-09 10:24:56 +08:00
2023-02-03 11:28:48 +08:00
2022-05-10 09:25:59 +08:00
2023-03-25 12:41:07 +08:00
2023-03-14 10:54:04 +08:00
2023-03-14 10:54:04 +08:00
2022-10-18 13:10:13 +08:00
2022-05-10 09:25:59 +08:00
2022-11-08 09:52:33 +08:00
2023-03-13 11:11:59 +08:00
2022-12-02 17:11:34 +08:00
2022-12-05 18:22:48 +08:00
2023-03-29 09:00:52 +08:00
2023-03-29 09:00:52 +08:00
2023-03-29 09:00:52 +08:00
2023-03-29 09:00:52 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2022-08-02 10:56:13 +08:00
2022-08-29 12:06:01 +08:00
2022-01-29 01:00:38 +08:00
2022-05-10 09:25:59 +08:00
2022-08-29 12:06:01 +08:00
2022-05-10 09:25:59 +08:00
2022-11-15 08:58:57 +08:00
2020-11-28 18:36:49 +08:00
2022-05-10 09:25:59 +08:00
2023-03-20 16:27:08 +08:00
2022-05-10 09:25:59 +08:00
2022-05-10 09:25:59 +08:00
2022-07-14 10:50:50 +08:00
2023-03-13 11:11:59 +08:00
2021-05-09 22:00:48 +08:00
2023-03-13 11:11:59 +08:00
2023-03-05 16:38:43 +08:00
2023-03-05 16:38:43 +08:00
2022-05-10 09:25:59 +08:00
2022-04-13 09:55:29 +08:00
2022-12-26 21:25:09 +08:00
2022-10-18 13:10:13 +08:00
2023-02-15 15:58:43 +08:00
2023-02-10 16:58:27 +08:00
2022-08-12 11:39:35 +08:00
2022-05-10 09:25:59 +08:00
2022-12-11 23:33:18 +08:00
2020-11-28 18:36:49 +08:00
2021-11-17 10:18:35 +08:00
2022-05-10 09:25:59 +08:00
2022-11-12 16:06:15 +08:00
2022-07-02 18:58:23 +08:00
2022-11-12 16:06:15 +08:00
2022-07-19 08:23:29 +08:00
2023-01-10 16:10:49 +08:00
2022-05-10 09:25:59 +08:00
2020-11-28 18:36:49 +08:00
2020-11-28 18:36:49 +08:00
2022-06-16 10:59:31 +08:00
2020-11-28 18:36:49 +08:00
2020-11-28 18:36:49 +08:00
2022-12-26 21:25:09 +08:00
2022-12-26 21:25:09 +08:00
2023-03-13 11:11:59 +08:00
2022-10-31 19:19:13 +08:00
2022-08-29 12:06:01 +08:00
2023-03-13 11:11:59 +08:00
2023-02-15 15:58:43 +08:00
2022-05-10 09:25:59 +08:00
2023-01-22 16:39:23 +08:00
2023-01-22 16:39:23 +08:00
2022-01-30 16:47:22 +08:00
2022-05-10 09:25:59 +08:00
2021-05-09 22:00:48 +08:00
2022-12-11 23:33:18 +08:00
2020-11-28 18:36:49 +08:00