Mingyu Chen
05db6e9b55
[refactor](file-system)(step-2) remove env, file_utils and filesystem_utils ( #18009 )
...
Follow #17586 .
This PR mainly changes:
Remove env/
Remove FileUtils/FilesystemUtils
Some methods are moved to LocalFileSystem
Remove olap/file_cache
Add s3 client cache for s3 file system
In my test, the time of open s3 file can be reduced significantly
Fix cold/hot separation bug for s3 fs.
This is the last PR of #17764 .
After this, all IO operation should be in io/fs.
Except for tests in #17586 , I also tested some case related to fs io:
clone
concurrency query on local/s3/hdfs
load error log create and clean
disk metrics
2023-03-29 09:00:52 +08:00
..
2023-01-24 10:45:35 +08:00
2023-03-27 09:06:03 +08:00
2023-03-21 21:08:38 +08:00
2023-03-01 20:28:41 +08:00
2023-03-29 09:00:52 +08:00
2023-01-11 08:40:58 +08:00
2022-12-11 23:33:18 +08:00
2020-11-28 18:36:49 +08:00
2023-03-19 14:05:02 +08:00
2023-02-07 12:28:55 +08:00
2022-04-29 16:14:22 +08:00
2023-01-06 09:15:08 +08:00
2023-03-29 09:00:52 +08:00
2023-03-19 14:05:02 +08:00
2023-03-19 14:05:02 +08:00
2023-03-20 16:27:08 +08:00
2023-03-28 09:46:43 +08:00
2023-03-08 10:42:20 +08:00
2023-03-15 10:51:29 +08:00
2023-03-06 16:07:09 +08:00
2023-03-06 16:07:09 +08:00
2023-03-06 16:07:09 +08:00
2023-03-29 09:00:52 +08:00
2020-11-28 18:36:49 +08:00
2023-03-29 09:00:52 +08:00
2022-12-08 14:52:52 +08:00
2022-12-08 14:52:52 +08:00
2022-07-18 08:52:24 +08:00
2020-11-28 18:36:49 +08:00
2023-03-22 09:51:03 +08:00
2023-03-08 12:41:15 +08:00
2023-03-27 23:02:18 +08:00
2023-03-04 16:19:36 +08:00
2020-11-28 18:36:49 +08:00
2022-10-21 15:18:16 +08:00
2022-12-29 09:29:09 +08:00
2021-08-04 10:55:19 +08:00
2022-05-30 16:12:10 +08:00
2023-01-31 21:36:34 +08:00
2023-01-16 16:30:35 +08:00
2023-01-03 20:05:21 +08:00
2023-01-03 20:05:21 +08:00
2023-03-29 09:00:52 +08:00
2022-05-10 09:25:59 +08:00
2023-02-10 11:00:33 +08:00
2023-02-10 11:00:33 +08:00
2023-01-24 10:45:35 +08:00
2023-01-24 10:45:35 +08:00
2022-04-18 09:52:31 +08:00
2022-02-22 09:26:23 +08:00
2023-03-01 08:35:27 +08:00
2023-03-01 08:35:27 +08:00
2023-03-15 10:51:29 +08:00
2023-03-28 23:10:39 +08:00
2023-03-20 16:27:08 +08:00
2022-08-29 12:06:01 +08:00
2023-02-03 11:28:48 +08:00
2023-03-19 14:05:02 +08:00
2020-11-28 18:36:49 +08:00
2022-05-10 09:25:59 +08:00
2023-03-19 14:05:02 +08:00
2023-02-12 16:56:10 +08:00
2022-07-18 08:52:24 +08:00
2023-03-19 14:05:02 +08:00
2020-05-25 21:24:56 +08:00
2023-03-19 14:05:02 +08:00
2023-02-16 11:07:46 +08:00
2023-02-16 11:07:46 +08:00
2023-02-06 15:36:05 +08:00
2023-02-03 11:28:48 +08:00
2023-03-29 09:00:52 +08:00
2023-03-29 09:00:52 +08:00
2023-03-29 09:00:52 +08:00
2022-05-10 09:25:59 +08:00
2023-03-29 09:00:52 +08:00
2023-03-29 09:00:52 +08:00
2023-01-22 16:39:23 +08:00
2023-02-10 11:00:33 +08:00
2023-03-19 14:05:02 +08:00
2023-03-10 10:52:40 +08:00
2023-03-08 10:42:20 +08:00
2022-12-19 09:47:38 +08:00
2023-03-02 08:55:00 +08:00
2022-12-26 21:25:09 +08:00
2023-03-08 12:41:15 +08:00
2023-03-20 16:27:08 +08:00
2023-03-06 16:07:09 +08:00
2023-03-06 16:07:09 +08:00
2023-03-29 09:00:52 +08:00
2023-03-19 11:52:15 +08:00