05db6e9b55
[refactor](file-system)(step-2) remove env, file_utils and filesystem_utils ( #18009 )
...
Follow #17586 .
This PR mainly changes:
Remove env/
Remove FileUtils/FilesystemUtils
Some methods are moved to LocalFileSystem
Remove olap/file_cache
Add s3 client cache for s3 file system
In my test, the time of open s3 file can be reduced significantly
Fix cold/hot separation bug for s3 fs.
This is the last PR of #17764 .
After this, all IO operation should be in io/fs.
Except for tests in #17586 , I also tested some case related to fs io:
clone
concurrency query on local/s3/hdfs
load error log create and clean
disk metrics
2023-03-29 09:00:52 +08:00
5014ad03e7
[feature](cooldown) Auto delete unused remote files ( #16588 )
2023-02-13 23:59:39 +08:00
b727033906
[Chore](build) enable -Wextra and remove some -Wno ( #15760 )
...
enable -Wextra and remove some -Wno
2023-01-15 10:40:35 +08:00
c9f86bc7e2
[refactor] Refactoring Status static methods to format message using fmt( #9533 )
2022-07-02 18:58:23 +08:00
c0e59e59aa
[fix][refactor] fix bugs and refactor some code by lint ( #7871 )
...
1. Fix some `passedByValue` issues.
2. Fix some `dereferenceBeforeCheck` issues.
3. Fix some `uninitMemberVar` issues.
4. Fix some iterator `eraseDereference` issues.
5. Fix compile issue introduced from #7923 #7905 #7848
2022-02-01 14:31:14 +08:00
800a36343a
[chore] Prolog of hermetic build with GCC 11 and Clang 13. ( #7712 )
...
Prepare to generate hermetic build using GCC 11 and Clang 13.
The ideal toolchain would be ldb toolchain generated by [ldb_toolchain_gen.sh](https://github.com/amosbird/ldb_toolchain_gen/releases/download/v0.3/ldb_toolchain_gen.sh )
To kick off a clang build, set `DORIS_TOOLCHAIN=clang` before running any build scripts.
2022-01-21 12:12:04 +08:00
6fedf5881b
[CodeFormat] Clang-format cpp sources ( #4965 )
...
Clang-format all c++ source files.
2020-11-28 18:36:49 +08:00
c53dd949c9
[Feature] Add CPU and Heap profile in BE webserver ( #4632 )
...
Add CPU Profile and Heap Profile in BE webserver.
This way we can more easily diagnose system performance bottlenecks through perf tools.
2020-11-05 20:25:07 +08:00
