Commit Graph

18429 Commits

Author SHA1 Message Date
0ab8143565 [fix](catalog recycle bin) table partition meta is error if recover partition in some case (#31125) 2024-02-21 13:52:10 +08:00
4735c5b50f 2.1.0-rc08 2024-02-20 23:45:35 +08:00
2af920c6f8 [chore](regression) Update q03.sql (#31063)
add 'order by' of case
2024-02-20 16:24:05 +08:00
97c9d75af3 [Feature](executor)Add scan_thread_num property for workload group (#31106) 2024-02-20 16:24:05 +08:00
6d7662e8ac [fix](tools) Fix non-standard code in tpch/tpcds dbgen tools leading to compilation failure (#31124)
Fix non-standard code in tpch/tpcds dbgen tools leading to compilation failure
2024-02-20 16:24:05 +08:00
9251816673 [fix](Nereids): log constraint editlog in lock scope (#30630) 2024-02-20 16:24:05 +08:00
95a1e1c0bf [Enhancement](tools) Support transaction for benchmarks loading (#31126) 2024-02-20 16:24:05 +08:00
4aaab6fb44 [fix](statistics)Refresh follower FE cache after alter column stats. Support alter index column stats (#31108)
1. Refresh follower FE cache after alter column stats. So that follower could update the cached stats too.
2. Support alter index column stats.
2024-02-20 16:23:53 +08:00
54e8354fc6 [doc](mtmv) Update the mtmv documentation to make it consistent with the code (#30899) 2024-02-20 16:23:53 +08:00
Pxl
493385c2c7 [Bug](AggState) fix not match function when agg combinator function has alias (#31101) 2024-02-20 16:23:53 +08:00
fd453ace38 [enhancement](sc-test) Optimize waitForSchemeChangeDone (#31002) 2024-02-20 16:23:53 +08:00
a7a530189e [regression-test](decimalv3) Adding numerical precision exceeding the data type will error case (#31068)
* Adding numerical precision exceeding the data type will result in an error case

* add order by

---------

Co-authored-by: smallhibiscus <844981280>
2024-02-20 16:23:53 +08:00
15964ee3d8 [opt](deps) reduce the size of FE dependencies (#31129) 2024-02-20 16:23:53 +08:00
b69acbf98b [Improvement](group commit) FE should throw NotFoundException if database or table not exist when loading data (#31113)
* [Improvement](group commit) FE should throw NotFoundException if database or table not exist when loading data

* edit
2024-02-20 16:23:53 +08:00
24fb24db3e [refactor](catalog) catalog interface refactor #31047 (#31135) 2024-02-20 11:08:50 +08:00
6778b4ed93 [pipelineX](refactor) make non-virtual function in Dependency (#31109)
* [pipelineX](refactor) make non-virtual function in Dependency

* update
2024-02-20 09:18:33 +08:00
76767f2867 [fix](fe) Fix UnsetVariableStmt write editlog in non master node (#31080)
* Problem introduced by https://github.com/apache/doris/pull/27552
2024-02-20 09:18:33 +08:00
689b2c7bc5 [fix](s3client) fix unable to access COS (#31111) 2024-02-20 09:16:28 +08:00
02bded2688 [Improve](common)Optimize logging performance with LOG.isDebugEnabled() (#31091)
* [Improve](common)Optimize logging performance with LOG.isDebugEnabled()

* fix error ut
2024-02-20 09:16:14 +08:00
4c34ebb1cf [fix](mtmv)Fix the case failure issue caused by the same catalog name #31058 2024-02-20 09:12:38 +08:00
faaa51fa9d [fix](regression-test) test_nested_type_with_rowstore is flaky (#31121) 2024-02-20 09:12:38 +08:00
7ca3be6d51 [fix](parquet) return error if schema changed in complex types (#31128)
Check the column type of complex type to prevent core dump in BE. ColumnReader will throw segmentation fault in the following case:
Change complex types in hive:

hive> create table struct_test(
           id int,
           sf struct<f1: int, f2: map<string, string>>) stored as parquet;

hive> insert into struct_test values
          (1, named_struct('f1', 1, 'f2', str_to_map('1:s2,2:s2'))),
          (2, named_struct('f1', 2, 'f2', str_to_map('k1:s3,k2:s4'))),
          (3, named_struct('f1', 3, 'f2', str_to_map('k1:s5,k2:s6')));

hive> alter table struct_test change sf sf struct<f1:int, f2: string>;
2024-02-20 09:12:38 +08:00
8f70c00a26 [fix](routine-load) add lock to avoid editlog out of order when concurrent update job (#31095) 2024-02-20 09:12:38 +08:00
7a1bd6abb0 [improvment](group_commit) Refector scan wal function (#30939)
Co-authored-by: Yongqiang YANG <98214048+dataroaring@users.noreply.github.com>
2024-02-20 09:12:38 +08:00
066d674358 [Fix](inverted index) fix inverted index read data opt not work on MOW (#31075) 2024-02-20 09:12:38 +08:00
4a33d9820a [fix](multi-catalog)fix getting ugi methods and unify them (#30844)
put all ugi login methods to HadoopUGI
2024-02-20 09:12:38 +08:00
d55d796c74 [branch-2.1](multi-table-load) reduce routine load job transaction info storage in memory #31127 2024-02-20 09:08:56 +08:00
9a708806e0 [fix](segcompaction) enable segcompaction by default (#30810) 2024-02-19 19:04:22 +08:00
56ebff8f74 Doris doc (#31099) 2024-02-19 18:35:29 +08:00
e892b967da [docs](functions) fix and complete agg functions docs #31114 2024-02-19 18:35:29 +08:00
3f9b597b6b [fix](auto-partition) Fix concurrent load same value of auto partition #31107 2024-02-19 18:35:29 +08:00
2bb184f43b [fix](docs) fix kafka-load error word #31116 2024-02-19 18:35:29 +08:00
7607bfc78d [bugfix](performance) fix performance problem (#31093) 2024-02-19 17:48:29 +08:00
180fc13f6b [fix](nereids) disable PushDownJoinOtherCondition rule for mark join (#31084) 2024-02-19 17:48:29 +08:00
8a3e6644d4 [fix](udf) fix java-udf coredump as get env return nullptr (#30986) 2024-02-19 17:23:24 +08:00
277de979c3 [fix](mysql-channel) initialize mysql serializer by default (#31083) 2024-02-19 17:22:03 +08:00
2f9bd3e3bb (enhance)(S3) Change s3 metric from bvar adder to latency recorder (#28861) 2024-02-19 17:22:03 +08:00
5ac4b6a137 [opt](Nereids) refine group by elimination column prune (#30953) 2024-02-19 17:22:03 +08:00
Pxl
bb4575a392 [Improvement](join) optimization for build_side_output_column (#30826)
optimization for build_side_output_column
2024-02-19 17:22:03 +08:00
ed30b658bb fix pick_pr.sh push_id (#31041) 2024-02-19 17:22:03 +08:00
b3ac2128dd [Refactor](catalog) Refactor Jdbc Catalog external name case mapping rules (#28414) 2024-02-19 17:22:03 +08:00
8db2824c44 [bugfix](es catalog) add constant_keyword wildcard data type (#30947) 2024-02-19 17:20:21 +08:00
bda2042c78 [enhancement](paimon)add obs filesystem for paimon (#31061) 2024-02-19 17:20:21 +08:00
2f960c49f5 [Fix](executor)Fix query runtime statistics report failed #31064 2024-02-19 17:20:21 +08:00
e29d1ff59d [Fix](Docs) add thrift brew command #31077 2024-02-19 17:20:21 +08:00
ae809cd900 Fix hive p2 case. (#31072) 2024-02-19 17:20:21 +08:00
bb91c3a1cf [enhancement](neredis)add PushDownFilterThroughGenerate rule (#31057) 2024-02-19 17:20:21 +08:00
6504f6de74 [pipelineX](bug) Fix ConcurrentModificationException for profile reporting (#31040) 2024-02-19 17:20:21 +08:00
3f126fdd63 [fix](repository) fix NullPointerException when execute create repository statement without properties (#30972)
Co-authored-by: caiconghui1 <caiconghui1@jd.com>
2024-02-19 17:20:21 +08:00
a7037df9a1 [fix](iceberg) iceberg hms support hive1 (#30985) 2024-02-19 17:20:21 +08:00