Commit Graph

6154 Commits

Author SHA1 Message Date
ef22bd3318 [fix](txn insert) Txn insert can not write to table with mv (#31167) 2024-02-22 13:01:49 +08:00
ad07dec0ed [Improve](InPredict) enhance in predict with struct type (#30840) 2024-02-22 13:01:49 +08:00
d080fe8c89 [log](query) add debug log for check query visible version (#31217) 2024-02-22 13:01:48 +08:00
70dc40ab3c [fix](audit) The time field in the audit log table is set to the millisecond level (#31096) 2024-02-22 13:01:48 +08:00
98a1b12ac6 [Enhancement] [plsql] support drop store procedure (#30966) (#31001) 2024-02-22 13:01:48 +08:00
c56cb0ac3e [Exec](RF) Support merge remote rf local first (#31067) 2024-02-22 13:01:48 +08:00
2069f9ff63 [fix](Nereids): OuterJoinAssoc reject literal condition (#31172) 2024-02-22 13:01:32 +08:00
6bbe6c9a59 [fix](statistics)Release StmtExecutor in AnalysisTask object when sql execution finished to release memory. #31212 2024-02-21 19:18:45 +08:00
eb5e6a829a [fix](nereids)should normalize window expression by bottom project's output (#31115) 2024-02-21 19:18:45 +08:00
8fc9d80479 [compatibility](MySQL) update charset to utf8mb4, collation to utf8mb4_0900_bin (#31046)
Doris's behaviour is more like utf8mb4 and utf8mb4_0900_bin than utf8 and utf8_general_ci
2024-02-21 17:01:39 +08:00
f1fbfeba2f [fix](nereids) removeRuntimeFilter() removes more than one RFs if there are different types of RF from the buildNode to the target (#31197)
this bug can be produced on tpcds 95, when set runtime filter type: min-max + bloom
2024-02-21 17:01:39 +08:00
98106ad60f [fix](nereids) fix bug of unnest subuqery with having clause (#31152)
1. run PushDownFilterThroughAggregation, PushDownFilterThroughProject and MergeFilters before subquery unnesting
2. should keep plan unchanged even left semi join's condition is true (because the right table may be empty())
3. PushDownFilterThroughProject need check if filter's input slots are all coming from project's output
2024-02-21 17:01:30 +08:00
33925a738d [improvement](schemachange) add schema change log (#31145) (#31203) 2024-02-21 14:15:02 +08:00
c27692fb3b [Enhancement](jdbc catalog) Add security check on driver when creating Jdbc Catalog (#31153) 2024-02-21 13:53:40 +08:00
cd7230885f [fix](nereids)push more than one runtime filters into cte (#30901)
* push rf into cte, used by tpcds95
2024-02-21 13:53:32 +08:00
1e3968fe7e [fix](group_commit) Need to wait wal to be deleted when creating MaterializedView (#30956) 2024-02-21 13:53:19 +08:00
1d6dc9a5f0 [fix](catalog recycle bin) Forbid recover partition if table schame is changed #31146 2024-02-21 13:53:18 +08:00
0ab8143565 [fix](catalog recycle bin) table partition meta is error if recover partition in some case (#31125) 2024-02-21 13:52:10 +08:00
97c9d75af3 [Feature](executor)Add scan_thread_num property for workload group (#31106) 2024-02-20 16:24:05 +08:00
9251816673 [fix](Nereids): log constraint editlog in lock scope (#30630) 2024-02-20 16:24:05 +08:00
4aaab6fb44 [fix](statistics)Refresh follower FE cache after alter column stats. Support alter index column stats (#31108)
1. Refresh follower FE cache after alter column stats. So that follower could update the cached stats too.
2. Support alter index column stats.
2024-02-20 16:23:53 +08:00
b69acbf98b [Improvement](group commit) FE should throw NotFoundException if database or table not exist when loading data (#31113)
* [Improvement](group commit) FE should throw NotFoundException if database or table not exist when loading data

* edit
2024-02-20 16:23:53 +08:00
24fb24db3e [refactor](catalog) catalog interface refactor #31047 (#31135) 2024-02-20 11:08:50 +08:00
76767f2867 [fix](fe) Fix UnsetVariableStmt write editlog in non master node (#31080)
* Problem introduced by https://github.com/apache/doris/pull/27552
2024-02-20 09:18:33 +08:00
689b2c7bc5 [fix](s3client) fix unable to access COS (#31111) 2024-02-20 09:16:28 +08:00
02bded2688 [Improve](common)Optimize logging performance with LOG.isDebugEnabled() (#31091)
* [Improve](common)Optimize logging performance with LOG.isDebugEnabled()

* fix error ut
2024-02-20 09:16:14 +08:00
8f70c00a26 [fix](routine-load) add lock to avoid editlog out of order when concurrent update job (#31095) 2024-02-20 09:12:38 +08:00
4a33d9820a [fix](multi-catalog)fix getting ugi methods and unify them (#30844)
put all ugi login methods to HadoopUGI
2024-02-20 09:12:38 +08:00
d55d796c74 [branch-2.1](multi-table-load) reduce routine load job transaction info storage in memory #31127 2024-02-20 09:08:56 +08:00
3f9b597b6b [fix](auto-partition) Fix concurrent load same value of auto partition #31107 2024-02-19 18:35:29 +08:00
180fc13f6b [fix](nereids) disable PushDownJoinOtherCondition rule for mark join (#31084) 2024-02-19 17:48:29 +08:00
8a3e6644d4 [fix](udf) fix java-udf coredump as get env return nullptr (#30986) 2024-02-19 17:23:24 +08:00
277de979c3 [fix](mysql-channel) initialize mysql serializer by default (#31083) 2024-02-19 17:22:03 +08:00
5ac4b6a137 [opt](Nereids) refine group by elimination column prune (#30953) 2024-02-19 17:22:03 +08:00
b3ac2128dd [Refactor](catalog) Refactor Jdbc Catalog external name case mapping rules (#28414) 2024-02-19 17:22:03 +08:00
8db2824c44 [bugfix](es catalog) add constant_keyword wildcard data type (#30947) 2024-02-19 17:20:21 +08:00
bda2042c78 [enhancement](paimon)add obs filesystem for paimon (#31061) 2024-02-19 17:20:21 +08:00
bb91c3a1cf [enhancement](neredis)add PushDownFilterThroughGenerate rule (#31057) 2024-02-19 17:20:21 +08:00
6504f6de74 [pipelineX](bug) Fix ConcurrentModificationException for profile reporting (#31040) 2024-02-19 17:20:21 +08:00
3f126fdd63 [fix](repository) fix NullPointerException when execute create repository statement without properties (#30972)
Co-authored-by: caiconghui1 <caiconghui1@jd.com>
2024-02-19 17:20:21 +08:00
a7037df9a1 [fix](iceberg) iceberg hms support hive1 (#30985) 2024-02-19 17:20:21 +08:00
6e4f76de54 [improvement](jdbc catalog) Delete unnecessary schema and optimize insert logic (#30880)
In the previous design, we were compatible with MySQL's auto-increment column and default value to bypass the null value check when writing back Jdbc External Table. However, because MySQL's default value is not completely unified with Doris, this resulted in The unsuitable default value is wrong. In response to this situation, I made the following optimizations
1. For JDBC External Table, we always allow certain columns to be missing during insertion. Even if these columns are not allowed to be empty at the source end, the error should be generated by the source end, not Doris herself.
2. When the target column is non-nullable and the insertion is done via `INSERT INTO tbl VALUES()` or `INSERT INTO tbl SELECT constants`, Doris should verify any inconsistency between them and throw an exception. This check is not applied for `INSERT INTO tbl SELECT ... FROM tbl` operations.
2024-02-19 17:20:21 +08:00
d66559f693 [bugfix](sessionVariable) Fix sessionVariable has sessionOriginValue property, and execute cloneSessionVariable method will throw java.io.NotSerializableException: java.lang.reflect.Field (#31029) 2024-02-18 14:45:25 +08:00
6cf7468073 [enhancement](function) change some function nullable mode (#30991)
change some function nullable mode
2024-02-18 14:45:25 +08:00
68102fd531 [Fix](auto-partition) fix a concurrent bug of extremely long values (#31005) 2024-02-18 14:45:25 +08:00
753ff10840 [bugfix](export command) Export exceptions when use legacy optimizer (#31020) 2024-02-18 14:45:25 +08:00
33aaacf2fa [Bug] (plsql) procedure call to a non existing procedure, returning success (#31019)
Issue Number: close. #31018

state was set OK even in failure case. changed it.
2024-02-18 11:50:17 +08:00
d70776af55 [feature](agg-func) support covar and covar_samp function (#30983) 2024-02-18 11:50:17 +08:00
1d596018c8 [enhance](iceberg)upgrade iceberg to 1.4.3 (#30799) 2024-02-18 11:50:17 +08:00
5417bb4db0 [Enhancement](auto-inc) Show create table support auto inc init value (#31021) 2024-02-18 11:50:16 +08:00