Commit Graph

16763 Commits

Author SHA1 Message Date
77b366fc4b [fix](join) incorrect result of mark join (#30543)
incorrect result of mark join
2024-01-31 23:53:40 +08:00
711b156a78 [Refactor][Rf] remove unless code in RF (#30597) 2024-01-31 23:53:40 +08:00
c28ced1ebb [Feature](executor)Insert select limited by WorkloadGroup #30610 2024-01-31 23:53:40 +08:00
65305f66c0 [typo](doc)Update flink Spark connector documentation (#30565) 2024-01-31 23:53:40 +08:00
88edb26e89 [docs](update) Update Doris-Streamloader docs (#30552) 2024-01-31 23:53:40 +08:00
8aaae4c873 [fix](Nereids) div priority is not right (#30575) 2024-01-31 23:53:40 +08:00
a8f46cab75 [typo](doc) Modify the alter table column document (#28645) 2024-01-31 23:53:40 +08:00
045225a096 [pipelineX](profile) Fix Tablet counter on pipelineX engine (#30613) 2024-01-31 23:53:39 +08:00
Pxl
bf582cd5d3 [Chore](case) reset all variables at start on set_and_unset_variable case (#30580)
reset all variables at start on set_and_unset_variable case
2024-01-31 23:53:39 +08:00
866dde92b8 [tools] update tpcds test tools (#30607)
Co-authored-by: zhongjian.xzj <zhongjian.xzj@zhongjianxzjdeMacBook-Pro.local>
2024-01-31 23:53:39 +08:00
ef8d9ad9a4 [pipelinex](profile) improve memory counter of pipelineX (#30538) 2024-01-31 23:53:39 +08:00
8deeaef61b [Chore](workflow)delete auto-reply workflow (#30626)
auto-reply not working due to permission issue
Comments on the fork repository failed due to permission issues
We will instead use Github App to listen for events and then comment.
2024-01-31 23:53:39 +08:00
71fd3a6b12 [feature](fe) support ANSI standard keyword for CURRENT_XXX #30550
support ANSI standard keywords:

CURRENT_DATE
CURRENT_TIME
CURRENT_TIMESTAMP
LOCALTIME
LOCALTIMESTAMP
CURRENT_USER
mysql> SELECT CURRENT_DATE, CURRENT_TIME, CURRENT_TIMESTAMP, LOCALTIME, LOCALTIMESTAMP, CURRENT_USER;
+--------------+--------------+---------------------+-----------+---------------------+--------------+
| CURRENT_DATE | CURRENT_TIME | CURRENT_TIMESTAMP   | LOCALTIME | LOCALTIMESTAMP      | CURRENT_USER |
+--------------+--------------+---------------------+-----------+---------------------+--------------+
| 2024-01-31   | 03:53:20     | 2024-01-31 03:53:20 | 03:53:20  | 2024-01-31 03:53:20 | 'root'@'%'   |
+--------------+--------------+---------------------+-----------+---------------------+--------------+
1 row in set (0.07 sec)
2024-01-31 23:53:39 +08:00
9eeb7dc9e4 Refactor MemTableFlushExecutor::create_flush_token to improve (#30554)
readability && Add default type guard

Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com>
2024-01-31 23:53:39 +08:00
19f57b544e support cosh math function (#30602)
Co-authored-by: Rohit Satardekar <rohitrs1983@gmail.com>
2024-01-31 23:53:39 +08:00
a640ca5aaf [fix](planner)LateralViewRef's toSql method is not correctly implemented (#30590) 2024-01-31 23:53:39 +08:00
f35803b7a0 [feature](pipeline-load) enable pipeline load by default (#30581) 2024-01-31 23:53:39 +08:00
e6fbccd3ed [Feature](Variant) support row store for variant type (#30052) 2024-01-31 23:53:39 +08:00
8b61b7c6cd [exec](function) Add tanh func (#30555) 2024-01-31 23:53:39 +08:00
a1ccf34ecc [fix](group commit) Fix replay wal core because undefined TLoadSourceType (#30571) 2024-01-31 23:53:39 +08:00
1d632f1af4 [improvement](move-memtable) enable stream write to socket in background bthread (#30586) 2024-01-31 23:53:39 +08:00
2646dc279e [enhance](Nereids): support DateLiteral with suffix space (#30583) 2024-01-31 23:53:39 +08:00
7d037c12bf [bugfix](paimon)fix paimon testcases (#30514)
1. set default timezone
2. not supported `char` type to pushdown
2024-01-31 23:53:39 +08:00
378d9e7336 [Colo][Scan] delete the colo scan code (#30584) 2024-01-31 23:53:39 +08:00
7d9313c807 [revert](Nereids): revert#30578 #30422 (#30594)
* Revert "[fix](Nereids): don't log edit log when replaying"
* Revert "[fix](Nereids) create constraint write edit log in lock scope (#30422)"
This reverts commit 27a12d37acbe2ca807f7ce56125ad4773d89f584.
2024-01-31 23:53:39 +08:00
221308f78a [fix](datatype) fix bugs for IPv4/v6 datatype and add some basic regression test cases (#30261) 2024-01-31 23:53:39 +08:00
1a8e281255 [fix](cluster by) Fix cluster_by used-after-moved in compaction (#29273) 2024-01-31 23:53:39 +08:00
6376b24300 [fix](Nereids): don't log edit log when replaying (#30578)
* don't log edit log when replaying
2024-01-31 23:53:39 +08:00
b983cbd02d [fix](audit) add workload_group to audit log table (#30470)
1. Missing workload_group column in audit table
2. Extract the definition of internal schema's tables into a new class
3. Fix bug that audit loader has no authorization to load data to audit_table, introduced from #29790
4. Fix bug that audit_log can not be modified to 3 replica because it is partitioned table
2024-01-31 23:53:39 +08:00
7838ba6d4e [feature](journal) Add a method to write a set of journals in batch (#30582)
* [feature](journal) Add a method to write a set of journals in batch (#30380)

* [feature](journal) Add log and metric to improve the observability of journal batch (#30401)
2024-01-31 23:53:39 +08:00
59b79d47ca fix compile bug 2024-01-30 16:17:55 +08:00
7fe4d00bb2 [fix](regex) use boost regex instead of std (#30462) 2024-01-30 15:33:40 +08:00
11f7b36dab [bugfix](paimon)add class loader (#30483) 2024-01-30 15:33:40 +08:00
ea427e8c51 [fix](JDK17) It will report an exception whenwe start BE with JDK17 and query AVRO table : InaccessibleObjectException (#30541)
* [fix](JDK17) It will report an exception whenwe start BE with JDK17 and query AVRO  table : InaccessibleObjectException (#30003)
2024-01-30 15:33:40 +08:00
12827ceb16 [fix](Nereids): fix wrong regression test (#30520) 2024-01-30 15:33:40 +08:00
b7c86d66fa [improvement](thirdparty) introduce brpc stream patch to make stream write to socket in background bthread (#30458) 2024-01-30 15:33:40 +08:00
218fb80938 [fix](group commit) Fix group commit VOlapTablePartitionParam memory … (#30491) 2024-01-30 15:33:40 +08:00
c810df55c5 [fix](Nereids) create constraint write edit log in lock scope (#30422)
write edit log in lock scope to ensure the order of log sequence.

To avoid the sequence like:
```
add primary key pk1
add foreign key ref pk1
log foreign key
log primary key
```
2024-01-30 15:33:40 +08:00
9e63015e2f [fix](mtmv)resolve task tvf concurrent modification exception #30497
LinkedList is not thread safe and there may be issues with concurrent queries and writes. Change it to ConcurrentLinkedQueue

Caused by: java.util.ConcurrentModificationException
	at java.util.LinkedList$ListItr.checkForComodification(LinkedList.java:966) ~[?:1.8.0_131]
	at java.util.LinkedList$ListItr.next(LinkedList.java:888) ~[?:1.8.0_131]
	at org.apache.doris.tablefunction.MetadataGenerator.taskMetadataResult(MetadataGenerator.java:694) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.tablefunction.MetadataGenerator.getMetadataTable(MetadataGenerator.java:119) ~[doris-fe.jar:1.2-SNAPSHOT]
	at org.apache.doris.service.FrontendServiceImpl.fetchSchemaTableData(FrontendServiceImpl.java:2195) ~[doris-fe.jar:1.2-SNAPSHOT]
	... 13 more
2024-01-30 15:32:43 +08:00
53c624ffa0 [feat](Nereids): support alias when eliminate join for partially mv rewritting #30498 2024-01-30 15:32:43 +08:00
4648902350 [bugfix](iceberg)fix read NULL with date partition (#30478)
* fix date

* fix date

* add case
2024-01-30 15:32:43 +08:00
5731ed7aad [fix](Nereids): add order by when testing pkfk to avoid unstable res #30507 2024-01-30 15:32:42 +08:00
b712f0b810 [improvement](index)add index_id column in show index stmt (#30431) 2024-01-30 15:32:42 +08:00
08897b7e03 [Improvement](executor)Remove ThreadPoolToken from MemTableFlushExecutor #30529 2024-01-30 15:32:40 +08:00
0932dadcff [enhancement](log) print detail error for segment compaction failure (#30503) 2024-01-30 15:31:22 +08:00
28c4e69149 [fix](move-memtable) check load timeout before close wait (#30526) 2024-01-30 15:31:22 +08:00
129463f557 [Try_Fix](scan) try fix the scanner schedule logic to prevent excessive memory usage and timeout (#30515) 2024-01-30 15:31:22 +08:00
589e83561c [Fix](jdk17) support start FE with JDK17 (#29658) (#30485)
Issue Number: close #30484

problem:
gson will use Java's reflection mechanism to generate a default Adapter, but JDK17 is prohibited from visiting such an access.

solution:
gson has provided solutions since 2.9.1, which can bypass this problem: Add support for reflection access filter by Marcono1234 · Pull Request #1905 · google/gson

We need to upgrade the gson version and use this solution
2024-01-30 15:31:22 +08:00
009bca9652 [regression test](broker load) add partition load case (#28259) 2024-01-30 15:30:39 +08:00
5f20d7c5d0 [regression test](stream load) test for enable_profile (#28534) 2024-01-30 15:30:39 +08:00