Commit Graph

18263 Commits

Author SHA1 Message Date
9889683ae3 [Feature](Job)STARTS and AT allow setting current_timestamp (#30593) 2024-02-03 20:24:39 +08:00
e21c9dca9c [fix](mtmv)compatibility metadata without refreshsnapshot #30735 2024-02-02 13:31:47 +08:00
2ca911fb5d [revert](move-memtable) Revert enable brpc debug log in regression pipelines (#30389) (#30611)
This reverts commit 4bf47e229f930714572d8f91d6f9e94b4608bd20.
2024-02-02 13:31:47 +08:00
94eedd8ea4 [Enhancement](function)make SUBSTRING_INDEX function DEPEND_ON_ARGUMENT (#30392) 2024-02-02 13:31:47 +08:00
xy
afa085968e [Fix](doc) Fix word spelling errors (#30654)
Co-authored-by: xingying01 <xingying01@corp.netease.com>
2024-02-02 13:31:47 +08:00
82bb3ed50f [Fix](group commit) Fix pre allocated err handling for group commit async load and add regression test #30718 2024-02-02 13:31:47 +08:00
cd65a8c9a7 Remove useless statistics report path (#30687) 2024-02-01 23:14:14 +08:00
c1c633dc1f [opt](exec) change string ser der way to improve performance (#30693) 2024-02-01 23:14:14 +08:00
9b7c6af581 [Fix](JDK17) Fixed that BE could not be started using JDK17 (#30286)
Issue Number: #30484

This is because hadoop-client-api relies on hadoop-common.
In the case of JDK17, it will still include hadoop-common.
2024-02-01 23:14:14 +08:00
5e60ca0652 [chore](3rd) update CRoaring bitmap version to 2.1.2 (#30697) 2024-02-01 23:14:14 +08:00
82aa304706 [Opt](exec) opt the repeat node code (#30683) 2024-02-01 23:14:14 +08:00
f0eeb45355 [chore](ci) trigger a must success pipeline (#30711)
Co-authored-by: stephen <hello-stephen@qq.com>
2024-02-01 23:14:14 +08:00
318bd3f9de [Cherry-Pick][improvement](stmt) Add fuzzy matching of label in show transaction (#30725)
* Add fuzzy matching of label in show transaction

* fix
2024-02-01 23:04:06 +08:00
9100fba47e [Fix](parquet-reader) Fix decimal test case out files. (#30715) 2024-02-01 21:17:17 +08:00
3315c16383 [enhance](function) refactor from_format_str and support more format (#30452) 2024-02-01 19:08:37 +08:00
fb0d712096 [fix](multi-catalog)access HMS need ugiDoAs (#30595) 2024-02-01 19:08:37 +08:00
65e277e365 [refacotr](node) refactor partition sort node to improve readability (#30511)
* [refacotr](node) refactor partition sort node to improve readability

* update
2024-02-01 19:01:08 +08:00
fd2d9ae63e [improve](test) fix regression test case report error when run times (#30531) 2024-02-01 19:01:08 +08:00
c8b0840e6c [improve](backup) Skip all backup/restore jobs if max allowd option is set to 0 (#30677)
If there are too many backup/restore jobs, it may cause OOM. This PR allows the user to skip all backup/restore jobs if max_backup_restore_job_num_per_db is set to 0.
2024-02-01 19:01:08 +08:00
203daba19d [fix](outfile) fix outfile csv did not write json column with string (#29067) 2024-02-01 19:01:08 +08:00
822f2b1255 [improve](stream-load) add observability on receiving HTTP request #30432 2024-02-01 19:01:08 +08:00
5a0764b288 [log](rpc) print log when offer_failed in internal service (#30454) 2024-02-01 19:01:08 +08:00
7935dc9fae [fix](routine-load) update partition offset cache timely to avoid negative lag #30455 2024-02-01 19:01:08 +08:00
7f0d3d9dcb [Fix](nereids)Disable getting partition related table and column when self join (#30650)
* add left anti join ut

* forbidden the self join partition column get

* [Fix](nereids) Disable getting partition related table and column when self join

* fix code style
2024-02-01 19:01:08 +08:00
1ac5b45180 [fix](invert index) fixed the issue of insufficient index idx generation during partial column updates. (#30678) 2024-02-01 19:01:08 +08:00
fbb3ece72e [docs](fix) Fix invalid link and unified name of Doris Streamloader (#30696) 2024-02-01 19:01:08 +08:00
1d5471f805 [chore](debug) check the const exprs count in union node (#30679) 2024-02-01 19:00:51 +08:00
ecf282ca92 [improve](catalog recycle bin) show data size info when show catalog recycle bin (#30592) 2024-02-01 19:00:51 +08:00
379b541494 [enhance](mtmv)use version instead of timestamp (#30599)
MTMV records snapshot information for each refresh of data, used to compare whether partitions need to be updated
2024-02-01 19:00:51 +08:00
b86bd2672f [fix](Nereids) add logical project to prevent extra wrong column (#30459)
Issue Number: close #30264
2024-02-01 19:00:50 +08:00
d024d65384 [doc](partial update) update plan of flexible column updates (#30682) 2024-02-01 19:00:50 +08:00
1ab37737ae [Test](Nereids) Add SSB dataset to test materialized view rewrite (#30528)
* [Test](Nereids) Add SSB dataset to test materialized view rewrite

* rollback irrelevant code

* fix sort slot 0
2024-02-01 19:00:50 +08:00
2a81ab70e4 [Enhancement](group commit) Optimize WAL insufficient space error messages (#30614) 2024-02-01 19:00:50 +08:00
90d3f0d805 [Fix](json) avoid print warn log when parse failed (#30656) 2024-02-01 19:00:50 +08:00
1548813a17 [fix](test) fix case with same catalog name (#30585) 2024-02-01 19:00:50 +08:00
e9c112b843 [Refact](inverted index) refact inverted index cache to decouple with reader (#30574) 2024-02-01 19:00:50 +08:00
Pxl
8d906c48e8 [Bug](insert) try to fix invalid slot when insert (#30570)
try to fix invalid slot when insert
2024-02-01 19:00:50 +08:00
1f754c55d5 [chore](show replica) show replica print path (#30402) 2024-02-01 19:00:50 +08:00
Pxl
1aa7a914e1 fix wrong profile on distinct agg and pass reference on uint136's compare (#30661) 2024-02-01 19:00:50 +08:00
4bfb4c134c [MINOR](fe) remove unused member in (#30664) 2024-02-01 19:00:50 +08:00
e1d9071bc8 [fix](compatibility)remove cluster prefix in user manager #30655 2024-02-01 19:00:50 +08:00
882ba2e1a1 [fix](Cooldown) enhance the policy existence check logic when drop storage policy (#30404) 2024-02-01 19:00:13 +08:00
4f1d76d646 handle create rowset error to avoid null pointer exception (#30670) 2024-02-01 11:51:51 +08:00
92cad69fc4 [Fix](parquet-reader) Fix reading fixed length byte array decimal in parquet reader. (#30535) 2024-01-31 23:53:40 +08:00
7c7a423828 Sync stats cache while task finished, doesn't need to query column_statistics table. (#30609) 2024-01-31 23:53:40 +08:00
65076949ef [fix](compile)Fix Ambiguous regex Namespace Issue on MacOS Compilation (#30652) 2024-01-31 23:53:40 +08:00
cc5205f6d1 [fix](JDK17) The objects stored in PriorityQueue must implement the Comparable interface (#30050) (#30625)
Issue Number:  #30484 

The objects stored in PriorityQueue must implement the Comparable interface or passed into the customized `Comparator`. 

If we don't do this, run the program in the JDK17 environment will report an exception:
```java
Caused by: java.lang.AssertionError: Expect exception msg contains 'query wait timeout', but meet
'java.sql.SQLException: ClassCastException,
msg: class org.apache.doris.resource.workloadgroup.QueueToken cannot be cast to class java.lang.Comparable 
(org.apache.doris.resource.workloadgroup.QueueToken is in unnamed module of loader 'app'; java.lang.Comparable is in module java.base of loader 'bootstrap')'
```
2024-01-31 23:53:40 +08:00
9310dbf3fd [fix](statistics)Fix stats cleaner delete partition stats bug (#30648)
When a partition in OlapTable is removed, we should use partition id to delete the related stats record in column_statistics. Before, it was using id, which may cause delete useful stats of other partition.
2024-01-31 23:53:40 +08:00
eb2aafcd49 [fix](insert into) 'output_tuple_slot_num should be equal to output_expr_num' when insert into unique table with sequence column map (#30635) 2024-01-31 23:53:40 +08:00
73371d44f8 [fix][refactor] refactor schema init of externa table and some parquet issue (#30325)
1. Skip parquet file which has only 4 bytes length: PAR1
2. Refactor the schema init method of iceberg/hudi/hive table in hms catalog
    1. Remove some redundant methods of `getIcebergTable`
    2. Fix issue described in #23771
3. Support HoodieParquetInputFormatBase, treat it as normal hive table format
4. When listing file, skip all hidden dirs and files
2024-01-31 23:53:40 +08:00