database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
17,549 Commits 1 Branch 0 Tags
ea2fbfaffaf9cd09c3cfa8eabbde415dfdbeeade
Commit Graph

17549 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
zclllyybb
3315c16383 [enhance](function) refactor from_format_str and support more format (#30452) 2024-02-01 19:08:37 +08:00
slothever
fb0d712096 [fix](multi-catalog)access HMS need ugiDoAs (#30595) 2024-02-01 19:08:37 +08:00
zhangstar333
65e277e365 [refacotr](node) refactor partition sort node to improve readability (#30511) 
* [refacotr](node) refactor partition sort node to improve readability

* update
 2024-02-01 19:01:08 +08:00
zhangstar333
fd2d9ae63e [improve](test) fix regression test case report error when run times (#30531) 2024-02-01 19:01:08 +08:00
walter
c8b0840e6c [improve](backup) Skip all backup/restore jobs if max allowd option is set to 0 (#30677) 
If there are too many backup/restore jobs, it may cause OOM. This PR allows the user to skip all backup/restore jobs if max_backup_restore_job_num_per_db is set to 0.
 2024-02-01 19:01:08 +08:00
xueweizhang
203daba19d [fix](outfile) fix outfile csv did not write json column with string (#29067) 2024-02-01 19:01:08 +08:00
HHoflittlefish777
822f2b1255 [improve](stream-load) add observability on receiving HTTP request #30432 2024-02-01 19:01:08 +08:00
Kaijie Chen
5a0764b288 [log](rpc) print log when offer_failed in internal service (#30454) 2024-02-01 19:01:08 +08:00
HHoflittlefish777
7935dc9fae [fix](routine-load) update partition offset cache timely to avoid negative lag #30455 2024-02-01 19:01:08 +08:00
seawinde
7f0d3d9dcb [Fix](nereids)Disable getting partition related table and column when self join (#30650) 
* add left anti join ut

* forbidden the self join partition column get

* [Fix](nereids) Disable getting partition related table and column when self join

* fix code style
 2024-02-01 19:01:08 +08:00
zzzxl
1ac5b45180 [fix](invert index) fixed the issue of insufficient index idx generation during partial column updates. (#30678) 2024-02-01 19:01:08 +08:00
KassieZ
fbb3ece72e [docs](fix) Fix invalid link and unified name of Doris Streamloader (#30696) 2024-02-01 19:01:08 +08:00
Jerry Hu
1d5471f805 [chore](debug) check the const exprs count in union node (#30679) 2024-02-01 19:00:51 +08:00
meiyi
ecf282ca92 [improve](catalog recycle bin) show data size info when show catalog recycle bin (#30592) 2024-02-01 19:00:51 +08:00
zhangdong
379b541494 [enhance](mtmv)use version instead of timestamp (#30599) 
MTMV records snapshot information for each refresh of data, used to compare whether partitions need to be updated
 2024-02-01 19:00:51 +08:00
zzwwhh
b86bd2672f [fix](Nereids) add logical project to prevent extra wrong column (#30459) 
Issue Number: close #30264
 2024-02-01 19:00:50 +08:00
zhannngchen
d024d65384 [doc](partial update) update plan of flexible column updates (#30682) 2024-02-01 19:00:50 +08:00
seawinde
1ab37737ae [Test](Nereids) Add SSB dataset to test materialized view rewrite (#30528) 
* [Test](Nereids) Add SSB dataset to test materialized view rewrite

* rollback irrelevant code

* fix sort slot 0
 2024-02-01 19:00:50 +08:00
abmdocrt
2a81ab70e4 [Enhancement](group commit) Optimize WAL insufficient space error messages (#30614) 2024-02-01 19:00:50 +08:00
lihangyu
90d3f0d805 [Fix](json) avoid print warn log when parse failed (#30656) 2024-02-01 19:00:50 +08:00
Mingyu Chen
1548813a17 [fix](test) fix case with same catalog name (#30585) 2024-02-01 19:00:50 +08:00
airborne12
e9c112b843 [Refact](inverted index) refact inverted index cache to decouple with reader (#30574) 2024-02-01 19:00:50 +08:00
Pxl
8d906c48e8 [Bug](insert) try to fix invalid slot when insert (#30570) 
try to fix invalid slot when insert
 2024-02-01 19:00:50 +08:00
yujun
1f754c55d5 [chore](show replica) show replica print path (#30402) 2024-02-01 19:00:50 +08:00
Pxl
1aa7a914e1 fix wrong profile on distinct agg and pass reference on uint136's compare (#30661) 2024-02-01 19:00:50 +08:00
DuRipeng
4bfb4c134c [MINOR](fe) remove unused member in (#30664) 2024-02-01 19:00:50 +08:00
zhangdong
e1d9071bc8 [fix](compatibility)remove cluster prefix in user manager #30655 2024-02-01 19:00:50 +08:00
AlexYue
882ba2e1a1 [fix](Cooldown) enhance the policy existence check logic when drop storage policy (#30404) 2024-02-01 19:00:13 +08:00
HHoflittlefish777
4f1d76d646 handle create rowset error to avoid null pointer exception (#30670) 2024-02-01 11:51:51 +08:00
Qi Chen
92cad69fc4 [Fix](parquet-reader) Fix reading fixed length byte array decimal in parquet reader. (#30535) 2024-01-31 23:53:40 +08:00
Jibing-Li
7c7a423828 Sync stats cache while task finished, doesn't need to query column_statistics table. (#30609) 2024-01-31 23:53:40 +08:00
zy-kkk
65076949ef [fix](compile)Fix Ambiguous regex Namespace Issue on MacOS Compilation (#30652) 2024-01-31 23:53:40 +08:00
Tiewei Fang
cc5205f6d1 [fix](JDK17) The objects stored in PriorityQueue must implement the Comparable interface (#30050) (#30625) 
Issue Number:  #30484 

The objects stored in PriorityQueue must implement the Comparable interface or passed into the customized `Comparator`. 

If we don't do this, run the program in the JDK17 environment will report an exception:
```java
Caused by: java.lang.AssertionError: Expect exception msg contains 'query wait timeout', but meet
'java.sql.SQLException: ClassCastException,
msg: class org.apache.doris.resource.workloadgroup.QueueToken cannot be cast to class java.lang.Comparable 
(org.apache.doris.resource.workloadgroup.QueueToken is in unnamed module of loader 'app'; java.lang.Comparable is in module java.base of loader 'bootstrap')'
```
 2024-01-31 23:53:40 +08:00
Jibing-Li
9310dbf3fd [fix](statistics)Fix stats cleaner delete partition stats bug (#30648) 
When a partition in OlapTable is removed, we should use partition id to delete the related stats record in column_statistics. Before, it was using id, which may cause delete useful stats of other partition.
 2024-01-31 23:53:40 +08:00
meiyi
eb2aafcd49 [fix](insert into) 'output_tuple_slot_num should be equal to output_expr_num' when insert into unique table with sequence column map (#30635) 2024-01-31 23:53:40 +08:00
Mingyu Chen
73371d44f8 [fix][refactor] refactor schema init of externa table and some parquet issue (#30325) 
1. Skip parquet file which has only 4 bytes length: PAR1
2. Refactor the schema init method of iceberg/hudi/hive table in hms catalog
    1. Remove some redundant methods of `getIcebergTable`
    2. Fix issue described in #23771
3. Support HoodieParquetInputFormatBase, treat it as normal hive table format
4. When listing file, skip all hidden dirs and files
 2024-01-31 23:53:40 +08:00
Jerry Hu
77b366fc4b [fix](join) incorrect result of mark join (#30543) 
incorrect result of mark join
 2024-01-31 23:53:40 +08:00
HappenLee
711b156a78 [Refactor][Rf] remove unless code in RF (#30597) 2024-01-31 23:53:40 +08:00
wangbo
c28ced1ebb [Feature](executor)Insert select limited by WorkloadGroup #30610 2024-01-31 23:53:40 +08:00
caoliang-web
65305f66c0 [typo](doc)Update flink Spark connector documentation (#30565) 2024-01-31 23:53:40 +08:00
KassieZ
88edb26e89 [docs](update) Update Doris-Streamloader docs (#30552) 2024-01-31 23:53:40 +08:00
morrySnow
8aaae4c873 [fix](Nereids) div priority is not right (#30575) 2024-01-31 23:53:40 +08:00
yuanyuan8983
a8f46cab75 [typo](doc) Modify the alter table column document (#28645) 2024-01-31 23:53:40 +08:00
Gabriel
045225a096 [pipelineX](profile) Fix Tablet counter on pipelineX engine (#30613) 2024-01-31 23:53:39 +08:00
Pxl
bf582cd5d3 [Chore](case) reset all variables at start on set_and_unset_variable case (#30580) 
reset all variables at start on set_and_unset_variable case
 2024-01-31 23:53:39 +08:00
xzj7019
866dde92b8 [tools] update tpcds test tools (#30607) 
Co-authored-by: zhongjian.xzj <zhongjian.xzj@zhongjianxzjdeMacBook-Pro.local>
 2024-01-31 23:53:39 +08:00
TengJianPing
ef8d9ad9a4 [pipelinex](profile) improve memory counter of pipelineX (#30538) 2024-01-31 23:53:39 +08:00
Calvin Kirs
8deeaef61b [Chore](workflow)delete auto-reply workflow (#30626) 
auto-reply not working due to permission issue
Comments on the fork repository failed due to permission issues
We will instead use Github App to listen for events and then comment.
 2024-01-31 23:53:39 +08:00
yangshijie
71fd3a6b12 [feature](fe) support ANSI standard keyword for CURRENT_XXX #30550 
support ANSI standard keywords:

CURRENT_DATE
CURRENT_TIME
CURRENT_TIMESTAMP
LOCALTIME
LOCALTIMESTAMP
CURRENT_USER
mysql> SELECT CURRENT_DATE, CURRENT_TIME, CURRENT_TIMESTAMP, LOCALTIME, LOCALTIMESTAMP, CURRENT_USER;
+--------------+--------------+---------------------+-----------+---------------------+--------------+
| CURRENT_DATE | CURRENT_TIME | CURRENT_TIMESTAMP   | LOCALTIME | LOCALTIMESTAMP      | CURRENT_USER |
+--------------+--------------+---------------------+-----------+---------------------+--------------+
| 2024-01-31   | 03:53:20     | 2024-01-31 03:53:20 | 03:53:20  | 2024-01-31 03:53:20 | 'root'@'%'   |
+--------------+--------------+---------------------+-----------+---------------------+--------------+
1 row in set (0.07 sec)
 2024-01-31 23:53:39 +08:00
Jack Drogon
9eeb7dc9e4 Refactor MemTableFlushExecutor::create_flush_token to improve (#30554) 
readability && Add default type guard

Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com>
 2024-01-31 23:53:39 +08:00