database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
16,997 Commits 1 Branch 0 Tags
7607bfc78df33cd0ff8d02a963b7bedf1c9da53e
Commit Graph

6873 Commits

Author SHA1 Message Date
yiguolei
7607bfc78d [bugfix](performance) fix performance problem (#31093) 2024-02-19 17:48:29 +08:00
zhangstar333
8a3e6644d4 [fix](udf) fix java-udf coredump as get env return nullptr (#30986) 2024-02-19 17:23:24 +08:00
AlexYue
2f9bd3e3bb (enhance)(S3) Change s3 metric from bvar adder to latency recorder (#28861) 2024-02-19 17:22:03 +08:00
Pxl
bb4575a392 [Improvement](join) optimization for build_side_output_column (#30826) 
optimization for build_side_output_column
 2024-02-19 17:22:03 +08:00
wangbo
2f960c49f5 [Fix](executor)Fix query runtime statistics report failed #31064 2024-02-19 17:20:21 +08:00
Gabriel
5ea46f210c [pipelineX](bug) Fix use-after-free when BE exits (#31042) 2024-02-18 14:45:25 +08:00
lsy3993
870a9342b7 [fix](function) fix extract_url_parameter's bug then get the last key (#30929) 
fix extract_url_parameter's bug then get the last key
 2024-02-18 14:45:25 +08:00
koarz
6cf7468073 [enhancement](function) change some function nullable mode (#30991) 
change some function nullable mode
 2024-02-18 14:45:25 +08:00
yiguolei
a3c78dd21a [chore](refactor) refactor some rf code and delete rpc file (#31031) 
---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
 2024-02-18 11:50:17 +08:00
vhwzIs
d70776af55 [feature](agg-func) support covar and covar_samp function (#30983) 2024-02-18 11:50:17 +08:00
lihangyu
7b79b77cc9 [Optimize](Variant) make tablet schema more well-organized (#99) (#30922) 2024-02-18 11:50:17 +08:00
lihangyu
b0d2ecbf52 [Improve](Tablet Schema) Use deterministic way to serialize protobuf (#101) (#30906) 2024-02-18 11:50:17 +08:00
abmdocrt
b5012dc55a [Enhancement](group commit) optimize pre allocated calculation (#30893) 2024-02-18 11:50:17 +08:00
Mingyu Chen
fc53c7210b [fix](chmod) change chmod to filesystem::permission to avoid race condition (#31032) 2024-02-18 11:50:16 +08:00
HappenLee
45b4189bb6 [Refactor](opt) Opt rf and remove unless code (#30900) 
Opt rf and remove unless code
 2024-02-18 11:50:16 +08:00
Jerry Hu
acdc9575ad [fix](function) incorrect result of 'equal_for_null' (#30990) 2024-02-18 11:50:16 +08:00
Vallish Pai
0d4b8386a2 [bugfix][be][cppcheck] Possible NULL pointer access (#31025) (#31026) 2024-02-16 10:16:40 +08:00
nanfeng
e68019c10a [Function](Exec) Support windows function cume_dist (#30997) 2024-02-16 10:16:40 +08:00
Tiewei Fang
f65844fae4 [Enhencement](Outfile/Export) Export data to csv file format with BOM (#30533) 
The UTF8 format of the Windows system has BOM. 

We add a new user property to `Outfile/Export`。Therefore, when exporting Doris data, users can choose whether to bring BOM on the beginning of the CSV file.

**Usage:**
```sql
-- outfile:
select * from demo.student
into outfile "file:///xxx/export/exp_"
format as csv
properties(
    "column_separator" = ",",
    "with_bom" = "true"
);

-- Export:
EXPORT TABLE student TO "file:///xx/tmpdata/export/exp_"
PROPERTIES(
    "format" = "csv",
    "with_bom" = "true"
);
```
 2024-02-16 10:16:40 +08:00
lihangyu
eaaab33f0a [Fix](Top-N opt) evicting quering rowsets in prior to correct use_count (#102) (#30904) 
This addresses the scenario where a rowset cannot be removed.
 2024-02-16 10:16:40 +08:00
yiguolei
2573150f6d [refactor](runtime filter) do not wait runtime filter rpc finished when hash node or pipeline finished (#30970) 
Co-authored-by: yiguolei <yiguolei@gmail.com>
 2024-02-16 10:16:40 +08:00
yiguolei
7f50998406 fix compile 2024-02-16 10:12:25 +08:00
yangshijie
40e1326bc9 [feature](window-func) support percent_rank window function (#30926) 2024-02-16 10:12:25 +08:00
yiguolei
5cfd7c2a1c [improvement](memtracker) should counter memory usage to query when exchange sink buffer rpc (#30964) 
* [improvement](memtracker) should counter memory usage to query when rpc callback

* f

---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
 2024-02-16 10:12:25 +08:00
zclllyybb
d60ecdba6f [fix](regex) fix wrong escape of function LIKE (#30557) 
fix wrong escape of function LIKE
 2024-02-16 10:12:25 +08:00
huanghaibin
ff82e2ab59 [improvement](group_commit) Add bvar to monitor the count of replaying wal fail on group commit (#30941) 2024-02-16 10:12:24 +08:00
huanghaibin
bbbe3e666a [improvement](group_commit) Rename fail wal to tmp should only use in test P0 scenario (#30959) 2024-02-16 10:12:24 +08:00
Jerry Hu
e8f614791e [fix](pipeline) Set the flag of short circuit only when hash join sink finished (#30977) 2024-02-16 10:12:24 +08:00
huanghaibin
1437348040 [fix](group_commit) Wal file should be removed from _wal_path_map when renaming it to tmp directory (#30974) 2024-02-16 10:12:24 +08:00
HappenLee
02c37b8ead opt the rf code and remove rf unless code (#30861) 2024-02-16 10:12:24 +08:00
zhannngchen
041db03c94 [fix](gc) fix a core introduced by #30854 (#30932) 
introduced by #30854, if it is the end of the map _unused_rowsets, program will core.
 2024-02-16 10:12:24 +08:00
huanghaibin
7571ecc42f [fix](group_commit)Add bounds checking when reading wal file on group commit (#30940) 2024-02-16 10:12:24 +08:00
Kang
abbd1c7ede disable OR predicate for bitmap index (#30951) 
There is some problem for OR predicate push down using bitmap index, so disable it.
 2024-02-16 10:12:24 +08:00
abmdocrt
22cc8342d4 [Enhancement](wal) Optimize group commit manager log (#30849) 2024-02-16 10:12:24 +08:00
huanghaibin
5bb8a72626 [fix](group_commit) Fix write column id twice problem on wal file (#30935) 2024-02-16 10:12:24 +08:00
Ashin Gau
366a6792bf [refactor](scanner) refactoring and optimizing scanner scheduling (#30746) 2024-02-16 10:12:24 +08:00
Kaijie Chen
16cdab816a [refactor](move-memtable) remove phmap and use shared ptr in delta writer v2 (#30949) 
* [refactor](move-memtable) remove phmap and use shared ptr in delta writer v2 pool

* ENABLE_FACTORY_CREATOR DeltaWriterV2
 2024-02-16 10:12:24 +08:00
Pxl
e96b3db6f8 [Improvement](memory) clear arena when finalize one row #30788 2024-02-16 10:12:24 +08:00
nanfeng
2bb477bae7 [feature](agg-func) support corr function #30822 2024-02-16 10:12:24 +08:00
Sun Chenyang
0442d5dc0e [fix](Variant Type) Add sparse columns meta to fix compaction (#28673) 
Co-authored-by: eldenmoon <15605149486@163.com>
 2024-02-16 10:12:23 +08:00
Xin Liao
517e7a0567 [Fix](load) fix load channel leak when load exception occurs (#30915) 2024-02-16 10:12:23 +08:00
zhannngchen
c4a8d5497d [fix](gc) process exception while iteratoring directory (#30850) 2024-02-16 10:12:23 +08:00
lihangyu
b23a785775 [Fix](Variant) support materialize view for variant and accessing variant subcolumns (#30603) 
* [Fix](Variant) support materialize view for variant and accessing variant subcolumns
1. fix schema change with path lost and lead to invalid data read
2. support element_at function in BE side and use simdjson to parse data
3. fix multi slot expression
 2024-02-16 10:12:23 +08:00
zhannngchen
5b343911e8 [log](gc) add log for unused rowsets gc (#30854) 2024-02-16 10:12:23 +08:00
meiyi
2667e10ba2 [improve](group-commit) Modify some log (#30842) 2024-02-16 10:12:23 +08:00
yiguolei
89695f43d4 [refactor](queryctx) move tg related code to task group (#30829) 
init query ctx memtracker in queryctx constructor
set all task group related property during set taskgroup
 2024-02-16 10:12:23 +08:00
abmdocrt
2cb46eed94 [Feature](auto-inc) Add start value for auto increment column (#30512) 2024-02-16 10:12:23 +08:00
abmdocrt
847db2c015 [Enhancement](group commit) Add retry message for group commit load while schema changing (#30391) 2024-02-16 10:12:23 +08:00
zhiqiang
73940f96d3 [opt](string_to_unsigned_int) performance opt (#30825) 2024-02-05 22:23:16 +08:00
Guangdong Liu
1ed24117ac [function](url_decode)add url_decode function (#30667) 2024-02-05 22:23:00 +08:00