29d4809c80
[BugFix](Array) fix DataTypeArray to_string use after free ( #10640 )
...
ColumnArray::convert_to_full_column_if_const override the base function
and ColumnArray::create generate a temporary variable
2022-07-06 18:18:00 +08:00
cff9ffa0e1
fix the inaccurate comments ( #10617 )
...
Co-authored-by: hucheng01 <hucheng01@baidu.com >
2022-07-06 17:54:43 +08:00
b4c5dfc28e
[Improvement] remove redundant code of VOlapScanner ( #10621 )
2022-07-06 17:54:10 +08:00
a7df6e3dee
rename some files inside vec/sink dir ( #10636 )
...
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-07-06 17:52:47 +08:00
006283c036
[Fix] select nested type of string within type array should be wrapped with '' in vectorized path ( #10498 )
2022-07-06 10:47:36 +08:00
8e364fb848
[fix](load) skip empty orc file ( #10593 )
...
Something the upstream system(eg, hive) may create empty orc file
which only has a header and footer, without schema.
And if we call `_reader->createRowReader()` with selected columns,
it will throw ParserError: Invalid column selected xx.
So here we first check its number of rows and skip these kind of files.
This is only a fix for non-vec load, for vec load, it use arrow scanner
to read orc file, which does not have this problem.
2022-07-05 22:18:56 +08:00
1f57fcc4e9
remove duplicate codes from function_test_util.cpp ( #10607 )
...
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-07-05 20:43:56 +08:00
89e56ea67f
[refactor] remove alpha rowset related code and vectorized row batch related code ( #10584 )
2022-07-05 20:33:34 +08:00
3e87960202
[bugfix] fix bug of vhash join build ( #10614 )
...
* [bugfix] fix bug of vhash join build
* format code
2022-07-05 19:14:42 +08:00
86502b014d
[feature-wip](unique-key-merge-on-write)port IntervalTree from kudu ( #10511 )
...
See the DISP-18:https://cwiki.apache.org/confluence/display/DORIS/DSIP-018%3A+Support+Merge-On-Write+implementation+for+UNIQUE+KEY+data+model
This patch is for step 3.1 in scheduling.
2022-07-05 17:43:01 +08:00
575bf18d55
[enhancement] speed up week_of_year by pre_calc table ( #10586 )
2022-07-05 15:37:02 +08:00
585d42330c
[BUG] fix bug in bloom filter for datev2 ( #10579 )
2022-07-05 11:10:03 +08:00
a2f74bf260
[Improvement] remove profile with poor readability ( #10581 )
2022-07-05 11:09:23 +08:00
73ba806046
[feature-wip](multi-catalog) Add catalog to information_schema table "columns". ( #10592 )
2022-07-05 09:57:19 +08:00
570139e332
[fix][be] Delete uncivilized comments. ( #10578 )
2022-07-04 22:35:15 +08:00
1f1bdaa9c3
[bugfix] fix coredump of left anti join ( #10591 )
2022-07-04 22:29:41 +08:00
e68ab0084b
[bugfix]fix default value get wrong result because no implement read_by_rowids ( #10582 )
2022-07-04 19:30:49 +08:00
46bff6bba0
[fix](multi-catalog) fix the core dump on hms table ( #10573 )
...
In the funciton `TextConverter::write_vec_column`, it should execute the statement `nullable_column->get_null_map_data().push_back(0);` for every row.
Otherwise the null map will get error and cause the core dump.
2022-07-04 15:52:05 +08:00
9d4a9b95a4
[Build] fix the compile error with clang ( #10570 )
...
Co-authored-by: hucheng01 <hucheng01@baidu.com >
2022-07-04 11:13:17 +08:00
1a173a854e
[fix](routine-load) Fix that routine load cannot work with old kafka version ( #10554 )
...
Co-authored-by: caiconghui1 <caiconghui1@jd.com >
2022-07-04 10:47:50 +08:00
d56d88d391
[improvement]No need to memset flags for vectorization predicates ( #10564 )
2022-07-04 10:23:08 +08:00
0b251481d5
[Enhancement][Storage] refactor Comparison Predicates ( #10380 )
2022-07-04 09:22:27 +08:00
7bfe438884
[BUG] fix bug in literal debug_string when literal is null ( #10567 )
2022-07-04 08:57:55 +08:00
91fca49df4
[feature-wip](unique-key-merge-on-write) add primary key index ( #10529 )
2022-07-03 23:20:30 +08:00
aecf6e09a9
[fix] fix agg_memleak ( #10571 )
...
The previous code did not call 'destroy' to release the resource after the' create 'operation,
resulting in a memory leak. So I added Destroy
2022-07-03 20:22:26 +08:00
c9f86bc7e2
[refactor] Refactoring Status static methods to format message using fmt( #9533 )
2022-07-02 18:58:23 +08:00
5dd43fff53
[improvement] alloc aligned memory for block bloom filter to work with jemalloc ( #10446 )
2022-07-01 16:05:48 +08:00
ca0906626f
[BUG] fix bitmap function bug ( #10502 )
...
* fix bitmap function bug
* add regression test
2022-07-01 15:30:16 +08:00
97996c9275
[fix](Insert) fix 5 concurrent "insert...select..." OOM ( #10501 )
...
* [hotfix](dev-1.0.1) 5 concurrent insert...select... OOM
Co-authored-by: minghong <minghong.zhou@163.com >
Co-authored-by: yiguolei <yiguolei@gmail.com >
2022-07-01 15:29:26 +08:00
659e863bd7
[bugfix] fix tcmalooc hook cancel deadlock ( #10514 )
2022-07-01 10:41:59 +08:00
a9d23ce337
[refactor] remove collator ( #10518 )
2022-07-01 10:35:32 +08:00
06e436b7cc
[bugfix]dump_one_line failed to dump last column ( #10522 )
...
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-07-01 10:33:49 +08:00
0d99b27d89
[fix] (mem tracker) Fix BE hangs at startup, stuck in tcmalloc hook call ExecEnv::GetInstance() ( #10517 )
...
1. Added flag exec_env_existed to indicate whether ExecEnv Instance is created.
2. ThreadMemTrackerMgr::add_tracker fail when USE_MEM_TRACKER=OFF, add USE_MEM_TRACKER compile option.
2022-07-01 10:20:53 +08:00
7571263ed7
[Bug][Vectorized] fix timestamp(datetime) not regist right ( #10525 )
2022-07-01 07:37:44 +08:00
aab7dc956f
[refactor](load) Remove mini load ( #10520 )
2022-06-30 23:21:41 +08:00
18ad8ebfbb
[improvement]Add reading by rowids to speed up lazy materialization ( #10506 )
2022-06-30 21:03:41 +08:00
d9f2da8cf0
[bugfix] temporarily disable RF code to avoid core dump caused by vexpr destruction ( #10504 )
...
Runtime filter handling in volap_scann_ode may cause double free in VExprContext, temporarily disable it to avoid it.
2022-06-30 14:54:44 +08:00
d259770b86
[Fix] avoid core dump cause by malformed bitmap type data ( #10458 )
2022-06-30 11:27:22 +08:00
ec6620ae3e
[feature-wip](array-type) add function arrays_overlap ( #10233 )
2022-06-30 08:12:29 +08:00
2c35abe940
[bugfix]fix core dump on outfile with expr ( #10491 )
...
remove log
2022-06-29 20:38:49 +08:00
e42adbb959
Fix compilation error reported by clang ( #10494 )
2022-06-29 20:38:06 +08:00
4ec6e3ee81
[refactor] Remove debug action since it is never used. ( #10484 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2022-06-29 20:37:51 +08:00
b9223d1657
[Build] fix build fail on clang ( #10445 )
2022-06-29 15:08:24 +08:00
8e713ddfcf
[Feature] [Vectorized] support vectorized schema-change ( #10187 )
2022-06-29 15:07:21 +08:00
6a566ccb74
[Enhancement][Vectorized] add constexpr_loop_match ( #10283 )
2022-06-29 14:58:50 +08:00
5f73668626
[log] add more error info for hdfs reader writer ( #10475 )
2022-06-29 12:02:27 +08:00
abd10f0f3e
[feature-wip](multi-catalog) Impl FileScanNode in be ( #10402 )
...
Define a new file scanner node for hms table in be.
This file scanner node is different from broker scan node as blow:
1. Broker scan node will define src slot and dest slot, there is two memory copy in it: first is from file to src slot
and second from src to dest slot. Otherwise FileScanNode only have one stemp memory copy just from file to dest slot.
2. Broker scan node will read all the filed in the file to src slot and FileScanNode only read the need filed.
3. Broker scan node will convert type into string type for src slot and then use cast to convert to dest slot type,
but FileScanNode will have the final type.
Now FileScanNode is a standalone code, but we will uniform the file scan and broker scan in the feature.
2022-06-29 11:04:01 +08:00
8cbdbb5658
[Enhancement] a better vec version for count_zero_num ( #10472 )
2022-06-29 10:26:42 +08:00
deeb3028ad
[Enhancement] [Memory] [Vectorized] Stress test and optimize memory allocation ( #9581 )
...
* vec stress test, Allocator introduce chunkallocator
* fix comment
2022-06-29 02:57:51 +08:00
7898c818e9
Revert "[improvement]Do not lazily read dict encoded columns ( #10420 )" ( #10466 )
...
Reason:
1. Some queries performance degradation
2. Coredump bug: #10419
This reverts commit 904e7576797c796b809823647a769bc1d4569115.
2022-06-28 15:43:48 +08:00
