9f9651b2f2
[Enhancement](Jemalloc): correct the varialbe name of malloc_conf & enable prof ( #15382 )
...
enable profile and correct the conf name in Jemalloc.
2022-12-28 09:50:59 +08:00
816e12db6a
[Bench](mem) some benchmark over the query limit ( #15408 )
2022-12-28 09:29:53 +08:00
28bb13a026
[feature](light-schema-change) enable light schema change by default ( #15344 )
2022-12-28 09:29:26 +08:00
22b31e516c
[Bug](decimalv3) select view of decimalv3 error ( #15404 )
2022-12-28 08:38:33 +08:00
5ac7b09765
[feature](Nereids) Support SchemaScan ( #15411 )
...
such as: select * from information_schema.backends;
2022-12-28 00:33:48 +08:00
aad53d37c7
[typo](docs)fix doris docs 404 link ( #15400 )
2022-12-27 22:57:40 +08:00
03aef7a8ac
[fix](nereids) sender in union's child fragment has no destination ( #15402 )
...
1. always create an exchange node for set operation node's children
2. fix cast expr's nullability bug.
2022-12-27 22:36:54 +08:00
700f963571
[refactor](remove-non-vec) remove some non vec code in segment iterator and remove reuse schema opt since it is introduced in non-vec code ( #15407 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2022-12-27 22:30:02 +08:00
51b14c06d3
[enhancement](nereids) support approx_count_distinct function ( #15406 )
2022-12-27 22:25:21 +08:00
c63dda99db
[test](Nereids) Disable some regression test for materialized index. ( #15387 )
...
When light schema change is enabled by default (#15344 ), regression tests that run SQL by selecting data from the materialized index will fail.
This PR disabled those failed queries in the regression test. Those tests would be added back when nereids planner could give the correct plan when light schema change is enabled.
2022-12-27 19:24:03 +08:00
0550dfaeb2
[enhancement](rewrite) add OrToIn rule and fix ExtractCommonFactorsRule apply problems ( #12872 )
...
Co-authored-by: wuhangze <wuhangze@jd.com >
2022-12-27 18:39:53 +08:00
849adca225
[fix](Nereids) expressions is not be extracted when binding function ( #15361 )
2022-12-27 17:12:07 +08:00
a07ca41f8e
[Fix](Nereids) fix repeat node nullable error bugs ( #15251 )
2022-12-27 17:01:33 +08:00
524208ab3a
[Feature](bitmap/hll)Support return bitmap/hll data in select statement in vectorization ( #15224 )
...
Support return bitmap data in select statement in vectorization mode
In the scenario of using Bitmap to circle people, users need to return the Bitmap results to the upper layer, which is parsing the contents of the Bitmap to deal with high QPS query scenarios
2022-12-27 14:49:24 +08:00
5a8201320a
[fix](nereids) group by constants produce wrong result ( #15322 )
...
SELECT 2 FROM tbl GROUP BY 1
it should produce 2 would the table is not empty when table is not empty. Before this PR, the execution of nereids generated plan would produce empty result set
2022-12-27 14:35:02 +08:00
b3f77a2e00
[feature](Show) add one show type cast command ( #15137 )
2022-12-27 14:19:04 +08:00
6d851b1fc9
[Doc](Flink) update flink connector doc add new version #15365
...
Co-authored-by: wudi <>
2022-12-27 14:15:49 +08:00
777b0b94bb
[typo](docs) fix wrong date format ( #15363 )
...
fix wrong date format
2022-12-27 11:45:05 +08:00
69068f9835
[fix](planner) fix hll_union plan: Invalid Aggregate Operator: hll_union ( #14931 )
...
When using hll_union aggregate function, PREAGGREGATION is always OFF and Rollup cannot be hit.
2022-12-27 11:20:41 +08:00
99868f9929
[fix](planner) set limit to nagtive value when has offset in limit ( #15367 )
2022-12-27 11:16:19 +08:00
73957a028c
[fix](mow-uniquekey) fix dereference to nullptr in Tablet::calc_delete_bitmap ( #15375 )
2022-12-27 11:14:25 +08:00
0f922a83c7
[fix](nereids) group_bit_xxx signature update ( #15318 )
2022-12-27 00:41:42 +08:00
325d247b92
[Feature](Nereids) Support hll and count for materialized index. ( #15275 )
2022-12-27 00:38:04 +08:00
650136c32e
[Enhancement](fe): replace assertTrue(X.equals(X)) with assertEquals ( #15356 )
2022-12-27 00:37:24 +08:00
8879400419
[feature](nereids) Support query on specific partitions ( #15243 )
2022-12-27 00:32:14 +08:00
a1c6ea876f
[fix](inbitmap) fix core dump caused by bitmap filter with union ( #15333 )
...
The join node need project operation to remove unnecessary columns from the output tuples.
For SetOperationNode output tuple and input tuple is consistent and do not need project,
but the children of SetOperationNode may be join nodes, so the children of the SetOperationNode
need to do the project operation.
2022-12-26 23:14:32 +08:00
fc8f6a0715
[fix](multi-catalog) throw NPE when reading data after EOF ( #15358 )
...
1. Fix 1 bug:
Throw null pointer exception when reading data after the reader reaches the end of file, so should return directly when `_do_lazy_read` read no data.
2. Optimize code:
Remove unused parameters.
3. Fix regression test
2022-12-26 22:49:35 +08:00
aa0f38f864
[chore](gutil) remove some gutil files and use c++ stl instead ( #15357 )
...
* [chore](gutil) remove some gutil files and use c++ stl instead
* fix
* fix
2022-12-26 21:25:09 +08:00
301640d3c0
[fix](string) fix offsets over flow for extreme large String column ( #15360 )
...
* [fix](string) fix offsets over flow for extreme large String column
* fix
2022-12-26 21:23:58 +08:00
c3d0e2931a
[typo](docs) fix version tag for docs of s3 token ( #15362 )
2022-12-26 19:23:43 +08:00
72f0003753
[enhancement](regression) use sf0.1 data in datev2 and decimalv3 cases ( #15342 )
2022-12-26 19:15:49 +08:00
ae87415174
[Feature](Nereids) add simplify arithmetic rule ( #15242 )
...
support simplify arithmetic rule
for example ：
a + 1 > 1
=> a > 0
2022-12-26 16:57:59 +08:00
24a994eb9f
[Feature-WIP](inverted) add inverted index writer api for be ( #14207 )
2022-12-26 15:02:12 +08:00
1400a89065
[Bug](Compile) fix compile error by using correct method name ( #15355 )
...
fix compile error by using correct method name
2022-12-26 14:58:01 +08:00
8b6e4e74e7
[improvement](jdbc) add default jdbc driver's dir ( #15346 )
...
Add a new config "jdbc_drivers_dir" for both FE and BE.
User can put jdbc drivers' jar file in this dir, and only specify file name in "driver_url" properties
when creating jdbc resource.
And Doris will find jar files in this dir.
Also modify the logic so that when the jdbc resource is modified, the corresponding jdbc table
will get the latest properties.
2022-12-26 11:51:12 +08:00
bf71943605
[feature](load) stream load trim double quotes for csv ( #15241 )
2022-12-26 11:45:54 +08:00
7b5739e9a9
[Fix](Nerids) fix dup key for pull predicate from project children ( #15292 )
...
In InferPredicates, we need pull predicates from project children then use sid replace id1.
In our code, use alias name as key, use expression as value to build map. Obviously, sid has two alias name(id1,id2) so throw Duplicate key exception.
2022-12-26 10:57:14 +08:00
bd52fa1966
[enhancement](checksum) use vertorized engine in checksum ( #15260 )
2022-12-26 10:28:15 +08:00
ca4674ca68
[pipeline](opt) opt the exec performance of pipe exec engine ( #15330 )
...
opt the exec performance of pipe exec engine
2022-12-26 09:58:52 +08:00
6bec1ffc47
[feature](planner) remove restrict of offset without order by ( #15218 )
...
Support SELECT * FROM tbl LIMIT 5, 3;
2022-12-26 09:37:41 +08:00
ada091b5d2
[fix](array-type) forbid implicit cast of array type while load ( #15325 )
...
* forbit array cast while load
* add regression test
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com >
2022-12-26 09:24:44 +08:00
ec055e1acb
[feature](new file reader) Integrate new file reader ( #15175 )
2022-12-26 08:55:52 +08:00
0e651365ca
[profile](scanner) add per scanner running time profile ( #15321 )
...
* [profile](scanner) add per scanner running time profile
Co-authored-by: yiguolei <yiguolei@gmail.com >
2022-12-26 08:55:07 +08:00
a807978882
[refactor](non-vec) Remove rowbatch code from delta writer and some rowbatch related code ( #15349 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2022-12-26 08:54:51 +08:00
b7768a928d
[Improvement](S3) support access s3 via temporary security credentials ( #15340 )
2022-12-26 00:31:55 +08:00
f821dbc9f2
[doc] enable_new_load_scan_node doc ( #15347 )
2022-12-25 22:51:37 +08:00
001153ab38
[Improvement](multi-catalog) support hive external tables which store data on tencent chdfs ( #15297 )
...
* support read hive table whichs store data on tencent chdfs in multi-catalog
2022-12-25 21:57:18 +08:00
fe9571c2fd
[typo](docs) fix typo in get-starting.md ( #15345 )
2022-12-25 21:56:44 +08:00
e640f49b6d
[refactor](non-vec) remove non vectorized predicate and row_block ( #15348 )
...
remove non vectorized predicate and row_block
2022-12-25 21:45:00 +08:00
691790a46f
[typo](docs) fix typo in tablet-repair-and-balance ( #15341 )
2022-12-25 10:12:02 +08:00
