Commit Graph

13721 Commits

Author SHA1 Message Date
bbdf40b6bd [Enhencement](Push Handle) use VParquetScanner in PushHandle (#15980)
* use VParquetScanner in PushHadnle

* delete ParquetScanner
2023-01-17 16:21:04 +08:00
151ae71761 [fix](be)fix bug of VSetOperationNode::release_resource (#15997)
should call "ExecNode::release_resource(state)" if child class override the parent's method
2023-01-17 16:16:25 +08:00
7e4bc1fee6 [fix](Nereids) add a rule to adjust nullable of all expressions (#15791)
we have some rules that change output's nullable in rewrite step. So we need a rule to adjust nullable at the end of rewrite step.

TODO
- remove the output slot map
- add nullable compare into slot reference
- use exprid to compare two slot if do not need to compare nullable
- merge all rules into one to adjust all type plans
2023-01-17 15:51:25 +08:00
82e2102e18 [fix](MTMV) Exceptions occur when dropping meterialized view with if exists (#15568) 2023-01-17 15:29:39 +08:00
01ae9fb380 [typo](doc) fix language zh-CH (#15989) 2023-01-17 15:12:59 +08:00
d062ca2944 [refactor](vectorized) remove unnecessary vectorization check (#15984) 2023-01-17 12:21:46 +08:00
7d34512501 [Bug](pipeline) Fix DCHECK failure (#15928) 2023-01-17 12:01:20 +08:00
b469efdb17 [fix](Nereids) all slot in grouping sets in repeat node should be nullable (#15991)
according to be's code, all slot in grouping set should be nullable.
reference to be code (be3482e6d6/be/src/vec/exec/vrepeat_node.cpp (L113))
2023-01-17 11:47:55 +08:00
d98abb12f9 [fix](Nereids)set oepration type coercion is diff with legacy planner (#15982) 2023-01-17 11:41:41 +08:00
ce1d19b373 [fix](Nereids) lateral view cannot bind function nested in generators (#15960) 2023-01-17 11:37:56 +08:00
6609eb804d [fix](regression) result of withUnionAll in query_p0/select_no_from is unstable (#15958) 2023-01-17 11:34:41 +08:00
9f106161a7 [Bug](join) Fix null aware anti join error in fuzzy mode (#15987) 2023-01-17 11:32:16 +08:00
8d25b156aa [fix](nereids) bind slot using exactly match (#15950)
example:
unbound slot k
bounded [k, t.k]

In previous binding algorithm, there are 2 candidate bindings,
in which bounded k is exactly matched unbound slot k, it has higher priority than that of t1.k
2023-01-17 11:25:08 +08:00
9755358787 [fix](brokerload) fix be core dump casued by broker load (#15874) 2023-01-17 11:21:13 +08:00
b6d9e73c59 [feature](merge-on-write) enable by default (#15920) 2023-01-17 11:15:42 +08:00
1ea11aa120 [Bug](datev2) Fix wrong cast expr (#15985)
Found by regression tests when I turn on enable_date_conversion
2023-01-17 10:18:20 +08:00
0ab0479633 [Compile](lzo) fix lzo decompressor compiler error (#15956) 2023-01-17 09:56:07 +08:00
b1caa68706 [Feature-WIP](inverted index) inverted index reader's implementation, and add mysql_fulltext regression case to test fulltext query (#15823)
Issue Number: Step2 of DSIP-023: Add inverted index for full text search
implementation of inverted index reader

dependency pr: #14211 #15807 #15821
2023-01-17 09:13:56 +08:00
089d93534c fix missing comma for properties (#15942) 2023-01-17 09:00:00 +08:00
a3bca46d73 [typo](docs)sidebar docs fix (#15992) 2023-01-17 08:59:33 +08:00
167b1963a7 add host and port in hdfs outfile (#15953) 2023-01-17 08:58:07 +08:00
be3482e6d6 [docs](compilation) Update the post: Compilation on macOS (#15970)
Add more details about using the pre-built third-party libraries.
2023-01-17 00:09:04 +08:00
4b49d05e97 [refactor](fe) remove type related class to fe-common to reduce java-udf jar size (#15808) 2023-01-17 00:01:15 +08:00
525f990d2b [feture-wip](multi-catalog) upgrade iceberg pom version to 1.1.0, for rest catalog api (#15964)
Co-authored-by: jinzhe <jinzhe@selectdb.com>
2023-01-16 23:10:41 +08:00
1b2f882d24 [fix](terminal) remove echo database passwd (#15876)
* remove echo passwd
* add timer for data load
2023-01-16 22:00:52 +08:00
0057243f54 [improvement](reader) use union merge when rowset are noneoverlapping (#15749) 2023-01-16 21:53:18 +08:00
65a4c8b163 [refactor] refactor segment writer (#15705)
Co-authored-by: zhoubintao <1229701101@qq.com>
2023-01-16 21:50:21 +08:00
5521c7a236 [fix](load) fix that tablet channel doesn't set received rows for verify the number of rows (#15961) 2023-01-16 19:46:59 +08:00
bdec4d5ac2 [enhancement](profile) add read columns to scanner profile (#15902) 2023-01-16 19:32:46 +08:00
d75cf756c5 [fix](third-party) Pass search paths of dependencies to CLucene explicitly (#15959)
When building CLucene, CMake may find the wrong Boost and zlib. We should pass the search paths to the build command for CLucene explicitly to find the correct dependencies.
2023-01-16 17:12:40 +08:00
806cd9fb3c [regression-test](topn)add test cases for nonkey topn query for each scalar type (#15790)
related to #15558 #15693
1. dup key table with 17 scalar datatypes
2. unique key table with mow enabled
3. unique key table with mow disabled
2023-01-16 16:49:59 +08:00
97fcad76f8 [enhancement](memtracker) Improve readability (#15716) 2023-01-16 16:30:35 +08:00
b7f43441e3 [enhancement](load) change the publish version log to VLOG_CRITICAL (#15673) 2023-01-16 16:22:33 +08:00
63d48564ed [fix](datetimev2) fix datetimev2 error with T (#15915)
Signed-off-by: nextdreamblue <zxw520blue1@163.com>
2023-01-16 15:30:48 +08:00
899f5f5cf5 [feature](multi-catalog) support hive metastore more events (#15702)
support hive metastore more events
2023-01-16 14:16:12 +08:00
fa03c8a241 [feature](nereids) const folding for in-predicate with null literal (#15880)
select 1 in (2 , null)  => null
select 1 in (1 , null)  => true
select 1 not in (2 , null)  => null
select 1 not in (1 , null)  => false
2023-01-16 13:48:45 +08:00
Pxl
81bab55d43 [Bug](function) catch function calculation error on aggregate node to avoid core dump (#15903) 2023-01-16 11:21:28 +08:00
3cb7b2ea50 [refactor](doc) add first class category "lakehouse" for multi catalog and external table (#15934)
* [refactor](doc) add new first class catalog lakehouse for multi catalog and external table
I change the doc of multi-catalog and external table.

Now there will be a first-class category named "Lakehouse" in doc sidebar.
2023-01-16 09:27:02 +08:00
151fdc224e [Fix](inverted index) fix compilation error for inverted index compound directory (#15946)
fix compilation error for inverted index compound directory

```
be/src/olap/rowset/segment_v2/inverted_index_compound_directory.cpp:249:32: error: comparison of unsigned expression in '< 0' is always false [-Werror=type-limits]
  249 |         if (h->_reader->size() < 0) {
      |             ~~~~~~~~~~~~~~~~~~~^~~
```
2023-01-16 08:59:55 +08:00
wxy
067b33bca7 [Enhancement](profile) use queryId of originStatement as the queryId. (#15898)
* [Enhancement](profile) use queryId of originStatement as the queryId.

Co-authored-by: wangxiangyu@360shuke.com <wangxiangyu@360shuke.com>
2023-01-15 18:26:14 +08:00
0d61ca7cdd [chore](regression) remove redundant case (#15935) 2023-01-15 11:06:33 +08:00
Pxl
b727033906 [Chore](build) enable -Wextra and remove some -Wno (#15760)
enable -Wextra and remove some -Wno
2023-01-15 10:40:35 +08:00
fd0c352144 [fix](thirdparty) patch sqltypes.h in odbc to avoid conflict with clucene macro TCHAR (#15926)
Fix conflit name TCHAR in odbc sqltypes.h and clucene clucene-config.h.
Change TCHAR to TWCHAR in odbc sqltypes.h, because TCHAR in odbc is not found used in doris,
but there are too many places to call clucene's TCHAR.

thirdparty/installed/include/sqltypes.h: 
`typedef char                            TCHAR;`

thirdparty/installed/include/CLucene/clucene-config.h: 
`typedef  wchar_t TCHAR;`
2023-01-15 10:10:00 +08:00
5af7bcaa55 [Bug](decimalv3) Fix missing precision and scale in predicates (#15930) 2023-01-15 00:01:48 +08:00
429af016dd [fix](test) donot use same table name in a database (#15931) 2023-01-15 00:01:33 +08:00
58c520dbfd [Feature](remote) Cooldown cold data to object storage only one replica (#15832) 2023-01-14 23:58:00 +08:00
a65044dbac [fix](nereids) unstable regression case in nereids_syntax_p0 (#15896) 2023-01-14 22:37:30 +08:00
29863112a4 (test) change remote_fragment_exec_timeout_ms in p0/p1 to 60 seconds (#15932)
test_join case failed due to send fragment timeout frequently.
2023-01-14 22:07:35 +08:00
3575233375 [typo](doc) add iceber_meta table valued function docs (#15883)
Add iceber_meta table valued function docs.
For #15418 and #15618
2023-01-14 21:22:31 +08:00
0206e0bc57 [Feature](inverted index) implementation of inverted index writer for numeric types, using bkd index (#15918)
Step3 of DSIP-023: Add inverted index for full text search
implementation of inverted index writer for numeric types, using bkd index
dependency pr: #14207 #15807 #15821
2023-01-14 21:06:51 +08:00