Commit Graph

8213 Commits

Author SHA1 Message Date
d98abb12f9 [fix](Nereids)set oepration type coercion is diff with legacy planner (#15982) 2023-01-17 11:41:41 +08:00
ce1d19b373 [fix](Nereids) lateral view cannot bind function nested in generators (#15960) 2023-01-17 11:37:56 +08:00
6609eb804d [fix](regression) result of withUnionAll in query_p0/select_no_from is unstable (#15958) 2023-01-17 11:34:41 +08:00
9f106161a7 [Bug](join) Fix null aware anti join error in fuzzy mode (#15987) 2023-01-17 11:32:16 +08:00
8d25b156aa [fix](nereids) bind slot using exactly match (#15950)
example:
unbound slot k
bounded [k, t.k]

In previous binding algorithm, there are 2 candidate bindings,
in which bounded k is exactly matched unbound slot k, it has higher priority than that of t1.k
2023-01-17 11:25:08 +08:00
9755358787 [fix](brokerload) fix be core dump casued by broker load (#15874) 2023-01-17 11:21:13 +08:00
b6d9e73c59 [feature](merge-on-write) enable by default (#15920) 2023-01-17 11:15:42 +08:00
1ea11aa120 [Bug](datev2) Fix wrong cast expr (#15985)
Found by regression tests when I turn on enable_date_conversion
2023-01-17 10:18:20 +08:00
0ab0479633 [Compile](lzo) fix lzo decompressor compiler error (#15956) 2023-01-17 09:56:07 +08:00
b1caa68706 [Feature-WIP](inverted index) inverted index reader's implementation, and add mysql_fulltext regression case to test fulltext query (#15823)
Issue Number: Step2 of DSIP-023: Add inverted index for full text search
implementation of inverted index reader

dependency pr: #14211 #15807 #15821
2023-01-17 09:13:56 +08:00
089d93534c fix missing comma for properties (#15942) 2023-01-17 09:00:00 +08:00
a3bca46d73 [typo](docs)sidebar docs fix (#15992) 2023-01-17 08:59:33 +08:00
167b1963a7 add host and port in hdfs outfile (#15953) 2023-01-17 08:58:07 +08:00
be3482e6d6 [docs](compilation) Update the post: Compilation on macOS (#15970)
Add more details about using the pre-built third-party libraries.
2023-01-17 00:09:04 +08:00
4b49d05e97 [refactor](fe) remove type related class to fe-common to reduce java-udf jar size (#15808) 2023-01-17 00:01:15 +08:00
525f990d2b [feture-wip](multi-catalog) upgrade iceberg pom version to 1.1.0, for rest catalog api (#15964)
Co-authored-by: jinzhe <jinzhe@selectdb.com>
2023-01-16 23:10:41 +08:00
1b2f882d24 [fix](terminal) remove echo database passwd (#15876)
* remove echo passwd
* add timer for data load
2023-01-16 22:00:52 +08:00
0057243f54 [improvement](reader) use union merge when rowset are noneoverlapping (#15749) 2023-01-16 21:53:18 +08:00
65a4c8b163 [refactor] refactor segment writer (#15705)
Co-authored-by: zhoubintao <1229701101@qq.com>
2023-01-16 21:50:21 +08:00
5521c7a236 [fix](load) fix that tablet channel doesn't set received rows for verify the number of rows (#15961) 2023-01-16 19:46:59 +08:00
bdec4d5ac2 [enhancement](profile) add read columns to scanner profile (#15902) 2023-01-16 19:32:46 +08:00
d75cf756c5 [fix](third-party) Pass search paths of dependencies to CLucene explicitly (#15959)
When building CLucene, CMake may find the wrong Boost and zlib. We should pass the search paths to the build command for CLucene explicitly to find the correct dependencies.
2023-01-16 17:12:40 +08:00
806cd9fb3c [regression-test](topn)add test cases for nonkey topn query for each scalar type (#15790)
related to #15558 #15693
1. dup key table with 17 scalar datatypes
2. unique key table with mow enabled
3. unique key table with mow disabled
2023-01-16 16:49:59 +08:00
97fcad76f8 [enhancement](memtracker) Improve readability (#15716) 2023-01-16 16:30:35 +08:00
b7f43441e3 [enhancement](load) change the publish version log to VLOG_CRITICAL (#15673) 2023-01-16 16:22:33 +08:00
63d48564ed [fix](datetimev2) fix datetimev2 error with T (#15915)
Signed-off-by: nextdreamblue <zxw520blue1@163.com>
2023-01-16 15:30:48 +08:00
899f5f5cf5 [feature](multi-catalog) support hive metastore more events (#15702)
support hive metastore more events
2023-01-16 14:16:12 +08:00
fa03c8a241 [feature](nereids) const folding for in-predicate with null literal (#15880)
select 1 in (2 , null)  => null
select 1 in (1 , null)  => true
select 1 not in (2 , null)  => null
select 1 not in (1 , null)  => false
2023-01-16 13:48:45 +08:00
Pxl
81bab55d43 [Bug](function) catch function calculation error on aggregate node to avoid core dump (#15903) 2023-01-16 11:21:28 +08:00
3cb7b2ea50 [refactor](doc) add first class category "lakehouse" for multi catalog and external table (#15934)
* [refactor](doc) add new first class catalog lakehouse for multi catalog and external table
I change the doc of multi-catalog and external table.

Now there will be a first-class category named "Lakehouse" in doc sidebar.
2023-01-16 09:27:02 +08:00
151fdc224e [Fix](inverted index) fix compilation error for inverted index compound directory (#15946)
fix compilation error for inverted index compound directory

```
be/src/olap/rowset/segment_v2/inverted_index_compound_directory.cpp:249:32: error: comparison of unsigned expression in '< 0' is always false [-Werror=type-limits]
  249 |         if (h->_reader->size() < 0) {
      |             ~~~~~~~~~~~~~~~~~~~^~~
```
2023-01-16 08:59:55 +08:00
wxy
067b33bca7 [Enhancement](profile) use queryId of originStatement as the queryId. (#15898)
* [Enhancement](profile) use queryId of originStatement as the queryId.

Co-authored-by: wangxiangyu@360shuke.com <wangxiangyu@360shuke.com>
2023-01-15 18:26:14 +08:00
0d61ca7cdd [chore](regression) remove redundant case (#15935) 2023-01-15 11:06:33 +08:00
Pxl
b727033906 [Chore](build) enable -Wextra and remove some -Wno (#15760)
enable -Wextra and remove some -Wno
2023-01-15 10:40:35 +08:00
fd0c352144 [fix](thirdparty) patch sqltypes.h in odbc to avoid conflict with clucene macro TCHAR (#15926)
Fix conflit name TCHAR in odbc sqltypes.h and clucene clucene-config.h.
Change TCHAR to TWCHAR in odbc sqltypes.h, because TCHAR in odbc is not found used in doris,
but there are too many places to call clucene's TCHAR.

thirdparty/installed/include/sqltypes.h: 
`typedef char                            TCHAR;`

thirdparty/installed/include/CLucene/clucene-config.h: 
`typedef  wchar_t TCHAR;`
2023-01-15 10:10:00 +08:00
5af7bcaa55 [Bug](decimalv3) Fix missing precision and scale in predicates (#15930) 2023-01-15 00:01:48 +08:00
429af016dd [fix](test) donot use same table name in a database (#15931) 2023-01-15 00:01:33 +08:00
58c520dbfd [Feature](remote) Cooldown cold data to object storage only one replica (#15832) 2023-01-14 23:58:00 +08:00
a65044dbac [fix](nereids) unstable regression case in nereids_syntax_p0 (#15896) 2023-01-14 22:37:30 +08:00
29863112a4 (test) change remote_fragment_exec_timeout_ms in p0/p1 to 60 seconds (#15932)
test_join case failed due to send fragment timeout frequently.
2023-01-14 22:07:35 +08:00
3575233375 [typo](doc) add iceber_meta table valued function docs (#15883)
Add iceber_meta table valued function docs.
For #15418 and #15618
2023-01-14 21:22:31 +08:00
0206e0bc57 [Feature](inverted index) implementation of inverted index writer for numeric types, using bkd index (#15918)
Step3 of DSIP-023: Add inverted index for full text search
implementation of inverted index writer for numeric types, using bkd index
dependency pr: #14207 #15807 #15821
2023-01-14 21:06:51 +08:00
57098bf669 [fix](thirdparty) fix bug for build_thirdparty (#15910) 2023-01-14 21:02:59 +08:00
98c74f9ab8 [improvement](signal) add tid during core dump,the tid is equal to tid in be.INFO (#15893)
Co-authored-by: yiguolei <yiguolei@gmail.com>
2023-01-14 18:40:02 +08:00
c88c6b3c41 [chore](build) Fix linkage errors on macOS (arm64) (#15922)
macOS with Apple Silicon chip doesn't support AVX2 instructions, we should build CLucene without AVX2 support.
2023-01-14 18:37:56 +08:00
84d6938a73 [Bug](pipeline) Fix BE crash caused by pipeline (#15890)
* [Bug](pipeline) Fix BE crash caused by pipeline

* update
2023-01-14 18:37:19 +08:00
0a57f12578 [Bug](datev2) Fix bugs for datev2 (#15860)
These bugs are found when I run regression test with enable_date_conversion on
2023-01-14 18:36:36 +08:00
c4475a8dbc [Enhencement](jdbc scanner) add profile for jdbc scanner (#15914) 2023-01-14 10:28:59 +08:00
313e14d220 [Bugfix] (ROLLUP) fix the coredump when add rollup by link schema change (#15654)
Because of the rollup has the same keys and the keys's order is same, BE will do linked schema change. The base tablet's segments will link to the new rollup tablet. But the unique id from the base tablet is starting from 0 and as the rollup tablet also. In this case, the unique id 4 in the base table is column 'city', but in the rollup tablet is 'cost'. It will decode the varcode page to bigint page so that be coredump. It needs to be rejected.

I think that if a rollup add by link schema change, it means this rollup is redundant. It brings no additional revenue and wastes storage space. So It needs to be rejected.
2023-01-14 10:20:07 +08:00
2810029d24 [fix](multi-catalog) fix bug that replay init catalog may happen after catalog is dropped (#15919) 2023-01-14 09:41:37 +08:00