Commit Graph

6608 Commits

Author SHA1 Message Date
e6c3557b1b [improvement](regression-test) Support suite plugin to add third-part… (#9294)
Support register suite plugin to add third-party function.

See 
1. register in: ${DORIS_HOME}/regression-test/plugins/plugin_example.groovy
2. usage: ${DORIS_HOME}/regression-test/suites/demo/test_plugin.groovy
3. doc: ${DORIS_HOME}/docs/zh-CN/developer-guide/regression-testing.md
2022-05-05 20:45:45 +08:00
6d1c300241 [improvement](odbc) support more ODBC Connection Parameters for odbc external table (#9198)
user can add more supported ODBC Connection Parameters to resource PROPERTIES or external table PROPERTIES
2022-05-05 20:45:13 +08:00
e222a50c42 [fix](backup) Remove colocate_with property when backing up a table (#9142)
We currently not support backup table with colocation property.
So that we have to remove colocate_with property from a table when backing up.
2022-05-05 20:44:27 +08:00
0604ecba17 [fixbug][metadata] catalog could not load from image (#9364)
* [fixbug][catalog] catalog could not load from image

* fix ut failed

Co-authored-by: yiguolei <yiguolei@gmail.com>
2022-05-05 09:58:01 +08:00
7d6645f8f1 [doc] update member.md (#9361) 2022-05-05 09:57:23 +08:00
512d8784d9 [improvement](load) Add http header size parameter (#9357)
Add the http header size parameter to avoid failure due to too many fields when users import using stream load.
The normal default is 8192, and 10K is given here.
2022-05-05 09:56:53 +08:00
ac5f4d6c7e [docs] Fix some typos in documentation. (#9356) 2022-05-05 09:56:02 +08:00
a33191e222 [fix](memtracker) DCHECK failed in vetorized exec engine fold constant execute (#9354) 2022-05-05 09:55:38 +08:00
832338c55e [improvement] set name for scanner threads and fix compile error in clang (#9336) 2022-05-05 09:53:43 +08:00
4ca3eb7fe2 [improvement](regression-test) support exclude suite/group/directory (#9096)
regression testing framework support skip some suite/group/directory
2022-05-05 09:50:07 +08:00
23d673a178 [fix](vectorized) Fix bug of outer join with delete column (#9315) 2022-05-05 09:42:48 +08:00
4a578b02a5 [fix][doc]add design doc (#9324)
add design doc
2022-05-05 09:31:37 +08:00
c5941fd166 [FE Code Style][sub] Adjust some check rules (#9345)
Adjust `RedundantImport`,`UnusedImports`,`EmptyStatement`,`NewlineAtEndOfFile`,`UpperEll`, `AvoidStarImport`, `MissingOverride` rules.
2022-05-04 23:34:55 +08:00
f1aa9668af [refactor][storage format] Forbidden rowset v1 (#9248)
- Force change the existing olaptable's storage format from V1 to V2
- Forbidden to create new olap table with storage format == v1 OR do schema change that want to create new v1 format
2022-05-04 17:32:20 +08:00
ac3f981175 [typo] fix getting started doc (#9352) 2022-05-03 22:39:23 +08:00
d6e88955c2 [doc] Implement java-format-code.md for IDEA (#9349) 2022-05-03 22:38:45 +08:00
9272226920 [doc] Remove deprecated BE config and add new config (#9347) 2022-05-03 22:37:51 +08:00
eed62695e1 [fix](function) handle merge in window_funnel_init and add test (#9338) 2022-05-03 22:37:06 +08:00
3baf6cefc3 [fix](alter-job) Missing alter job when doing checkpoint image (#9329)
This bug is introduced from #8030
2022-05-03 22:36:36 +08:00
7eefad429b [doc] Update sequence-column-manual.md (#9321) 2022-05-03 22:34:02 +08:00
dcf5f784d8 [fix](catalog) fix bug that replica missing version cause query -214 error (#9266)
1. Fix bug described in #9267 
    When report missing version replica, set last failed version to (replica version + 1)
2. Skip non-exist partition when handling transactions.
2022-05-03 17:54:19 +08:00
49a0cd1925 [fix](compaction) fix bug for vectorized compaction (#9344)
1. add a BE config to switch vectorized compaction
2. Fix vectorized compaction bug that row statistic is not right.
2022-05-03 17:31:40 +08:00
Pxl
b1870faddd [Bug] [Build] fix clang build fail (#9323)
* fix clang compile fail
2022-05-02 18:04:57 +08:00
Pxl
d2374dbd5e [fix](Lateral-View) fix outer combinator not work on non-vectorized (#9212) 2022-05-01 22:09:50 +08:00
5074018f0c [doc] fix EN doc edit link 404 (#9182) 2022-05-01 22:08:28 +08:00
f5f629304b [fix](truncate) fix bug that truncate partition throw NPE (#9339)
1. partition name is case insensitive.
2. add a simple help-resource.zip to help pass the FE ut.
2022-05-01 18:26:56 +08:00
b655ba8768 [doc] update doris manager doc (#9319) 2022-05-01 17:54:37 +08:00
bdf66731fa [doc] Add Flink Connector Sink Bitmap Type Doc (#9316) 2022-05-01 17:53:10 +08:00
239b6374ca [doc] fix new doc v2 bug (#9309)
change sql-references-v2 to sql-references
2022-05-01 17:51:34 +08:00
17f38cdcb1 [doc] add error doc for action_table.dat (#9263) 2022-05-01 17:50:48 +08:00
e3d7134962 fix complication guide on ubuntu (#9337) 2022-05-01 17:42:13 +08:00
784681f106 [FE Code Style][step 0]add github action to check incremental code in pr (#9328)
1. add rules to checkstyle
2. add github action to check incremental code in pr
2022-05-01 17:30:29 +08:00
4bd5d4f163 [feature-wip](statistics) step3: schedule the statistics tasks and update relevant info (#8860)
This pull request includes some implementations of the statistics(https://github.com/apache/incubator-doris/issues/6370), it will not affect any existing code and users will not be able to create statistics job.

After receiving the statistics statement and dividing the collection task, here we will start implementing the scheduling statistics task and updating the job information. Mainly include the following:
- Create a thread pool to schedule a certain number of tasks, and the number of concurrency is related to the configuration `cbo_concurrency_statistics_task_num`.
- After the task is completed, update the information of of the statistics Job.
2022-05-01 11:34:08 +08:00
84c2e4de29 [fix][doc]Modify readme link (#9334) 2022-04-30 16:55:43 +08:00
7431288c52 [github-action] Update regression required check in .asf.yaml (#9333)
Change `P0 regression (Doris P0 regression)` to `P0 regression (Doris P0 Regression)`
2022-04-30 15:23:34 +08:00
489581777f [fix](ut) Fix MarkDownParserTest (#9332) 2022-04-30 13:02:11 +08:00
c9961c9bb9 [style] clang-format all c++ code (#9305)
- sh build-support/clang-format.sh  to  clang-format all c++ code
2022-04-29 16:14:22 +08:00
201cd207f9 [Enhancement][Vectorized] Improve hash table build efficiency (#9250)
1. MAP_POPULATE is missing for mmap in Allocator, because macro OS_LINUX is not defined in allocator.h;
2. MAP_POPULATE has no effect for mremap as for mmap, zero-fill enlarged memory range explicitly to pre-fault the pages
2022-04-29 14:26:33 +08:00
ce7905e983 [fix](vectorized) Query get wrong result when ColumnDict concurrent predicate eval (#9270) 2022-04-29 11:45:04 +08:00
420cc2c3d8 [fix](help-doc) fix format of all sql-manual doc (#9306) 2022-04-29 11:42:02 +08:00
2c81624765 [Features]Add dbt doris adapter (#9299)
* Add dbt doris adapter

* Add licence header to each file

* Fix licence header
2022-04-29 11:40:29 +08:00
c132abd2bd (Refactor)[Statistics] Fix lock risks in Statistics Job (#9256)
* (Refactor)[Statistics] Fix lock risks in Statistics Job

1. Remove lock nesting between job and task
2. Solve the deadlock problem during job update
3. Avoid printing the log while holding the lock

* Add log
2022-04-29 10:46:24 +08:00
2fa19113ab [fix](profile) Short-circuit and del predicate filter rows are not counted on vectorized exec (#9268) 2022-04-29 10:45:48 +08:00
cbfb4a3115 [fix](materialized-view) fix bug that can not create mv for list partitioned table (#9281) 2022-04-29 10:45:09 +08:00
c077fafe76 [test](storage)duplicate model storage layer regression-test (#9285)
* duplicate model storage layer regression-test

* use insert values for batch

Co-authored-by: Wang Bo <wangbo36@meituan.com>
2022-04-29 10:42:09 +08:00
9ef09b8354 [feature](statistics) Statistics derivation.Step 1:ScanNode implement… (#8947)
* [feature](statistics) Statistics derivation.Step 1:ScanNode implementation

Co-authored-by: jianghaochen <jianghaochen@meituan.com>
2022-04-29 10:41:12 +08:00
93a41b2625 [refactor][routineload] Remove unused client object from routine load (#9223) 2022-04-29 10:40:07 +08:00
d330bc3806 [Vectorized](stream-load-vec) Support stream load in vectorized engine (#8709) (#9280)
Implement vectorized stream load.
Added fe configuration option `enable_vectorized_load` to enable vectorized stream load.

    Co-authored-by: tengjp@outlook.com
    Co-authored-by: mrhhsg@gmail.com
    Co-authored-by: minghong.zhou@163.com
    Co-authored-by: HappenLee <happenlee@hotmail.com>
    Co-authored-by: zhoubintao <35688959+zbtzbtzbt@users.noreply.github.com>
2022-04-29 09:50:51 +08:00
74a482ca7f [fix] fix docs build bug (#9293)
After this PR #9272, the `docs/build_help_zip.sh` will run failed.
This PR fix this issue.
But the help module still has some parse problem, I will fix it in next PR.

This CL mainly changes:
1. fix `docs/build_help_zip.sh` error
2. remove `sql-reference-v2` to `sql-reference`
3. modify build extension github action to run `docs/build_help_zip.sh`
2022-04-28 22:19:04 +08:00
48222f1fb0 [fix](storage)bloom filter support ColumnDict (#9167)
bloom filter support ColumnDict(#9167)
2022-04-28 20:03:26 +08:00