Commit Graph

4342 Commits

Author SHA1 Message Date
ca4f4d199e [Feature][regression-test]CSV import and export support header (#8487) (#9017)
* [Feature][regression-test]CSV import and export support header (#8487)
1.Add two new types to stream load boker load: csv_with_names and csv_with_name_sand_types
2.Add two new types to export: csv_with_names and csv_with_names_and_types
2022-04-15 13:44:36 +08:00
419ec3b96c [Fix Bug] Fix ehco command not found (#9021) 2022-04-15 13:43:47 +08:00
Pxl
f7a5ff4f1d [Enhancement] [Storage Vectorize] optimize BitmapRangeIterator.next_range() (#9013) 2022-04-15 11:27:03 +08:00
Pxl
90cf8ddf25 [Enhancement][Regression-Test] enhancement for regression-test framework (#8930) 2022-04-15 11:26:45 +08:00
0fa917703e [Bug] Fix some node in vectorized not have V title (#9028)
Co-authored-by: lihaopeng <lihaopeng@baidu.com>
2022-04-15 11:25:52 +08:00
579aee110a [fix](ut)(compile) Fix BE compile bug and FE unit test (#9027)
1. The compile bug is introduced from #8855
2. FE ut bug is introduced from #8848 and #8770
2022-04-14 17:37:41 +08:00
9ac6d23a44 [Feature]support stddev/variance agg functions to window function (#8962) 2022-04-14 12:07:26 +08:00
5e95d99925 [fix](load) fix bug of infinite loop in orc scanner (#9007)
When encounter unqualified data, orc scanner may not be able
to quit correctly.
2022-04-14 11:46:48 +08:00
48c288af94 [refactor](fe) modify warning message of drop backends (#9006)
Modify warning message of drop backends
2022-04-14 11:46:29 +08:00
d916ba8352 [fix](tools) Access denied when creating tpch tables (#9003) 2022-04-14 11:45:53 +08:00
Pxl
d161161767 [refactor](script) remove unused parament on run-be-ut.sh (#9000)
parament -v is not work on run-be-ut.sh now.
2022-04-14 11:45:35 +08:00
91200cc7a6 [fix] fix NPE when initialize GlobalState (#8990)
Introduced from #8695
The context object may be null for StreamLoadPlanner
2022-04-14 11:44:41 +08:00
18daefff80 [refactor](fe): remove unused code (#8986) 2022-04-14 11:44:21 +08:00
e5e0dc421d [refactor] Change ALL OLAPStatus to Status (#8855)
Currently, there are 2 status code in BE, one is common/Status.h,
and the other is olap/olap_define.h called OLAPStatus.
OLAPStatus is just an enum type, it is very simple and could not save many informations,
I will unify these code to common/Status.
2022-04-14 11:43:49 +08:00
8765881d8b [fix](load) wait _send_batch_thread_pool_token rather than shutdown. (#8970)
We can not shutdown _send_batch_thread_pool_token, because _packet_in_flight
has to be clear finally. Otherwise a never ended join on rpc would happen.

It is difficult to handle concurrent problem if a flag setter is not guaranteed to run.
2022-04-14 10:05:14 +08:00
f781669932 [typo](doc) Fix the broken link in the CONTRIBUTING.md (#8876) 2022-04-14 10:04:32 +08:00
a1982c4391 [improvement] Use System.currentTimeMillis() to get the current millisecond (#8828) 2022-04-14 10:03:37 +08:00
4cfb372387 [refactor][Doc] Database admin sql help (#9009)
* Add SQL function Chinese documentation

Add SQL function Chinese documentation

* Add database management SQL help documentation

Add database management SQL help documentation
2022-04-14 09:02:33 +08:00
d90418fff2 Add SQL function Chinese documentation (#8995)
[Refactor][Doc] Add SQL function Chinese documentation
2022-04-14 09:02:09 +08:00
943b08bcdf fix master compile error (#8992)
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com>
2022-04-13 11:23:37 +08:00
c872793a23 remove rowset converter since it is useless (#8974)
Co-authored-by: yiguolei <yiguolei@gmail.com>
2022-04-13 10:40:12 +08:00
5881e8fdc6 [refactor] use c++ 14 deprecated instaed of comment, this detect usage of deprecated var or func at compile time (#8439) 2022-04-13 10:19:04 +08:00
290366787c [refactor] refactor code, replace some file with stl libs (#8759)
1. replace ConditionVariables with std::condition_variable
2. repalace Mutex with std::mutex
3. repalce MonoTime with std::chrono
2022-04-13 09:55:29 +08:00
4734c4c326 Add SQL manual, account management documentation (#8809)
Add SQL manual, account management documentation
2022-04-13 09:52:18 +08:00
bca121333e [feature](cold-hot) support s3 resource (#8808)
Add cold hot support in FE meta, support alter resource DDL in FE
2022-04-13 09:52:03 +08:00
Pxl
64cf64d1f8 remove unused code and opt int_div (#8966) 2022-04-13 09:51:01 +08:00
7e08d3e320 Modify the maximum and minimum number of threads in jetty (#8960)
Co-authored-by: smallhibiscus <844981280>
2022-04-13 09:50:46 +08:00
d79e8a7b5a [fix](load) start transaction before we need it (#8819) (#8908) 2022-04-13 09:50:26 +08:00
4462da742f [Refactor][Doc] add show help doc (#8912) 2022-04-13 09:49:21 +08:00
d11698d2de [Refactor][doc] add data model and index doc (#8916) 2022-04-13 09:49:02 +08:00
5f9b241999 [Refactor][doc] Modify the documentation of alter, backup and restore in DDL (#8957) 2022-04-13 09:48:39 +08:00
767000b3f9 [Refactor][doc] add doc for auth management and conf (#8951) 2022-04-13 09:48:17 +08:00
52d18aa83c permute impl for column array; and codes format (#8949)
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com>
2022-04-13 09:47:54 +08:00
59abd65bfc add dml load sql help (#8939)
add dml load sql help
2022-04-13 09:47:30 +08:00
3b8ca4b035 add cluster admin help (#8924)
add cluster admin help
2022-04-13 09:47:12 +08:00
b33ab960a8 [fix] move new add enum OFS of StorageType to last (#8983)
* [fix] move new add enum OFS of StorageType to last

* modify enum in gensrc/thrift/Types.thrift
2022-04-12 20:21:15 +08:00
0c8ea8ce9f [Vectorizd] Let VAssertRowNumNode handle return value of child->get_next (#8969) 2022-04-12 19:56:03 +08:00
6af1c52e13 [Feature] add support for tencent chdfs (#8963)
Co-authored-by: chengwu <chengwu@tencent.com>
2022-04-12 16:02:42 +08:00
51269efbb7 [improvement]Disable mini load (#8955)
Disable miniload by default
2022-04-12 16:01:03 +08:00
5a44eeaf62 [refactor] Unify all unit tests into one binary file (#8958)
1. solved the previous delayed unit test file size is too large (1.7G+) and the unit test link time is too long problem problems
2. Unify all unit tests into one file to significantly reduce unit test execution time to less than 3 mins
3. temporarily disable stream_load_test.cpp, metrics_action_test.cpp, load_channel_mgr_test.cpp because it will re-implement part of the code and affect other tests
2022-04-12 15:30:40 +08:00
66d2f4e1fd [fix][mem tracker] Fix MemTracker null pointer in vectorized (#8925)
Fix ThreadMemTrackerMgr::update_tracker null pointer and some details.

Issue Number: close #8920
2022-04-12 10:17:10 +08:00
f992247779 [docs] update alter table doc (#8915) 2022-04-12 09:26:40 +08:00
7494a4cbdf DML help doc (#8953)
DML help doc
2022-04-12 08:45:16 +08:00
81495b0ff1 [docs]correct spelling of the word 'LABEL' #3265 (#8956) 2022-04-12 08:44:33 +08:00
667eac9b7d Utility-Statements SQL Help (#8952)
Utility-Statements SQL Help
2022-04-12 08:44:16 +08:00
067309c466 [fix](compile) fix compilation bug (#8950) 2022-04-11 13:12:34 +08:00
0b1b3e225d Revert "[Thirdparty]Add llvm for codegen (#8938)" (#8948)
This reverts commit 32133621c69a2d7544549c5ea54ed6d9de60415e.

Reverts #8938
The LLVM requires GLIBC_2.15. I decided to create a branch for the llvm feature first.
And once we resolve the low version glibc issue, it will be merged back to master.
2022-04-11 13:03:16 +08:00
Pxl
8a066e2586 [fix](vectorized) core dump on ST_AsText (#8870) 2022-04-11 09:39:32 +08:00
8158b05ea0 [fix] Fix bug that tablet data size and row num info are failed to report. (#8945)
Introduced from #8146
2022-04-11 09:38:28 +08:00
fd054ca2f6 [doc](java-udf) add docs for Java UDF (#8944) 2022-04-11 09:37:48 +08:00