Commit Graph

159 Commits

Author SHA1 Message Date
49a17bea99 [regression]add the cases for csv/orc/parquet file format (#11082)
Co-authored-by: hucheng01 <hucheng01@baidu.com>
2022-07-22 20:54:34 +08:00
3744321f01 [feature-wip](array-type) add function array_union/array_except/array_intersect (#10781)
Add array_union/array_except/array_intersect function.
2022-07-22 13:50:13 +08:00
4960043f5e [enhancement] Refactor to improve the usability of MemTracker (step2) (#10823) 2022-07-21 17:11:28 +08:00
5f6f35e886 Add the supported sub-type for array (#10824)
1.This pr is used for adding the supported sub-type for array which has been modified in #9916
2.add regression test for the supported sub-type

Co-authored-by: hucheng01 <hucheng01@baidu.com>
2022-07-21 16:29:17 +08:00
ae53a8a7e9 [regression] sf1DataPath can be url or local path (#11065) 2022-07-21 14:35:24 +08:00
b59ce73e1d fix the case fail when enable Hdfs (#11051) 2022-07-21 07:09:09 +08:00
b35d5bc15c [regressiontest] add tpcds_sf1 test (#10852) (#11042)
* [regressiontest] add tpcds_sf1 test (#10852)

Co-authored-by: smallhibiscus <844981280>
Co-authored-by: stephen <hello-stephen@qq.com>

* ignore q30 temporarily since it encounter latin character Ô

Co-authored-by: stephen <hello-stephen@qq.com>
2022-07-21 07:07:05 +08:00
b115b362fb [Bug] fix bug for function unix_timestamp (#11041)
* [Bug] fix bug for function `unix_timestamp`
2022-07-20 20:17:41 +08:00
b62e3e7aa0 [regression test]Add ssb sf1 test under unique table with zstd (#11004)
Co-authored-by: smallhibiscus <844981280>
2022-07-20 18:59:46 +08:00
Pxl
95366de7f6 cast array element to same type (#10980)
Fix problem when there are element of different types in an array.
2022-07-19 21:47:10 +08:00
d7770db5e2 Revert "[regressiontest] add tpcds_sf1 test (#10852)" (#11008)
This reverts commit d2bee602514e8238dd8ef3d3b9b34fb6171bd26f.
2022-07-19 18:41:53 +08:00
ac4ce4d874 Revert "[regression] Add ssb sf1 test under unique table with zstd (#10957)" (#10992)
This reverts commit 216a55c12c0be5c4090523195b2aff9d96c64f65.
2022-07-19 15:44:32 +08:00
d2bee60251 [regressiontest] add tpcds_sf1 test (#10852)
Co-authored-by: smallhibiscus <844981280>
Co-authored-by: stephen <hello-stephen@qq.com>
2022-07-19 08:30:53 +08:00
842ff2b1e2 [refactor] Refactor time LUT (#10982) 2022-07-19 08:23:29 +08:00
4c161b7e2c [regression-test] add tpch_sf1 test (#10846)
Co-authored-by: stephen <hello-stephen@qq.com>
2022-07-18 20:00:02 +08:00
b037aca4fd [improvement](dynamic-partition) add replication allocation check for dynamic partition when creating table(#10892) 2022-07-18 18:02:33 +08:00
ba04c983ae [regression-test]Add order by for qt_select1 in test_aggregate_all_functions (#10951) 2022-07-18 17:44:23 +08:00
216a55c12c [regression] Add ssb sf1 test under unique table with zstd (#10957)
* Add ssb sf1 test under unique table with zstd

Co-authored-by: smallhibiscus <844981280>
2022-07-18 16:35:14 +08:00
234e822b36 [Regression](Array) add more array test (#10770) 2022-07-18 15:27:13 +08:00
77ef19dbcd [BugFix](Array)Fix using Array aggregate function caused be coredump (#10649) 2022-07-18 13:47:17 +08:00
2d5aca18fb [feature-wip](array) add the array_sort function (#10598)
Co-authored-by: hucheng01 <hucheng01@baidu.com>
2022-07-18 10:52:42 +08:00
2b6cdcf599 [improvement] add an option to let regression stop when a failure happen (#10939)
For community pipeline, it is a waste of resource to run tests with errors.
2022-07-18 08:53:17 +08:00
50cb26d599 revert sc case (#10945)
schema change cases leads to failure of creating partition.
2022-07-17 21:45:23 +08:00
09d19e3f0f [feature-wip](array-type) explode support more sub types (#10673)
1. explode support more sub types;
2. explode support nullable elements;

Co-authored-by: cambyzju <zhuxiaoli01@baidu.com>
2022-07-17 18:08:30 +08:00
5793cb11d0 [feature-wip] (array-type) function concat_ws support array (#10749)
Issue #10052
function concat_ws support array
2022-07-17 17:50:39 +08:00
b5b6e1e12c [regression] add ssb flat sf 1 test (#10894) 2022-07-16 11:40:45 +08:00
2d5ea56a06 [regression] rm unwanted sleep (#10893) 2022-07-16 06:00:42 +08:00
7be2ef79ed array column support read by rowids (#10886)
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com>
2022-07-15 21:19:02 +08:00
401203da6a [feature](code-data) move cold data to object storage without losing any feature(FE) (#10693)
Co-authored-by:platonekosama@gmail.com
2022-07-15 18:00:48 +08:00
cc84cfcc0e [feature-wip](array-type) add function array_remove (#10385)
Description:

array_remove function remove all elements in array which is equal to the target.
2022-07-15 17:57:49 +08:00
1275aa905a fix sc regression test (#10879) 2022-07-15 17:53:11 +08:00
41f71f3ade [regression] add ssb sf1 test (#10831)
Co-authored-by: stephen <hello-stephen@qq.com>
2022-07-14 15:03:40 +08:00
4719d4705f [regression] update test framework and fix cases (#10686)
and regression test exclude suite test_create_table_with_bloom_filter temporarily.

Co-authored-by: stephen <hello-stephen@qq.com>
2022-07-13 10:16:16 +08:00
486cf0ebd4 [Feature] Lightweight schema change of add/drop column (#10136)
* [Schema Change] support fast add/drop column  (#49)

* [feature](schema-change) support fast schema change. coauthor: yixiutt

* [schema change] Using columns desc from fe to read data. coauthor: Lchangliang

* [feature](schema change) schema change optimize for add/drop columns.

1.add uniqueId field for class column.
2.schema change for add/drop columns directly update schema meta

Co-authored-by: yixiutt <yixiu@selectdb.com>
Co-authored-by: SWJTU-ZhangLei <1091517373@qq.com>

[Feature](schema change) fix write and add regression test (#69)

Co-authored-by: yixiutt <yixiu@selectdb.com>

[schema change] be ssupport that delete use newest schema

add delete regression test

fix regression case (#107)

tmp

[feature](schema change) light schema change exclude rollup and agg/uniq/dup key type.

[feature](schema change) fe olapTable maxUniqueId write in disk.

[feature](schema change) add rpc iface for sc add column.

[feature](schema change) add columnsDesc to TPushReq for ligtht sc.

resolve the deadlock when schema change (#124)

fix columns from fe don't has bitmap_index flag (#134)

add update/delete case

construct MATERIALIZED schema from origin schema when insert

fix not vectorized compaction coredump

use segment cache

choose newest schema by schema version when compaction (#182)

[bugfix](schema change) fix ligth schema change problem.

[feature](schema change) light schema change add alter job. (#1)

fix be ut

[bug] (schema change) unique drop key column should not light schema
change

[feature](schema change) add schema change regression-test.

fix regression test

[bugfix](schema change) fix multi alter clauses for light schema change. (#2)

[bugfix](schema change) fix multi clauses calculate column unique id (#3)

modify PushTask process (#217)

[Bugfix](schema change) fix jobId replay cause bdbje exception.

[bug](schema change) fix max col unique id repeatitive. (#232)

[optimize](schema change) modify pendingMaxColUniqueId generate rule.

fix compaction error
* fix be ut

* fix snapshot load core

fix unique_id error (#278)

[refact](fe) remove redundant code for light schema change. (#4)

[refact](fe) remove redundant code for light schema change. (#4)

format fe core

format be core

fix be ut

modify fe meta version

fix rebase error

flush schema into rowset_meta in old table

[refactor](schema change) refact fe light schema change. (#5)

delete the change of schemahash and support get max version schema

* modify for review

* fix be ut

* fix schema change test
2022-07-12 19:41:06 +08:00
eb079950cb [feature-wip] (array-type) add the array_distinct function (#10388)
* add the array_distinct function

* add the support for decimal and update variable names

* add docs and regression test for array_distinct function

Co-authored-by: hucheng01 <hucheng01@baidu.com>
2022-07-12 17:02:42 +08:00
27505773f5 add regression test for array functions inside WHERE condition (#10748)
Co-authored-by: cambyzju <zhuxiaoli01@baidu.com>
2022-07-11 22:18:48 +08:00
8472ea8324 Revert "[Enhancement] Add column prune support for VOlapScanNode (#10615)" (#10734) 2022-07-11 12:16:08 +08:00
a6e4c88663 [improve](planner): split output expr to multiple line. (#10710)
* [improve](planner): split output expr to multiple line.

+---------------------------------------------------+
| Explain String                                    |
+---------------------------------------------------+
| PLAN FRAGMENT 0                                   |
|   OUTPUT EXPRS:                                   |
|     <slot 9> `user_id`                            |
|     <slot 11> `default_cluster:test`.`tbl`.`date` |
|     <slot 10> `city`                              |
|     <slot 12> `default_cluster:test`.`tbl`.`age`  |
+---------------------------------------------------+

* *: fix UT and regression-test.
2022-07-10 11:35:48 +08:00
2b2bf017f8 [enhancement](regression-test) add real data path for regression test. (#10577)
in some situation, we need compare real result with
previous result for  analyzing.
2022-07-08 20:51:23 +08:00
e37d29485f [Enhancement] Add column prune support for VOlapScanNode (#10615) 2022-07-08 13:56:26 +08:00
fe8acdb268 [feature-wip](array-type) add agg function collect_list and collect_set (#10606)
add codes for collect_list and collect_set and update regression output, before output format for ARRAY(string) already changed.

Co-authored-by: cambyzju <zhuxiaoli01@baidu.com>
2022-07-08 12:48:46 +08:00
c583d3e27c [fix][vectorized] Fix bug of VInPredicate on date type (#10663) 2022-07-07 22:15:33 +08:00
8012d63ea0 [fix] substr('', 1, 5) return empty string instead of null (#10622) 2022-07-06 22:51:02 +08:00
43015f11a5 [Improvement] remove beHttpAddress in regression test (#10623) 2022-07-06 08:59:29 +08:00
9c990b073f [regression] modify compaction cases, not depend on beHttpAddress (#10553) 2022-07-04 22:36:12 +08:00
8b6c46cfd1 [fix] fix create table like when having sequence column (#10464) 2022-07-03 23:19:46 +08:00
ca0906626f [BUG] fix bitmap function bug (#10502)
* fix bitmap function bug

* add regression test
2022-07-01 15:30:16 +08:00
ec6620ae3e [feature-wip](array-type) add function arrays_overlap (#10233) 2022-06-30 08:12:29 +08:00
Pxl
2c35abe940 [bugfix]fix core dump on outfile with expr (#10491)
remove log
2022-06-29 20:38:49 +08:00
17eb8c00d3 [feature] add table valued function framework and numbers table valued function (#10214) 2022-06-28 14:01:57 +08:00