e77b98be88
[fix](months_diff) fix wrong result of months_diff ( #25577 )
2023-10-19 14:29:47 +08:00
3d1206d325
[date](fix) modify push-down predicate for datev1 type ( #25571 )
...
For comparison predicate, two arguments must be cast to datetime and push down to storage if either one is date type. This PR disables predicate push-down for this case.
2023-10-19 14:18:27 +08:00
ed713c2e2d
[FIX](func) fix count distinct do not support arr/map/struct ( #25483 )
2023-10-19 01:04:50 -05:00
b45f501e51
[improvement](nereids) Support aggregate functions without from clause ( #25500 )
...
Support aggregate functions in select without from clause, here are some examples as following:
SELECT 1,
'a',
COUNT(),
SUM(1) + 1,
AVG(2) / COUNT(),
MAX(3),
MIN(4),
RANK() OVER() AS w_rank,
DENSE_RANK() OVER() AS w_dense_rank,
ROW_NUMBER() OVER() AS w_row_number,
SUM(5) OVER() AS w_sum,
AVG(6) OVER() AS w_avg,
COUNT() OVER() AS w_count,
MAX(7) OVER() AS w_max,
MIN(8) OVER() AS w_min;
2023-10-18 23:07:37 -05:00
fcf7bdc9e0
[typo](docs) Rename Import Advanced to CN Version ( #25374 )
2023-10-19 10:18:30 +08:00
4752b800b2
[typo](doc)update config ( #25425 )
2023-10-19 10:02:31 +08:00
8d65a62705
[Fix](show-frontends-disk)Fix NPE and macOS compatibility ( #25565 )
2023-10-19 09:53:43 +08:00
63c89df474
[enhencement](RowsetWriter) Don't delete files when beta rowset writer destructed ( #25578 )
2023-10-19 09:37:04 +08:00
45178f5664
[improvement](disk balance) impr disk rebalancer sched with partition rebalancer ( #25549 )
2023-10-19 09:33:42 +08:00
5b814e6e65
[cases](regression-test) Add create and drop S3 repository test ( #25568 )
2023-10-18 22:16:31 +08:00
dbf5787682
[fix](be) Make DorisCallOnce's function exception-safe ( #25579 )
2023-10-18 22:13:30 +08:00
11fecafb74
[fix](move-memtable) fallback if target table contains inverted index ( #25498 )
2023-10-18 22:11:59 +08:00
32fc8a1799
[chore](compaction) Do not print the stack trace when the compaction task already exists ( #25597 )
2023-10-18 21:44:17 +08:00
c21eb315b0
[feature](thrift api) support expr in MemoryScratchSink and make arrow::Schema recalculate with block info ( #24603 )
2023-10-18 07:51:56 -05:00
2a442972a8
[Fix](merge-on-write) Fix some bugs about sequence column ( #24915 )
...
1. add checks and handling of sequence column in #21896 to insert statement in origin planner and Nereids planner.
2. disable drop sequence mapping column in schema change.
2023-10-18 20:40:12 +08:00
9c9fc84f39
[feature](merge-cloud) Abstract BaseTablet for CloudTablet ( #24929 )
2023-10-18 20:29:04 +08:00
46158a6555
[tpcds-tools](nereids) remove cascades specific control for global config ( #25595 )
...
remove sf100 cascades specific control for global config, which is only for q72
2023-10-18 06:47:19 -05:00
2ddd2e5079
[feature](Nereids) add map_agg function ( #25246 )
2023-10-18 06:44:36 -05:00
9e07291e65
[fix](stats) internal stats table tablet replica num not update as expected ( #25563 )
...
Before this PR, scale would not happen, since in the previous implementation relica count of all tablets was considered
2023-10-18 06:42:41 -05:00
ea97f2d6e5
[refactor](nereids)make enable_stats session var ( #25550 )
...
this pr is used to test plan shape without column stats
2023-10-18 18:13:15 +08:00
85e83b9c6c
[fix](auth)fix not check udf auth in nereids ( #25541 )
2023-10-18 16:22:36 +08:00
e4a83a22d1
[opt](error msg) Make data codec error clearly when load csv data can't display ( #25540 )
...
Co-authored-by: Tanya-W <tanya1218w@163,com>
2023-10-18 16:12:22 +08:00
80e5e72202
[fix](scanner) coredump caused by 'prune_predicates_by_zone_map' ( #25555 )
2023-10-18 16:11:41 +08:00
c77590414e
[fix](pipeline)fix case ( #25567 )
...
user in some case is repetitive
The order of backups may not be consistent
2023-10-18 03:03:40 -05:00
0533911275
[Enhance](regression)change external default docker list ( #25573 )
2023-10-18 02:56:10 -05:00
62d06584f1
[feature](fe) add function 'BitmapAgg' in nereids ( #25508 )
2023-10-18 14:24:27 +08:00
8a8e6edba9
[enhancement](stats) Unify sample algorithm between olap table and external table ( #25472 )
...
To reduce error of ndv estimation of olap table's column
2023-10-18 01:18:40 -05:00
0ec537edef
[fix](column-id) fix null conn ctx in column id flusher and parser for database field in corresponding show stmt ( #25393 )
2023-10-18 14:11:31 +08:00
76abbfc555
[fix](mvn source) fix audit compile java-cup and cup-maven-plugin not found ( #25564 )
2023-10-18 01:07:31 -05:00
db16a14970
[fix](backup) fix backup fail on s3 ( #25496 )
...
The s3 client properties are not passed to BE correctly.
The test cases will be added later
2023-10-18 13:52:12 +08:00
d2400d1d7b
[feature](profile) profilev2 distinguish Sink and Operator in pipelineX ( #25491 )
...
* update
* update
2023-10-18 13:12:29 +08:00
6cb947f72b
[refactor](unused code) delete unused method from field.h ( #25554 )
...
Co-authored-by: yiguolei <yiguolei@gmail.com >
2023-10-18 13:11:14 +08:00
64aeeb971b
[Fix](partial-update) Correct the alignment process when the table has sequence column and add cases ( #25346 )
...
This PR fix the alignment process during publish phase when conflict occurs during concurrent partial updates: if we encounter a row with the same key and larger value in sequence column, it means that there exists another load which introduces a row with the same keys and larger sequence column value published successfully after the commit phase of the current load. We should act as follows:
- If the columns we update include sequence column, we should delete the current row becase the partial update on the current row has been overwritten by the previous one with larger sequence column value.
- Otherwise, we should combine the values of the missing columns in the previous row and the values of the including columns in the current row into a new row.
2023-10-18 11:32:51 +08:00
ef9cbc4c64
[enhancement](priv) Clarify ccr releated FrontendServiceImpl call privs ( #25530 )
...
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com >
2023-10-18 10:51:55 +08:00
6f6264693f
[fix](Nereids) can't choosing best plan for join that could only broadcast ( #25511 )
...
we need ensure there is one request properties at least
2023-10-17 21:40:05 -05:00
b0e0a0569a
[Fix](row store) Real default value should be used instead of default… ( #25230 )
...
Before this PR the default value is not correct, we should use default value in Frontend schema.
2023-10-18 10:13:44 +08:00
5503d04be2
[fix](test) create table should with distribution info ( #25544 )
...
create table should with distribution info
2023-10-18 10:03:35 +08:00
3225495233
[regression-test](export) Add some tests that use hive external table to read orc/parquet file exported by doris ( #25431 )
...
add some regression test:
1. Export Doris data to the orc/parquet file on HDFS with DORIS.
2. Create external table to read orc/parquet files on hive.
2023-10-18 09:59:15 +08:00
7cfb1d9b0e
[Regression case](statistics) Add regression test case for fetching HMSExternalTable through hms. ( #25548 )
...
Regression case for fetching HMSExternalTable statistics through HMS when the table is not analyzed.
2023-10-18 09:57:58 +08:00
47689fd452
[refactor](jni) unified jni framework for java udf ( #25302 )
...
Use the unified jni framework to refactor java udf.
The unified jni framework takes VectorTable as the container to transform data between c++ and java, and hide the details of data format conversion.
In addition, the unified framework supports complex and nested types.
The performance of basic types remains consistent, with a 30% improvement in string types and an order of magnitude improvement in complex types.
2023-10-18 09:27:54 +08:00
26e332c608
[fix](multi-catalog)add exception for unsupported hive input format ( #25490 )
...
add exception for unsupported hive input format
2023-10-17 22:53:53 +08:00
b76e23fb34
[improvement](meta) allow to ignore unknown image module ( #25450 )
...
Add new FE config `ignore_unknown_metadata_module`. Default is false.
If set to true, when reading metadata image file, and there are unknown modules, these modules
will be ignored and skipped.
This is mainly used in downgrade operation, old version can be compatible with new version Image file.
2023-10-17 22:53:31 +08:00
18c2a13e09
[fix](multi-catalog)fix maxcompute partition filter and session creation ( #24911 )
...
add maxcompute partition support
fix maxcompute partition filter
modify maxcompute session create method
2023-10-17 22:36:10 +08:00
ce18f1148a
[improvement](catalog)compatible with paimon 0.5 ( #24985 )
...
compatible with paimon 0.5
add p0 for paimon,need set enablePaimonTest=true
2023-10-17 22:07:13 +08:00
f6f1e3b646
[chore](build) Bump the version of hyperscan ( #25464 )
...
The latest version fixed the previous issue (https://github.com/intel/hyperscan/issues/292 ).
2023-10-17 08:45:25 -05:00
d287f53d77
[fix](nereids)in physical plan, print join class simple name not full name #25515
2023-10-17 20:25:14 +08:00
9b1cdd3230
[fix](planner) mark join slot should always be nullable ( #25433 )
2023-10-17 06:14:13 -05:00
b74836050a
[chore](config) turnoff fuzzy for enable_simdjson_reader ( #25521 )
2023-10-17 18:42:11 +08:00
8eff1486bd
[feature](nereids)print query id with memo and physical tree ( #25501 )
...
print query id with memo and physical tree when dump_nereids_memo switched on. This is used for regression test.
2023-10-17 05:06:11 -05:00
9d6b2dceb2
[fix](Nereids) non-slot filter should not be push through aggregate ( #25525 )
2023-10-17 05:02:26 -05:00
