Commit Graph

16966 Commits

Author SHA1 Message Date
b0d2ecbf52 [Improve](Tablet Schema) Use deterministic way to serialize protobuf (#101) (#30906) 2024-02-18 11:50:17 +08:00
f9e16e08eb [fix](script) Fix start_fe.sh --image path check image not work (#30695) 2024-02-18 11:50:17 +08:00
b5012dc55a [Enhancement](group commit) optimize pre allocated calculation (#30893) 2024-02-18 11:50:17 +08:00
1d596018c8 [enhance](iceberg)upgrade iceberg to 1.4.3 (#30799) 2024-02-18 11:50:17 +08:00
5417bb4db0 [Enhancement](auto-inc) Show create table support auto inc init value (#31021) 2024-02-18 11:50:16 +08:00
ea4ad111a8 [fix](dynamic partition) fix create too many dynamic partitions (#30994) 2024-02-18 11:50:16 +08:00
cc727cfc32 [refactor](catalog) move some package related to catalog (#31022)
Move some package and files related to multi-catalog.
No logic is changed.
2024-02-18 11:50:16 +08:00
fc53c7210b [fix](chmod) change chmod to filesystem::permission to avoid race condition (#31032) 2024-02-18 11:50:16 +08:00
45b4189bb6 [Refactor](opt) Opt rf and remove unless code (#30900)
Opt rf and remove unless code
2024-02-18 11:50:16 +08:00
acdc9575ad [fix](function) incorrect result of 'equal_for_null' (#30990) 2024-02-18 11:50:16 +08:00
37d64389b9 [Improve](Job)Return directly when the job status does not need to change (#31028) 2024-02-18 11:50:16 +08:00
0d4b8386a2 [bugfix][be][cppcheck] Possible NULL pointer access (#31025) (#31026) 2024-02-16 10:16:40 +08:00
e68019c10a [Function](Exec) Support windows function cume_dist (#30997) 2024-02-16 10:16:40 +08:00
f65844fae4 [Enhencement](Outfile/Export) Export data to csv file format with BOM (#30533)
The UTF8 format of the Windows system has BOM. 

We add a new user property to `Outfile/Export`。Therefore, when exporting Doris data, users can choose whether to bring BOM on the beginning of the CSV file.

**Usage:**
```sql
-- outfile:
select * from demo.student
into outfile "file:///xxx/export/exp_"
format as csv
properties(
    "column_separator" = ",",
    "with_bom" = "true"
);

-- Export:
EXPORT TABLE student TO "file:///xx/tmpdata/export/exp_"
PROPERTIES(
    "format" = "csv",
    "with_bom" = "true"
);
```
2024-02-16 10:16:40 +08:00
ce892d04e5 [feature](index) Replace BITMAP INDEX with INVERTED INDEX (#30950) 2024-02-16 10:16:40 +08:00
eaaab33f0a [Fix](Top-N opt) evicting quering rowsets in prior to correct use_count (#102) (#30904)
This addresses the scenario where a rowset cannot be removed.
2024-02-16 10:16:40 +08:00
2573150f6d [refactor](runtime filter) do not wait runtime filter rpc finished when hash node or pipeline finished (#30970)
Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-02-16 10:16:40 +08:00
49cec39038 [test](mtmv) Add materialized view which contain external table rewrite test (#30975) 2024-02-16 10:16:39 +08:00
24e80b23a5 [Feature](executor)Support ShowProcessStmt Show all Fe connection (#30907) 2024-02-16 10:16:39 +08:00
7f50998406 fix compile 2024-02-16 10:12:25 +08:00
40e1326bc9 [feature](window-func) support percent_rank window function (#30926) 2024-02-16 10:12:25 +08:00
5cfd7c2a1c [improvement](memtracker) should counter memory usage to query when exchange sink buffer rpc (#30964)
* [improvement](memtracker) should counter memory usage to query when rpc callback

* f

---------

Co-authored-by: yiguolei <yiguolei@gmail.com>
2024-02-16 10:12:25 +08:00
448fb70f68 [fix](nereids) collect all correlated slots from subquery in correct way (#30908) 2024-02-16 10:12:25 +08:00
d60ecdba6f [fix](regex) fix wrong escape of function LIKE (#30557)
fix wrong escape of function LIKE
2024-02-16 10:12:25 +08:00
927dd8a246 [fix](Docs) fix dev-prepare doc #30923 2024-02-16 10:12:25 +08:00
cef31f6709 [feat](fe) Show db total size and recycle bin size with ShowDataStmt (#30663) 2024-02-16 10:12:25 +08:00
3e07167897 [enhancement](mysql-channel) avoid potential buffer overflow when flushing send buffer occurs IOE (#30868) 2024-02-16 10:12:25 +08:00
08c196f3dc [enhancement](stmt-forward) record query result for proxy query to avoid EOF (#30536) 2024-02-16 10:12:25 +08:00
ff82e2ab59 [improvement](group_commit) Add bvar to monitor the count of replaying wal fail on group commit (#30941) 2024-02-16 10:12:24 +08:00
bbbe3e666a [improvement](group_commit) Rename fail wal to tmp should only use in test P0 scenario (#30959) 2024-02-16 10:12:24 +08:00
b0835b4336 [fix](test) Increase the timeout duration for the test case (#30952) 2024-02-16 10:12:24 +08:00
ad715ab977 [feature](StoragePolicy) Add one http action to add storage policy back (#30879) 2024-02-16 10:12:24 +08:00
ac756075bb Alter workload group queue prop sync for regression test (#30869) 2024-02-16 10:12:24 +08:00
6596f95400 [test](mtmv) Add mtmv increment create case (#30751) 2024-02-16 10:12:24 +08:00
5e6e2f8061 [fix](nereids)should not infer predicate for nullaware anti-join (#30924) 2024-02-16 10:12:24 +08:00
e8f614791e [fix](pipeline) Set the flag of short circuit only when hash join sink finished (#30977) 2024-02-16 10:12:24 +08:00
1437348040 [fix](group_commit) Wal file should be removed from _wal_path_map when renaming it to tmp directory (#30974) 2024-02-16 10:12:24 +08:00
02c37b8ead opt the rf code and remove rf unless code (#30861) 2024-02-16 10:12:24 +08:00
041db03c94 [fix](gc) fix a core introduced by #30854 (#30932)
introduced by #30854, if it is the end of the map _unused_rowsets, program will core.
2024-02-16 10:12:24 +08:00
a1bf00e5ea [fix](nereids)aggregate function cannot contain aggregate parameters (#30928) 2024-02-16 10:12:24 +08:00
c72f634c10 [enhancement](schema change) some types changes (#30919) 2024-02-16 10:12:24 +08:00
7571ecc42f [fix](group_commit)Add bounds checking when reading wal file on group commit (#30940) 2024-02-16 10:12:24 +08:00
abbd1c7ede disable OR predicate for bitmap index (#30951)
There is some problem for OR predicate push down using bitmap index, so disable it.
2024-02-16 10:12:24 +08:00
22cc8342d4 [Enhancement](wal) Optimize group commit manager log (#30849) 2024-02-16 10:12:24 +08:00
36d753eacb [opt](ES catalog) Increase to 3 connect attempts per node (#30957) 2024-02-16 10:12:24 +08:00
5bb8a72626 [fix](group_commit) Fix write column id twice problem on wal file (#30935) 2024-02-16 10:12:24 +08:00
366a6792bf [refactor](scanner) refactoring and optimizing scanner scheduling (#30746) 2024-02-16 10:12:24 +08:00
16cdab816a [refactor](move-memtable) remove phmap and use shared ptr in delta writer v2 (#30949)
* [refactor](move-memtable) remove phmap and use shared ptr in delta writer v2 pool

* ENABLE_FACTORY_CREATOR DeltaWriterV2
2024-02-16 10:12:24 +08:00
de1724ab6a [case](mtmv) MTMV hive case (#30930) 2024-02-16 10:12:24 +08:00
1d10132aa1 [fix](Nereids) should distribute first when do sort enforce on must shuffle (#30948) 2024-02-16 10:12:24 +08:00