database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
10,608 Commits 1 Branch 0 Tags
92c6a3c53bd7b63e5fcfdccabaccee36347aae1a
Commit Graph

400 Commits

Author SHA1 Message Date
yongjinhou
40ab4ce305 fix select resource groups bug (#19808) 2023-05-18 21:54:31 +08:00
Kang
294599ee45 [feature](jsonb) rename JSONB type name and function name to JSON (#19774) 
To be more compatible with MySQL, rename JSONB type name and function name to JSON.

The old JSONB type name and jsonb_xx function can still be used for backward compatibility.

There is a function jsonb_extract remained since json_extract is used by json string function and more work need to change it. It will be changed further.
 2023-05-18 16:16:52 +08:00
amory
51a12f4f11 [Doc](map-type) add map sql doc (#19612) 2023-05-18 09:09:41 +08:00
lsy3993
7f9cdc41f5 [typo](docs)add new describe for grant (#19656) 2023-05-18 09:00:39 +08:00
caoliang-web
35ad081784 [typo](doc)Example of adding stream load import to current time (#19760) 2023-05-18 08:36:39 +08:00
xueweizhang
97d4778ecf [enhancement](schema) dynamic_partition.time_unit support year (#19551) 
dynamic_partition.time_unit support year
 2023-05-17 23:49:15 +08:00
luozenglin
60d5c82f44 [fix](tvf) fix the inconsistency between tvf backends function and show backends result (#19697) 2023-05-17 22:55:46 +08:00
Mingyu Chen
2536b57590 [doc](catalog) optimize catalog doc (#19601) 2023-05-17 21:45:08 +08:00
abmdocrt
3a7bc3a7a8 [doc](retention) optimize retention doc (#19692) 2023-05-17 08:17:45 +08:00
xy720
0d11c4207a [docs](struct-type) add docs for struct and named_struct function (#19700) 2023-05-17 08:16:33 +08:00
xy720
12c21287a5 [docs](struct-type) Add docs for struct type (#19694) 2023-05-16 19:13:27 +08:00
Ziyu Wang
325a1d4b28 [vectorized](function) support array_count function (#18557) 
support array_count function.
array_count：Returns the number of non-zero and non-null elements in the given array.
 2023-05-16 17:00:01 +08:00
Weijie Guo
9535ed01aa [feature](tvf) Support compress file for tvf hdfs() and s3() (#19530) 
We can support this by add a new properties for tvf, like :

`select * from hdfs("uri" = "xxx", ..., "compress_type" = "lz4", ...)`

User can:

Specify compression explicitly by setting `"compression" = "xxx"`.
Doris can infer the compression type by the suffix of file name(e.g. `file1.gz`)
Currently, we only support reading compress file in `csv` format, and on BE side, we already support.
All need to do is to analyze the `"compress_type"` on FE side and pass it to BE.
 2023-05-16 08:50:43 +08:00
Liqf
c87e78dc35 [bug](jsonb) fix jsonb query bug When the json key value contains "." (#19185) 
Issue Number: close #19173

mysql> SELECT jsonb_extract('{"a.b.c":{"k1":"v31", "k2.a1": 300},"a":"opentelemetry"}', '$."a.b.c".k1');
+-------------------------------------------------------------------------------------------+
| jsonb_extract('{"a.b.c":{"k1":"v31", "k2.a1": 300},"a":"opentelemetry"}', '$."a.b.c".k1') |
+-------------------------------------------------------------------------------------------+
| "v31" |
+-------------------------------------------------------------------------------------------+
1 row in set (0.06 sec)
 2023-05-15 15:43:12 +08:00
Zhengguo Yang
6748ae4a57 [Feature] Collect the information statistics of the query hit (#18805) 
1. Show the query hit statistics for `baseall`

   ```sql
    MySQL [test_query_db]> show query stats from baseall;
    +-------+------------+-------------+
    | Field | QueryCount | FilterCount |
    +-------+------------+-------------+
    | k0    | 0          | 0           |
    | k1    | 0          | 0           |
    | k2    | 0          | 0           |
    | k3    | 0          | 0           |
    | k4    | 0          | 0           |
    | k5    | 0          | 0           |
    | k6    | 0          | 0           |
    | k10   | 0          | 0           |
    | k11   | 0          | 0           |
    | k7    | 0          | 0           |
    | k8    | 0          | 0           |
    | k9    | 0          | 0           |
    | k12   | 0          | 0           |
    | k13   | 0          | 0           |
    +-------+------------+-------------+
    14 rows in set (0.002 sec)

    MySQL [test_query_db]> select k0, k1,k2, sum(k3) from baseall  where k9 > 1 group by k0,k1,k2;
    +------+------+--------+-------------+
    | k0   | k1   | k2     | sum(`k3`)   |
    +------+------+--------+-------------+
    |    0 |    6 |  32767 |        3021 |
    |    1 |   12 |  32767 | -2147483647 |
    |    0 |    3 |   1989 |        1002 |
    |    0 |    7 | -32767 |        1002 |
    |    1 |    8 |    255 |  2147483647 |
    |    1 |    9 |   1991 | -2147483647 |
    |    1 |   11 |   1989 |       25699 |
    |    1 |   13 | -32767 |  2147483647 |
    |    1 |   14 |    255 |         103 |
    |    0 |    1 |   1989 |        1001 |
    |    0 |    2 |   1986 |        1001 |
    |    1 |   15 |   1992 |        3021 |
    +------+------+--------+-------------+
    12 rows in set (0.050 sec)

    MySQL [test_query_db]> show query stats from baseall;
    +-------+------------+-------------+
    | Field | QueryCount | FilterCount |
    +-------+------------+-------------+
    | k0    | 1          | 0           |
    | k1    | 1          | 0           |
    | k2    | 1          | 0           |
    | k3    | 1          | 0           |
    | k4    | 0          | 0           |
    | k5    | 0          | 0           |
    | k6    | 0          | 0           |
    | k10   | 0          | 0           |
    | k11   | 0          | 0           |
    | k7    | 0          | 0           |
    | k8    | 0          | 0           |
    | k9    | 1          | 1           |
    | k12   | 0          | 0           |
    | k13   | 0          | 0           |
    +-------+------------+-------------+
    14 rows in set (0.001 sec)
   ```

2. Show the query hit statistics summary for all the mv in a table

   ```sql
   MySQL [test_query_db]> show query stats from baseall all;
    +-----------+------------+
    | IndexName | QueryCount |
    +-----------+------------+
    | baseall   | 1          |
    +-----------+------------+
    1 row in set (0.005 sec)
   ```

3. Show the query hit statistics detail info for all the mv in a table

   ```sql
    MySQL [test_query_db]> show query stats from baseall all verbose;
    +-----------+-------+------------+-------------+
    | IndexName | Field | QueryCount | FilterCount |
    +-----------+-------+------------+-------------+
    | baseall   | k0    | 1          | 0           |
    |           | k1    | 1          | 0           |
    |           | k2    | 1          | 0           |
    |           | k3    | 1          | 0           |
    |           | k4    | 0          | 0           |
    |           | k5    | 0          | 0           |
    |           | k6    | 0          | 0           |
    |           | k10   | 0          | 0           |
    |           | k11   | 0          | 0           |
    |           | k7    | 0          | 0           |
    |           | k8    | 0          | 0           |
    |           | k9    | 1          | 1           |
    |           | k12   | 0          | 0           |
    |           | k13   | 0          | 0           |
    +-----------+-------+------------+-------------+
    14 rows in set (0.017 sec)
   ```

4. Show the query hit for a database

   ```sql
    MySQL [test_query_db]> show query stats for test_query_db;
    +----------------------------+------------+
    | TableName                  | QueryCount |
    +----------------------------+------------+
    | compaction_tbl             | 0          |
    | bigtable                   | 0          |
    | empty                      | 0          |
    | tempbaseall                | 0          |
    | test                       | 0          |
    | test_data_type             | 0          |
    | test_string_function_field | 0          |
    | baseall                    | 1          |
    | nullable                   | 0          |
    +----------------------------+------------+
    9 rows in set (0.005 sec)
   ```

5. Show query hit statistics for all the databases

   ```sql
    MySQL [(none)]> show query stats;
    +-----------------+------------+
    | Database        | QueryCount |
    +-----------------+------------+
    | test_query_db   | 1          |
    +-----------------+------------+
    1 rows in set (0.005 sec)
   ```
 2023-05-15 10:56:34 +08:00
Hong Liu
80886af828 [doc](grant)add the version for grant for user; (#19556) 2023-05-14 23:52:18 +08:00
slothever
cd9d633c1b [doc](multi-catalog)add properties converter docs (#18287) 
update doc for #18005
 2023-05-12 21:03:30 +08:00
zzzzzzzs
feef5afa0b [typo](doc) Fixed typos in SHOW-ROUTINE-LOAD.md (#19573) 2023-05-12 14:37:28 +08:00
lsy3993
e8f1ce4eaa [typo](docs) fix doc bug of 'collect_list' and 'deploy' (#19531) 2023-05-11 16:53:29 +08:00
herry2038
834bf2eab7 [feature](array) Add array_last lambda function (#18388) 
Add array_last lambda function
 2023-05-11 13:15:54 +08:00
Yulei-Yang
41d4ed8367 [Improvement](multicatalog) support show_partitions for hms catalog (#19242) 
* [Improvement](multicatalog) support show_partitions for hms catalog

* update according review advice
 2023-05-11 01:17:23 +08:00
yagagagaga
b11e937778 [typo](docs) fix the wrong description about cte with (#19403) 2023-05-08 22:59:34 +08:00
ZashJie
e5a6b002a3 fixed (#19329) 2023-05-08 14:24:40 +08:00
Tiewei Fang
e78149cb65 [Enhencement](Export) add property for outfile/export and add test (#18997) 
This pr does three things:
1. add `delete_existing_files` property for outfile/export. If `delete_existing_files = true`, export/outfile will delete all files under file_path first.
2. add p2 test for export
3. modify docs
 2023-05-08 14:02:20 +08:00
Yulei-Yang
ff6e0d3943 [Improvement](meta) support return no partition info for show_create_table (#19030) 
Some tables have a mount of partitions, when use show create table stmt on them,
you will get so many lines of result that a whole screen cannot  show them all, even if you scroll up to the top.

show create table table2;
| table2 | CREATE TABLE `table2` (
  `k1` int(11) NULL COMMENT 'test column k1',
  `k2` int(11) NULL COMMENT 'test column k2'
) ENGINE=OLAP                                        
DUPLICATE KEY(`k1`, `k2`)
COMMENT 'test table1'          
PARTITION BY RANGE(`k1`)           
(PARTITION p01 VALUES [("-2147483648"), ("10")),
PARTITION p02 VALUES [("10"), ("100"))) 
 DISTRIBUTED BY HASH(`k1`) BUCKETS 1
PROPERTIES (                                                                                                                        
"replication_allocation" = "tag.location.default: 1",
"storage_format" = "V2",
"light_schema_change" = "true",
"disable_auto_compaction" = "false"
);


show brief create table table2;
| table2 | CREATE TABLE `table2` (  `k1` int(11) NULL COMMENT 'test column k1',
  `k2` int(11) NULL COMMENT 'test column k2'
) ENGINE=OLAP
DUPLICATE KEY(`k1`, `k2`)
COMMENT 'test table1'
DISTRIBUTED BY HASH(`k1`) BUCKETS 1
PROPERTIES (
"replication_allocation" = "tag.location.default: 1",
"storage_format" = "V2",
"light_schema_change" = "true",
"disable_auto_compaction" = "false"
); |
 2023-05-06 14:45:08 +08:00
Liqf
525ede54cb [doc](fix)fix array_map doc tag wrong #19249 2023-05-05 12:44:46 +08:00
lsy3993
44d95aa3d9 [typo](docs)add new attention of str_to_date function (#19264) 2023-05-05 09:40:06 +08:00
WenYao
5e9c0c3500 [Enhancement](data-type) add FE config to prohibit create date and decimalv2 type (#19077) 
* prohibits date and decimal type

* add config in test
 2023-04-28 11:31:51 +08:00
Tiewei Fang
86be6d27e7 [Enhencement](Cancel Export) Cancel export support to cancel IN_QUEUE state export job (#19058) 2023-04-28 09:27:23 +08:00
gnehil
745f29f557 [typo](doc) add version label (#19148) 2023-04-27 23:22:24 +08:00
jiugem
e0ca4e061b Update CHAR.md (#19156) 2023-04-27 23:21:26 +08:00
yagagagaga
72799622e1 [typo](docs) Supplementary explanation on the hint section of insertSupplementary explanation on the hint section of INSERT.md (#19171) 2023-04-27 23:21:01 +08:00
yongkang.zhong
f3f0496b99 [feature](multi-catalog) support oceanbase jdbc catalog and jdbc external table (#18943) 
* [feature](multi-catalog) support oceanbase jdbc catalog and jdbc external table
 2023-04-27 17:14:48 +08:00
yongkang.zhong
2727ad14cd [typo](docs)Optimize the query acceleration directory structure (#19113) 2023-04-27 14:08:48 +08:00
brody715
20395ce501 [feature](array_function): add support for array_cum_sum function (#18231) 2023-04-27 09:57:13 +08:00
wudi
ca19b972cc [doc](update-key)add update key doc (#18899) 2023-04-26 13:41:14 +08:00
Liqf
5a7a96f317 [doc](fix)fix doc link error (#19083) 2023-04-26 12:33:13 +08:00
Mingyu Chen
9c25b514f5 [fix](doc) fix jsonb_extract doc (#19059) 
This will cause FE start fail

1. docs under sql-manual need strict format.
2. Change the rule of github checks, to run FE ut if docs under sql-manual is changed
 2023-04-25 20:01:51 +08:00
yagagagaga
41fbe711b0 [typo][samples](docs)(java) add read bitmap sample and update document. (#19005) 2023-04-25 19:07:51 +08:00
ZhangYu0123
7c9e6e6ad5 [typo](docs) format function Syntax desc (#19019) 2023-04-25 13:31:32 +08:00
luozenglin
4ef43f5374 [improvement](docs) Add sync statement docs (#18972) 2023-04-25 10:35:20 +08:00
yongkang.zhong
bf75e74065 [typo](docs) add oceanbase jdbc catalog doc (#18994) 
* [typo](docs) add oceanbase jdbc catalog doc

* fix
 2023-04-25 08:50:31 +08:00
Mellorsssss
ab2a6864bc [function](json) Json unquote (#18037) 2023-04-24 10:33:29 +08:00
zzzzzzzs
b4282641c1 [typo](doc) Fixed typos in ADMIN-SHOW-CONFIG.md (#18969) 
* [typo](doc) Fixed typos in ADMIN-SHOW-CONFIG.md

* Update ADMIN-SHOW-CONFIG.md
 2023-04-24 08:29:55 +08:00
Hong Liu
bc379eebed [doc](show-rollup)delete SHOW-ROLLUP doc. (#18924) 
Co-authored-by: smallhibiscus <844981280>
 2023-04-22 23:39:24 +08:00
zzzzzzzs
a49311b48e [typo](doc) Fixed typos in DROP-CATALOG.md (#18909) 2023-04-22 08:39:42 +08:00
TengJianPing
b75f4c97f3 [function](string) support char function (#18878) 
* [function](string) support char function

* fix
 2023-04-22 08:36:48 +08:00
AlexYue
d56fed345e [chore](doc) fix mv doc typo and cold heat separation (#18892) 2023-04-21 22:30:56 +08:00
xueweizhang
f7651d8dfb (fix)[olap] not support in_memory=true now (#18731) 
* (fix)[olap] can not set in_memory=true now

---------

Signed-off-by: nextdreamblue <zxw520blue1@163.com>
 2023-04-21 21:55:37 +08:00
xu tao
dba27a67bc [typo](docs) fix docs SHOW-COLUMNS.md (#18875) 2023-04-21 15:58:29 +08:00