Commit Graph

2340 Commits

Author SHA1 Message Date
a389a51a61 [typo](docs)clearly describe the rename syntax (#20335) 2023-06-02 22:48:25 +08:00
0e06f15c87 [DOCS](data-types) remove old types (#20375) 2023-06-02 22:47:22 +08:00
0b86d07c0c [Docs](docs) Update BE http documents (#17604) 2023-06-02 18:01:44 +08:00
a20a6d2bea [refactor](jdbc catalog) Refactor the JdbcClient code (#20109)
This PR does the following:

1. This PR is a substantial refactor of the JDBC client architecture. The previous monolithic JDBC client has been refactored into an abstract base class `JdbcClient`, and a set of database-specific subclasses (e.g., `JdbcMySQLClient`, `JdbcOracleClient`, etc.), and the JdbcClient required config, abstract into an object. This allows for improved modularity, easier addition of support for new databases, and cleaner, more maintainable code. This change is backward-compatible and does not affect existing functionality.
2. As a result of client refactoring, OceanBaseClient can automatically recognize the mode of operation as MySQL or Oracle, so we cancel the oceanbase_mode property in the Jdbc Catalog, but due to the cancellation of the property, When creating a single OceanBase Jdbc Table, the table type needs to be filled in as oceanbase(mysql mode) or oceanbase_oracle(oracle_mode). The above work is a change in the usage behavior, please note.
3. For the PostgreSQL Jdbc Catalog, I did two things:

      1.   The adaptation to MATERIALIZED VIEW and FOREIGN TABLE is added
      2.   Fixed reading jsonb, which had been incorrectly changed to json in a previous PR

4. fix some jdbc catalog test case
5. modify oceanbase jdbc doc

And,Thanks @wolfboys for the guidance
2023-06-02 17:58:10 +08:00
c2121c831a [typo](docs) Update the help create command display (#20357) 2023-06-02 17:57:23 +08:00
4395fb70c4 [Enhancement](tvf) Backends tvf supports authentication (#20333)
Add authentication for backends tvf.
2023-06-02 17:53:44 +08:00
d68f3f3b3d [Feature](array-functions)improve array functions for array_last_index (#20294)
Now we just support array_first_index for lambda input , but no array_last_index
2023-06-02 13:54:03 +08:00
e32eba8fdf [refactor](stats) Persist status of analyze task to FE meta data (#20264)
1. In the past, we use a BE table named `analysis_jobs` to persist the status of analyze jobs/tasks, however there are many flaws such as, if BE crashed analyze job/task would failed however the status of analyze job/task couldn't get updated.
2. Support `DROP ANALYZE JOB [job_id]` to delete analyze job
3. Support `SHOW ANALYZE TASK STATUS [job_id] ` to  get the task status of specific job
4. Restrict the execute condition of auto analyze, only when  the  last execution of auto analyze job finished a while ago could be executed again
5. Support analyze whole DB
2023-06-02 12:33:31 +08:00
62c188d9a2 [typo](docs) fix release note 2.0 zh url (#20320) 2023-06-02 11:45:24 +08:00
c6b6dcdbc7 [Docs](inverted index) update docs for inverted index parser_mode and match_phrase support (#20266) 2023-06-02 11:38:04 +08:00
5a3b97bbf2 [enhancement](struct-type)support comment for struct field (#20200)
support comment for struct field
2023-06-02 10:29:56 +08:00
Bin
075635ee50 [typo](docs)Correct the getting started document (#20245) 2023-06-02 09:58:26 +08:00
ecdc5124be [feature-wip](duplicate-no-keys) schame change support for duplicate no keys (#19326) 2023-06-02 09:22:41 +08:00
0df073699d [fix](planner)Fix missing kw for workload #20319
1 add usage docment for Workload Group query queue;
2 Fix missing KW for workload, this may cause create workload group failed.
2023-06-02 09:04:22 +08:00
e416c4d95f [fix](docs)Correct the year and month format placeholder to lower case (#20210) 2023-06-01 16:14:00 +08:00
519f01133a [feature](decimal)support cast rounding half up and div precision increment in decimalv3. (#19811) 2023-06-01 13:09:58 +08:00
a1e3f49fb5 [enhancement](ldap) Support refresh ldap cache (#20183)
Support refreshing ldap cache:
refresh ldap all;
refresh ldap;
refresh ldap for user1;
Support for caching non-existent ldap users.
When logging in with a doris user that does not exist in the Ldap service after ldap is enabled, avoid accessing the ldap service every time in scenarios such as show databases; that require a lot of authentication.
2023-05-31 15:38:12 +08:00
f9dfcb923d [Enhancement] Change Create Resource Group Grammar (#20249) 2023-05-31 15:23:24 +08:00
54d1b16116 [docs](spark-doris-connector): modify the link of spark-doris-connector (#20159) 2023-05-31 09:42:00 +08:00
accaff1026 [Feature](compaction) wip: single replica compaction (#19237)
Currently, compaction is executed separately for each backend, and the reconstruction of the index during compaction leads to high CPU usage. To address this, we are introducing single replica compaction, where a specific primary replica is selected to perform compaction, and the remaining replicas fetch the compaction results from the primary replica.

The Backend (BE) requests replica information for all peers corresponding to a tablet from the Frontend (FE). This information includes the host where the replica is located and the replica_id. By calculating hash(replica_id), the replica with the smallest hash value is responsible for executing compaction, while the remaining replicas are responsible for fetching the compaction results from this replica.
The compaction task producer thread, before submitting a compaction task, checks whether the local replica should fetch from its peer. If it should, the task is then submitted to the single replica compaction thread pool.
When performing single replica compaction, the process begins by requesting rowset versions from the target replica. These rowset_versions are then compared with the local rowset versions. The first version that can be fetched is selected.
2023-05-30 21:12:48 +08:00
a220b1c34a [typo](docs) fix oceanbase jdbc catalog error (#20197) 2023-05-30 14:18:16 +08:00
5351153b04 [doc](fix)Modified the description about trino #20174 2023-05-30 13:14:45 +08:00
9eccbdbef3 [typo](docs) fix fqdn doc error (#20171) 2023-05-29 21:39:42 +08:00
198433b131 [typo](config)Remove FE config max_conn_per_user (#20122)
---------

Co-authored-by: Yijia Su <suyijia@selectdb.com>
2023-05-29 17:20:36 +08:00
Bin
d7e0a52bde [typo](doc)correct the misspelled word and the improper word (#20149) 2023-05-29 15:07:30 +08:00
5f9c6e076f [Fix](load)Make insert timeout accurate in show load statistics (#20068) 2023-05-28 21:19:06 +08:00
Bin
142f884753 [typo](docs)Best usage document correction. #20142 2023-05-28 18:56:17 +08:00
875e72b5ea [typo](doc)spark load add task timeout parameter #20115 2023-05-27 22:44:20 +08:00
f54a068d82 [feature](function) add json->operator convert to json_extract (#19899) 2023-05-27 12:45:45 +08:00
Bin
b12250f9e8 [typo](docs)Data partition document correction. (#20103)
* correct the wrongly conveyed meaning.

* delete the item which should not be there anymore.
2023-05-27 12:37:50 +08:00
9e70a9ef84 [opt](compaction) add pick rowset to compact interval config (#19868) 2023-05-26 17:39:02 +08:00
9bc01d3968 [doc](fix)Supplementary array type description #20079 2023-05-26 14:10:18 +08:00
3c2b2361be [docs](memory) debug-tools memory part description Jemalloc #20054 2023-05-26 08:58:57 +08:00
dfaa2db653 [typo](docs) modify the en url to zh url in 2.0 alpha release zh doc (#20038) 2023-05-25 21:08:19 +08:00
002c76e06f [vectorized](udaf) support udaf function work with window function (#19962) 2023-05-25 14:38:47 +08:00
04415d0b35 [opt](balance) add config balance_slot_num_per_path (#19869)
Make balance_slot_num_per_path configurable.
2023-05-25 13:39:42 +08:00
a3fd7abf92 [fix](docs) fix wrong link (#20000) 2023-05-25 08:51:01 +08:00
Bin
156c8faac5 [typo](doc)deleted the space which broke the word model (#19991) 2023-05-25 08:22:41 +08:00
4a7dab228c [fix](doc) Add doris-future doc in sidebar (#19992) 2023-05-24 21:39:14 +08:00
20f63a363d [docs](resource-group) add relevant documents to the resource group (#19941) 2023-05-23 23:36:46 +08:00
2b47282be1 [doc](merge-on-write) add some notes for using MoW (#19968) 2023-05-23 23:33:31 +08:00
c246c22b23 [doc](multi-catalog)Supplementary FAQ (#19911)
* catalog doc

* catalog doc
2023-05-23 18:22:10 +08:00
bfafa5e19d [Chore](docs)Remove empty pages to avoid ambiguity (#19953)
* [Chore](docs)Remove empty pages to avoid ambiguity

* update slidebar
2023-05-23 18:20:19 +08:00
d2e3fb097b [docs](struct-map-type) update user docs for struct and map type (#19939)
We have already supported decimalV3.
2023-05-23 09:30:26 +08:00
750a3ea1b4 [doc](fqdn)broker fqdn doc #19910 2023-05-22 18:30:57 +08:00
060fbe2b1f [typo](docs) replace the wrong field "json_paths" in s3 tvf related docs with the correct one "jsonpaths" #19900 2023-05-22 09:03:56 +08:00
1c950d6930 [fix](config) fix memory config enable_query_memroy_overcommit spell problem #19898 2023-05-22 00:32:20 +08:00
499f443779 [feature](iceberg) Support read iceberg data on gcs (#19815) 2023-05-20 12:40:03 +08:00
3e02b0e7ea [Doc](fix) Fixed two documentation errors (#19879) 2023-05-20 00:25:01 +08:00
6f21cd8a5f update create table doc (#19871) 2023-05-20 00:18:38 +08:00