doris

Files

airborne12 fc2b9db0ad [Feature](inverted index) add tokenize function for inverted index (#21813 )

In this PR, we introduce TOKENIZE function for inverted index, it is used as following:
```
SELECT TOKENIZE('I love my country', 'english');
```
It has two arguments, first is text which has to be tokenized, the second is parser type which can be **english**, **chinese** or **unicode**.
It also can be used with existing table, like this:
```
mysql> SELECT TOKENIZE(c,"chinese") FROM chinese_analyzer_test;
+---------------------------------------+
| tokenize(`c`, 'chinese')              |
+---------------------------------------+
| ["来到", "北京", "清华大学"]          |
| ["我爱你", "中国"]                    |
| ["人民", "得到", "更", "实惠"]        |
+---------------------------------------+
```

2023-07-25 15:05:35 +08:00

be-java-extensions

[vectorized](udf) java udf support map type (#22059 )

2023-07-25 11:56:20 +08:00

check/checkstyle

[fix](catalog) fix create catalog with resource replay issue and kerberos auth issue (#20137 )

2023-05-30 16:57:39 +08:00

fe-common

[vectorized](udf) java udf support map type (#22059 )

2023-07-25 11:56:20 +08:00

fe-core

[Feature](inverted index) add tokenize function for inverted index (#21813 )

2023-07-25 15:05:35 +08:00

hive-udf

[Improve](fe)Upgrade dependencies and optimize jar package management (#18882 )

2023-05-04 10:07:37 +08:00

spark-dpp

[improvement](spark-load) support datev2 and datetimev2 #21839

2023-07-24 09:07:53 +08:00

pom.xml

[improve](dependency)Upgrade dependency version (#21431 )

2023-07-04 11:29:21 +08:00

README

…

README

# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements.  See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership.  The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License.  You may obtain a copy of the License at
#
#   http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied.  See the License for the
# specific language governing permissions and limitations
# under the License.

# fe-common

This module is used to store some common classes of other modules.

# spark-dpp

This module is Spark DPP program, used for Spark Load function.
Depends: fe-common

# fe-core

This module is the main process module of FE.
Depends: fe-common, spark-dpp