doris

Files

Jibing-Li 3ebc98228d [feature wip](multi catalog)Support iceberg schema evolution. (#15836 )

Support iceberg schema evolution for parquet file format.
Iceberg use unique id for each column to support schema evolution.
To support this feature in Doris, FE side need to get the current column id for each column and send the ids to be side.
Be read column id from parquet key_value_metadata, set the changed column name in Block to match the name in parquet file before reading data. And set the name back after reading data.

2023-01-20 12:57:36 +08:00

check/checkstyle

[feature-wip](array) remove array config and check array nested depth (#13428 )

2022-10-20 15:52:31 +08:00

fe-common

[fix](planner) fix bugs in uncheckedCastChild (#15905 )

2023-01-19 15:51:08 +08:00

fe-core

[feature wip](multi catalog)Support iceberg schema evolution. (#15836 )

2023-01-20 12:57:36 +08:00

hive-udf

[deps](fe)upgrade deps version (#15262 )

2022-12-24 22:18:10 +08:00

java-udf

[fix](jdbc) fix jdbc driver bug and external datasource p2 test case issue (#16033 )

2023-01-18 17:48:06 +08:00

spark-dpp

[Enhancement](fe): replace assertTrue(X.equals(X)) with assertEquals (#15356 )

2022-12-27 00:37:24 +08:00

pom.xml

[refactor](fe) remove type related class to fe-common to reduce java-udf jar size (#15808 )

2023-01-17 00:01:15 +08:00

README

…

README

# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements.  See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership.  The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License.  You may obtain a copy of the License at
#
#   http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied.  See the License for the
# specific language governing permissions and limitations
# under the License.

# fe-common

This module is used to store some common classes of other modules.

# spark-dpp

This module is Spark DPP program, used for Spark Load function.
Depends: fe-common

# fe-core

This module is the main process module of FE.
Depends: fe-common, spark-dpp