doris

Files

qiye b2e3ecb81d [opt](load)change load_to_single_tablet tablet search algorithm from random to round-robin (#25256 )

At present, `load_to_singlt_tablet` import implementation refers to simple random number remainder, which cannot achieve true averaging. This will lead to uneven disk IO and uneven use of cluster resources. To solve this problem, we are preparing to implement round-robin for each partition tablet imported each time, in order to achieve average load to each tablet.

When generating the load query plan, the tablet index record currently imported is passed to BE.
Add a deamon task in FE to regularly clean up the `loadTabletRecordMap`. The map will get the bucket_number of the partition and update the `load_tablet_index` when `getCurrentLoadTabletIndex`.

2023-10-16 16:43:25 +08:00

.idea

[chore](idea) add back .idea dir under fe (#23821 )

2023-09-04 14:01:00 +08:00

be-java-extensions

[fix](jni) the offset in map type is int64 (#25394 )

2023-10-13 14:23:17 +08:00

check/checkstyle

[minor](fe) optimize some log info and imports issue (#24138 )

2023-09-11 16:16:58 +08:00

fe-common

[fix](Nereids) count should not accept complex and json type (#25354 )

2023-10-15 22:08:35 -05:00

fe-core

[opt](load)change load_to_single_tablet tablet search algorithm from random to round-robin (#25256 )

2023-10-16 16:43:25 +08:00

hive-udf

[fix](hive-udf) delete Logger to avoid Kryo serialize problem. (#25312 )

2023-10-16 16:10:06 +08:00

spark-dpp

[fix](spark load) not setting the file format cause null pointer exception (#16202 )

2023-09-05 12:14:07 +08:00

pom.xml

[Fix](mvn source) Fix fe compile java-cup and cup-maven-plugin not found #25348

2023-10-12 19:21:55 +08:00

README

…

README

# Licensed to the Apache Software Foundation (ASF) under one
# or more contributor license agreements.  See the NOTICE file
# distributed with this work for additional information
# regarding copyright ownership.  The ASF licenses this file
# to you under the Apache License, Version 2.0 (the
# "License"); you may not use this file except in compliance
# with the License.  You may obtain a copy of the License at
#
#   http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing,
# software distributed under the License is distributed on an
# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
# KIND, either express or implied.  See the License for the
# specific language governing permissions and limitations
# under the License.

# fe-common

This module is used to store some common classes of other modules.

# spark-dpp

This module is Spark DPP program, used for Spark Load function.
Depends: fe-common

# fe-core

This module is the main process module of FE.
Depends: fe-common, spark-dpp