Dam1029 834834dc44 [SparkLoadk] Avoid to read whole hive table when we add a where (#5047) ...

When we use spark load from hive table, the function loadDataFromHiveTable
will read whole hive table and then filter the data in process()
if hive table have lots of partitions and history data，the load will be cost too much time and resource.
So we can do filter work in loadDataFromHiveTable function when read from hive table.
Co-authored-by: 杜安明 <anming.du@mihoyo.com>

2020-12-15 09:26:42 +08:00

..

src

[SparkLoadk] Avoid to read whole hive table when we add a where (#5047)

2020-12-15 09:26:42 +08:00

pom.xml

[CodeRefactor] Modify FE modules (#4146)

2020-07-29 16:18:05 +08:00