database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity

Modify the result json format of mini load (#1487)

Browse Source 
Mini load is now using stream load framework. But we should keep the
mini load return behavior and result json format be same as old.
So PUBLISH_TIMEOUT error should be treated as OK in mini load.

Also add 2 counters for OlapTableSink profile:
SerializeBatchTime: time of serializing all row batch.
WaitInFlightPacketTime: time of waiting last send packet
This commit is contained in:
Mingyu Chen
2019-07-16 19:15:41 +08:00
committed by GitHub
parent a9e8113b82
commit 4e043e66e2
6 changed files with 70 additions and 6 deletions
Download Patch File Download Diff File Expand all files Collapse all files

43
be/src/runtime/stream_load/stream_load_context.cpp
View File

@ -76,6 +76,49 @@ std::string StreamLoadContext::to_json() const {
return s.GetString();
}
/*
* The old mini load result format is as followes:
* (which defined in src/util/json_util.cpp)
*
* {
* "status" : "Success"("Fail"),
* "msg" : "xxxx"
* }
*
*/
std::string StreamLoadContext::to_json_for_mini_load() const {
rapidjson::StringBuffer s;
rapidjson::PrettyWriter<rapidjson::StringBuffer> writer(s);
writer.StartObject();
// status
bool show_ok = true;
writer.Key("status");
switch (status.code()) {
case TStatusCode::OK:
writer.String("Success");
break;
case TStatusCode::PUBLISH_TIMEOUT:
// treat PUBLISH_TIMEOUT as OK in mini load
writer.String("Success");
break;
default:
writer.String("Fail");
show_ok = false;
break;
}
// msg
writer.Key("msg");
if (status.ok() || show_ok) {
writer.String("OK");
} else {
writer.String(status.get_error_msg().c_str());
}
writer.EndObject();
return s.GetString();
}
std::string StreamLoadContext::brief(bool detail) const {
std::stringstream ss;
ss << "id=" << id << ", job id=" << job_id << ", txn id=" << txn_id << ", label=" << label;