database/doris
2
0
Fork 0
Code Issues Pull Requests Actions 3 Packages Projects Releases Wiki Activity
15,043 Commits 1 Branch 0 Tags
da71fde0660d0cb4e78858fc0ba56caeb7eaed0f
Commit Graph

107 Commits

Author SHA1 Message Date
huanghaibin
add160b768 [improvement](regression-test) add more group commit regression-test (#26952) 2023-11-15 00:01:13 +08:00
yujun
7b8709a944 [feature](doris compose) Support generate code coverage data (#26804) 2023-11-13 21:47:53 +08:00
yujun
ebc15fc6cc [fix](transaction) Fix concurrent schema change and txn cause dead lock (#26428) 
Concurrent schema change and txn may cause dead lock. An example:

Txn T commit but not publish;
Run schema change or rollup on T's related partition, add alter replica R;
sc/rollup add a sched txn watermark M;
Restart fe;
After fe restart, T's loadedTblIndexes will clear because it's not save to disk;
T will publish version to all tablet, including sc/rollup's new alter replica R;
Since R not contains txn data, so the T will fail. It will then always waitting for R's data;
sc/rollup wait for txn before M to finish, only after that it will let R copy history data;
Since T's not finished, so sc/rollup will always wait, so R will nerver copy history data;
Txn T and sc/rollup will wait each other forever, cause dead lock;
Fix: because sc/rollup will ensure double write after the sched watermark M, so for finish transaction, when checking a alter replica:

if txn id is bigger than M, check it just like a normal replica;
otherwise skip check this replica, the BE will modify history data later.
 2023-11-13 21:39:28 +08:00
yujun
d34dc1c133 [enhancement](regression test) stream load support direct load to be (#26829) 2023-11-13 10:07:10 +08:00
shuke
faaf0ecc85 [regression-test](framework) Support running tests multiple times and reporting correctly to TeamCity (#26606) 2023-11-08 09:42:53 -06:00
shuke
0f3e97f9c5 [regression-test][framework] support cases that can only run in non-concurrent-mode. (#26487) 2023-11-08 12:46:36 +08:00
TengJianPing
70bc8600a9 [fix](regression) fix regression framework bug: if real test result is negative, it will miss check test result (#25734) 2023-11-08 09:05:58 +08:00
yujun
daeca7d414 [feature](doris compose) support multiple disk types and other improvement (#25924) 2023-11-06 23:23:09 +08:00
Jack Drogon
3e8d2f6986 [fix](regression-test) Fix regiressin test syncer suit use master fe directly (#26456) 
Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com>
 2023-11-06 22:51:54 +08:00
Jack Drogon
2cc68381ec [feature](binlog) Add ingest_binlog/http_get_snapshot limit download speed && Add async ingest_binlog (#26323) 2023-11-06 11:14:44 +08:00
walter
3e9e8becc6 [fix](regression) Add auto-expired prefix for backup/restore cases (#26272) 2023-11-02 15:21:43 +08:00
walter
a698e14fb2 [cases](regression-test) Add backup & restore with multi tables test (#26040) 2023-10-31 17:08:55 +08:00
zhangdong
2a74d9a8c8 [feature](mtmv)(1)remove old mtmv code (#26041) 
remove old mtmv code,we will implement mtmv in a new way
 2023-10-30 19:49:45 +08:00
zhengyu
f883d1acfa [enhancement](regression) fault injection for segcompaction test (#25709) 
1. generalized debug point facilities from docker suites for
   fault-injection/stubbing cases
2. add segcompaction fault-injection cases for demonstration
3. add -238 TOO_MANY_SEGMENTS fault-injection case for good
 2023-10-30 17:36:17 +08:00
walter
365fdd2f4d [feature](backup) add property to remove snapshot before creating repo (#25847) 
Doris is not responsible for managing snapshots, but it needs to clear all
snapshots before doing backup/restore regression testing, so a property is
added to indicate that existing snapshots need to be cleared when creating a
repo.

In addition, a regression test case for backup/restore has been added.
 2023-10-27 21:03:26 +08:00
zzzzzzzs
d94ae20d4a [improvement](nereids) support insert into doris_internal_table_id(xxx) (#25722) 2023-10-25 11:12:00 +08:00
zhangguoqiang
a364a24ac2 [Enhance](regression) add hive out file check (#25475) 
add hive out file check
fix hive sql state with " ; "
 2023-10-17 10:11:57 +08:00
yujun
73c3e3ab55 [Feature](x-load) support config min replica num for loading data (#21118) 2023-10-11 21:07:35 +08:00
meiyi
55d1090137 [feature](insert) Support group commit stream load (#24304) 2023-09-26 20:57:02 +08:00
yujun
b9496b2a8f [feature](docker) regression test support run suite in docker (#24508) 2023-09-24 21:44:16 +08:00
zhangguoqiang
6f961ba0e9 [Enhance](external)add prepare hive data in case (#24703) 2023-09-22 11:19:46 +08:00
Pxl
bc0f5dfd8f [Chore](checks) move sonar config file to be(#24712) 
move sonar config file to be
 2023-09-21 15:16:26 +08:00
wangqt
7c32b2b4ed [Fix](broker load) broker load with or predicate error fix #24157 
Co-authored-by: wangqingtao6 <wangqingtao6@jd.com>
 2023-09-20 14:56:32 +08:00
DeadlineFen
a1090f20c7 [supplement](regression-test) pass ccr case when fe enable_feature_binlog=false (#24077) 2023-09-10 10:49:42 +08:00
meiyi
82dc970916 [feature](insert) Support group commit insert (#22829) 2023-09-08 15:51:03 +08:00
ZhangYu0123
5ca14938ac [Test](Framework) add enable cache data args for test CommandLine (#21852) 2023-09-03 14:51:00 +08:00
zzzzzzzs
05771e8a14 [Enhancement](Load) stream Load using SQL (#23362) 
Using stream load in SQL mode

for example:
example.csv

10000,北京
10001,天津
curl -v --location-trusted -u root: -H "sql: insert into test.t1(c1, c2) select c1,c2 from stream(\"format\" = \"CSV\", \"column_separator\" = \",\")" -T example.csv http://127.0.0.1:8030/api/_stream_load_with_sql
curl -v --location-trusted -u root: -H "sql: insert into test.t2(c1, c2, c3) select c1,c2, 'aaa' from stream(\"format\" = \"CSV\", \"column_separator\" = \",\")" -T example.csv http://127.0.0.1:8030/api/_stream_load_with_sql
curl -v --location-trusted -u root: -H "sql: insert into test.t3(c1, c2) select c1, count(1) from stream(\"format\" = \"CSV\", \"column_separator\" = \",\") group by c1" -T example.csv http://127.0.0.1:8030/api/_stream_load_with_sql
 2023-08-30 19:02:48 +08:00
DeadlineFen
c41179b8e9 [fix](regression) Improve the robustness when close target connection (#23012) 2023-08-16 11:42:58 +08:00
zzzzzzzs
66784cef71 [Enhancement](Load) Stream Load using SQL (#22509) 
This PR was originally #16940 , but it has not been updated for a long time due to the original author @Cai-Yao . At present, we will merge some of the code into the master first.

thanks @Cai-Yao @yiguolei
 2023-08-08 13:49:04 +08:00
DeadlineFen
3a787b6684 [improvement](regression) syncer regression test (#22490) 2023-08-02 20:09:27 +08:00
Pxl
ae809fbeba [Bug](storage )fix dead lock when create_tablet need lock two tablet && update mv_p0… (#21969) 
fix dead lock when create_tablet need lock two tablet && update mv_p0/ssb case
 2023-07-22 15:27:05 +08:00
abmdocrt
48bfb8e9cf [Enhancement](regression-test)Add regression test for MoW backup and restore (#21223) 2023-07-05 15:16:04 +08:00
DeadlineFen
15ec191a77 [Fix](CCR) Use tableId as the credential for CCR syncer instead of tableName (#21466) 2023-07-05 10:16:09 +08:00
Jack Drogon
8c532e8808 [fix](restore) work around, ingest binlog after backup/restore which local_tablet.partition_id is not correct, use req.partition_id (#21288) 
* work around, ingest binlog after backup/restore which local_tablet.partition_id is not correct, use by
req.partition_id

Signed-off-by: Jack Drogon <jack.xsuperman@gmail.com>
 2023-06-29 17:19:02 +08:00
DeadlineFen
4b94d34ec2 [fix](regression) Add get master token into regression framework (#21198) 2023-06-27 11:54:31 +08:00
DeadlineFen
4d84cd8ca1 Revert "Revert "[Test](regression) CCR syncer thrift interface regression test (#20935)" (#20990)" (#21022) 
This reverts commit 2a294801f1324a999570158eea3224239eefbb29.
 2023-06-21 15:20:21 +08:00
DeadlineFen
2a294801f1 Revert "[Test](regression) CCR syncer thrift interface regression test (#20935)" (#20990) 
This reverts commit dd482b74c849b022862e7cfb1f1d0b933a84e3d2.
 2023-06-19 21:38:03 +08:00
DeadlineFen
dd482b74c8 [Test](regression) CCR syncer thrift interface regression test (#20935) 2023-06-18 00:13:09 +08:00
chunping
731ce5802e [Test][Framework] add enableCacheData option for test framework (#20874) 2023-06-16 14:12:21 +08:00
zgxme
61d9bd2ba1 [fix](regression) fix export file test cases (#20463) 2023-06-06 20:07:31 +08:00
shuke
492154ee55 [fix](regression-test) add jdbc timeout (#20228) 
In some cases ( or bugs), doris may returned query to jdbc, but jdbc can not recognized what doris sent back,
so hanged. To fix this, add a timeout of 30 minutes to jdbc connection.
 2023-06-01 10:50:17 +08:00
Mingyu Chen
a7f3bfec89 [refactor](cluster)(step-2) remove cluster related to Backend (#19842) 2023-05-21 09:00:35 +08:00
Mingyu Chen
72632b1e32 [improvement](regression-test) add max_failure_num to skip tests when too much failure #19003 2023-04-25 09:03:36 +08:00
Xiaocc
3007cd49f2 [enhancement](mysql) enable two-way ssl authentication (#18530) 
According to the mysql-ssl, enable two-way SSL authentication.
 2023-04-21 14:39:14 +08:00
Zhengguo Yang
918a244068 [chore](pom) update apache pom to 29 (#18843) 2023-04-20 16:57:05 +08:00
AlexYue
ccb3541fa5 [chore](regression) print exception along with error sql when run sql file (#18374) 2023-04-07 14:19:47 +08:00
Yongqiang YANG
8011bdb30d [improvement](test) print exception when streamload fails (#18315) 2023-04-03 08:56:54 +08:00
Yongqiang YANG
ff66efd7d0 [improvement](test) print response of streamload (#18313) 
We need reponse text to reason failures of streamload.
 2023-04-02 20:08:28 +08:00
Mingyu Chen
238223fb8b [regression-test](log) add log for malforamt response of stream load (#18173) 2023-03-29 15:52:44 +08:00
huangzhaowei
a65616a5cd [enhancement](MTMV) Add a timeout for regression tests (#18048) 
MTMV regression tests may loop forever due to some potential bugs. Therefore, we add a timeout to avoid endless loop. The value of the timeout is hard coded 30 minutes now.
 2023-03-24 10:39:42 +08:00