Commit Graph

50 Commits

Author SHA1 Message Date
3738dec53e *: enable the new collation by default (#32016)
ref pingcap/tidb#32015
2022-02-08 12:53:35 +08:00
5af13e8a9f *: improve import (#31887)
ref pingcap/tidb#31716
2022-01-22 09:15:46 +08:00
4ae96872ff planner: do not use like to build range when new collation is enabled (#31278)
close pingcap/tidb#31174
2022-01-22 00:09:47 +08:00
cfbe70846a config: remove new charset config (#31291)
close pingcap/tidb#31236
2022-01-06 13:26:37 +08:00
29c398cbcc charset: add gbk_bin collation into gbk charaset (#31309)
close pingcap/tidb#31308
2022-01-05 13:34:36 +08:00
6e75367ad0 collation: make gbk default collation to gbk_bin if new collation is not enabled (#31208)
close pingcap/tidb#31221
2022-01-04 15:48:35 +08:00
3de13842b3 test: control log level with environment variables (#30871) 2021-12-24 17:03:48 +08:00
daf525a17e *: replace compareDatum by compare, range part (#30710) 2021-12-16 19:48:36 +08:00
d9ef107d39 *: replace compareDatum by compare, PR 11 (#30465) 2021-12-09 12:47:56 +08:00
eb7672fc48 *: replace compareDatum by compare and ignore warnings is collate is empty (#30105) 2021-11-29 17:53:53 +08:00
fb5eb1fa77 *: replace compareDatum by compare (#30048) 2021-11-23 15:57:50 +08:00
e08df49a0d collation: support gbk_chinese_ci collation and make it as default collation for gbk (#28645) 2021-10-25 11:34:48 +08:00
6d58a823a2 collation: add gbk_bin collation support (#28028) 2021-10-13 15:39:28 +08:00
xhe
94e30df8e2 parser: fix compiling, add unit tests (#28700) 2021-10-11 23:15:25 +08:00
32f96fef77 expression: make infer collation support the expressions with different charset (#27863) 2021-10-11 14:51:25 +08:00
680de922ed *: fix license header (#28085) 2021-09-17 22:26:41 +08:00
b47d772d47 charset: add a config field to control charset feature (#27288) 2021-08-20 23:46:01 +08:00
7755d25aba *: Integrate SkyWalking-eyes to check license headers in CI and fix licenses headers (#27198) 2021-08-16 18:52:00 +08:00
b872b05801 util/collate: migrate to testify (#26535) 2021-07-27 17:42:16 +08:00
2de4a918ac variable: refactor session/global validation (part 8) (#24100) 2021-04-23 12:07:54 +08:00
78fc47c9a2 collation: hide pinyin collation in show collation (#23521) 2021-03-25 15:09:24 +08:00
b5a9076aea *: new secondary index value format (#20220) 2021-03-03 21:16:54 +08:00
35534ae752 *: apply golangci-lint to the new code (#22824) 2021-02-24 18:24:03 +08:00
28c9e9290b *: gocritic fixes for commentFormatting (#21578) 2020-12-09 12:03:17 +08:00
8d35f17c17 Update the errors dependence to the latest version (#20917) 2020-11-10 09:50:39 +08:00
42590965ed *: refactor CompilePattern and DoMatch used by like (#20610) 2020-11-04 13:25:52 +08:00
f1c464a86a collation: add utf8mb4_zh_pinyin_tidb_as_cs collation interface (#20504) 2020-11-03 11:35:39 +08:00
14a31b5c0e charset: improve performance of general_ci Compare and Key function (#19558) 2020-10-29 10:25:32 +08:00
2f067c0542 *: redact arguments for Error (#20436) 2020-10-21 14:44:08 +08:00
ba60cf5a69 charset: implement utf8_unicode_ci and utf8mb4_unicode_ci collation (#18776) 2020-08-27 23:20:48 +08:00
d355b82f1c expression: unicode_ci support when infer collation and charset information (#19142)
* add mix unicode_ci collation support

* comments change

* bug fix

* add test

* refactor illegal mix collation message

* fmt

* fix check

* fmt

* refactor infer collation

* refactor infer collation

* add charset info

* address comments

* return bin if something wrong

Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-08-26 11:08:21 +08:00
b642045ff2 charset: add utf8_unicode_ci and utf8mb4_unicode_ci interface (#18678)
* add unicode_ci interface

* fix build

* fix check

* fix test

* change comments

* add test

* Update util/collate/unicode_ci.go

Co-authored-by: djshow832 <zhangming@pingcap.com>

Co-authored-by: djshow832 <zhangming@pingcap.com>
Co-authored-by: Yuanjia Zhang <zhangyuanjia@pingcap.com>
Co-authored-by: djshow832 <873581766@qq.com>
Co-authored-by: ti-srebot <66930949+ti-srebot@users.noreply.github.com>
2020-07-24 17:16:03 +08:00
c84aa79970 *: simplify LIKE patterns with multiple consecutive wildcards (#17490) 2020-07-21 22:43:42 +08:00
b5bb0090e7 *: fix LIKE expressions with _ following % (#17418) 2020-05-28 15:05:10 +08:00
d823deb583 expression: fix case-sensitive problem for function INSTR and LOCATE (#16792) 2020-05-09 18:00:05 +08:00
5f0585415b expression: forbidden illegal mix collate (#16277) 2020-04-15 14:41:27 +08:00
82829e1fa5 *: consolidate some settings related to the collation (#15553) 2020-03-23 17:38:31 +08:00
5e8706a1f6 util/collate: remove CollatorOption (#15472)
`CollatorOption` was used to specify the `PadLen` which aims to support
"PADDING" attribute of the collations. But now it is not needed anymore,
since TiDB actually implements "PADDING" by removing trailing spaces.
2020-03-19 15:16:29 +08:00
80d577a143 expression: update builtinLike to be collation-aware (#15049) 2020-03-12 16:08:32 +08:00
0ddfe0716f *: fix datum's collation behavior to build correct logical ranges (#14963) 2020-03-05 22:34:46 +08:00
332cef97f5 *: support index encode/decode for new collation (#14876) 2020-02-27 11:33:33 +08:00
0daca24dc3 expression: set collation id to negative in tipb if new collations are enabled (#14883) 2020-02-26 10:07:15 +08:00
143b3bd728 util: change padding of collation to truncateTailSpace (#14917) 2020-02-25 16:15:22 +08:00
f275ac302a util: fix a padding error for general_ci (#14906) 2020-02-23 22:46:59 +08:00
eb12799152 *: Collation should be set accordingly when setting string datum (#14757) 2020-02-20 23:01:53 +08:00
d0e6aed1f1 executor: consider collations when calculating hash values in HashJoin (#14836) 2020-02-19 19:49:28 +08:00
1344d6ddd9 util: support padding for collation (#14824) 2020-02-19 12:59:29 +08:00
713099c1ad *: add a configuration entry to control if new collations are enabled (#14734)
Configuration entry `new_collations_enabled_on_first_bootstrap` is
added, which determines if the new collations can be enabled when a
TiDB cluster is initialized for the first time.
2020-02-17 15:56:24 +08:00
aef4c05786 util: implement collation interface for utf8_general_ci and utf8mb4_general_ci (#14725)
Implement collation interface for utf8_general_ci and utf8mb4_general_ci.
Add a function GetCollatorByID.
2020-02-17 11:00:26 +08:00
6bae385ce0 util: add collation interface (#14698) 2020-02-11 11:18:04 +08:00