vim-patch:9.1.1276: inline word diff treats multibyte chars as word char (#33323)

Problem:  inline word diff treats multibyte chars as word char
          (after 9.1.1243)
Solution: treat all non-alphanumeric characters as non-word characters
          (Yee Cheng Chin)

Previously inline word diff simply used Vim's definition of keyword to
determine what is a word, which leads to multi-byte character classes
such as emojis and CJK (Chinese/Japanese/Korean) characters all
classifying as word characters, leading to entire sentences being
grouped as a single word which does not provide meaningful information
in a diff highlight.

Fix this by treating all non-alphanumeric characters (with class number
above 2) as non-word characters, as there is usually no benefit in using
word diff on them. These include CJK characters, emojis, and also
subscript/superscript numbers. Meanwhile, multi-byte characters like
Cyrillic and Greek letters will still continue to considered as words.

Note that this is slightly inconsistent with how words are defined
elsewhere, as Vim usually considers any character with class >=2 to be
a "word".

related: vim/vim#16881 (diff inline highlight)
closes: vim/vim#17050

9aa120f7ad

Co-authored-by: Yee Cheng Chin <ychin.git@gmail.com>
This commit is contained in:
zeertzjq
2025-04-05 09:42:00 +08:00
committed by GitHub
parent 1e1384b6dd
commit e8785c2e94
7 changed files with 45 additions and 10 deletions

View File

@@ -2286,7 +2286,10 @@ local options = {
difference.
word Use internal diff to perform a
|word|-wise diff and highlight the
difference.
difference. Non-alphanumeric
multi-byte characters such as emoji
and CJK characters are considered
individual words.
internal Use the internal diff library. This is
ignored when 'diffexpr' is set. *E960*