Unicode compatibility decomposed normalized form (NFKD)
Normalize String to Unicode Compatibility Canonical Decomposition Form
Strings that look identical can have different underlying representations. The Unicode compatibiity canonical decomposition form (NFKD) ensures that equivalent strings have a unique binary representation.
Consider the string
"jalapeño", which contains eight letters.
str = "jalapeño"; strlength(str)
ans = 8
Normalize the string using the
textanalytics.unicode.nfkd function. On some systems, the output string appears to be identical to the input string.
newStr = textanalytics.unicode.nfkd(str)
newStr = "jalapeño"
View the length of the normalized string. The normalized representation includes one extra code unit. In this case, the function splits the accented letter
"ñ" into two separate code units.
ans = 9
Extract the seventh and eighth code units in the normalized string. On some systems, the output appears to be a single character.
ans = "ñ"
Check that the strings
newStr are equal using the
== operator. The operator returns
0 because the strings have different underlying representations.
tf = str == newStr
tf = logical 0
str — Input text
string array | character vector | cell array of character vectors
Input text, specified as a string array, character vector, or cell array of character vectors.
["An example of a short sentence."; "A second short
Unicode Normalization Forms
For more information about Unicode normalization forms, see Unicode Standard Annex #15 Unicode Normalization Forms.
 Whistler, Ken, ed. "Unicode Standard Annex #15: Unicode Normalization Forms." Unicode Technical Reports, August 27, 2021. https://unicode.org/reports/tr15/.
Introduced in R2022b