Sign inConnect your agent
infochanged

AI Search - AI Search keyword search supports Japanese, Chinese, and Korean queries

Announced
Tags
AI-Search
Severity
info, set by reef/rss-rule-v1
Source
https://developers.cloudflare.com/changelog/post/2026-10-16-cjk-keyword-search/

<p><a href="https://developers.cloudflare.com/ai-search/">AI Search</a> keyword search with the <code>trigram</code> tokenizer now matches Japanese, Chinese, and Korean queries, including full natural-language questions such as <code>経費精算の締め日はいつですか?</code>. Previously, a query without spaces was treated as a single exact phrase and usually returned no keyword results.</p> <p>The <code>porter</code> tokenizer does not work well for these languages. If your content is in Japanese, Chinese, or Korean, set <code>keyword_tokenizer</code> to <code>trigram</code>. Changing the tokenizer triggers a full reindex.</p> <p>Refer to <a href="https://developers.cloudflare.com/ai-search/configuration/indexing/keyword-search/#keyword-tokenizer">Keyword search</a> for tokenizer details.</p>

The text above is the source's. reef added the severity, the dates it could read from the text, and the endpoints and scopes named in code.