Token Search For Special Charactor #821

Is there an existing issue for this?

• I have searched the existing issues

Your question

I have read the Token Search codes, the feature is very useful, but it only use /\b\w+\b/g to split the sentence which cannot customize for special cases:

1. the word within dot or other special chars;
2. use in the some regions(like East Asian) not in the Romance languages.