Plucene::Analysis::LetterTokenizer(3pm) - phpMan

Plucene::Analysis::LetterTokeniUser3Contributed Perl DocumPlucene::Analysis::LetterTokenizer(3pm)

NAME
       Plucene::Analysis::LetterTokenizer - Letter tokenizer

SYNOPSIS
               # isa Plucene::Analysis::CharTokenizer

DESCRIPTION
       This is the letter tokenizer class, which divides text at non-letters.

       Note: this does a decent job for most European languages, but does a terrible job for some
       Asian languages, where words are not separated by spaces

perl v5.26.1                                2018-04-02    Plucene::Analysis::LetterTokenizer(3pm)

Generated by $Id: phpMan.php,v 4.55 2007/09/05 04:42:51 chedong Exp $ Author: Che Dong
On Apache
Under GNU General Public License
2025-11-21 18:05 @216.73.216.164 CrawledBy Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)