phpman > perldoc > Plucene::Analysis::LetterTokenizer(3pm)

NAME
    Plucene::Analysis::LetterTokenizer - Letter tokenizer

SYNOPSIS
            # isa Plucene::Analysis::CharTokenizer

DESCRIPTION
    This is the letter tokenizer class, which divides text at non-letters.

    Note: this does a decent job for most European languages, but does a terrible job for some Asian
    languages, where words are not separated by spaces