Plucene::Analysis::Tokenizer - phpMan

Plucene::Analysis::Tokenizer(3pUser Contributed Perl DocumentatiPlucene::Analysis::Tokenizer(3pm)

NAME
       Plucene::Analysis::Tokenizer - base class for tokenizers

SYNOPSIS
               my $tokenizer = Plucene::Analysis::Tokenizer::Subclass
                       ->new({ reader => $reader });

DESCRIPTION
       This is an abstract base class for tokenizers.

       A Tokenizer is a TokenStream whose input is a Reader.

METHODS
   new
               my $tokenizer = Plucene::Analysis::Tokenizer::Subclass
                       ->new({ reader => $reader });

       This will create a new tokenizer.

   next
       This must be defined in a subclass

   close
       Close the input reader.

perl v5.26.1                                2018-04-02          Plucene::Analysis::Tokenizer(3pm)

Generated by $Id: phpMan.php,v 4.55 2007/09/05 04:42:51 chedong Exp $ Author: Che Dong
On Apache
Under GNU General Public License
2025-11-21 17:58 @216.73.216.164 CrawledBy Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)