org.apache.lucene.analysis.fr
Class ElisionFilter

java.lang.Object
  extended by org.apache.lucene.analysis.TokenStream
      extended by org.apache.lucene.analysis.TokenFilter
          extended by org.apache.lucene.analysis.fr.ElisionFilter

public class ElisionFilter
extends TokenFilter

Removes elisions from a token stream. For example, "l'avion" (the plane) will be tokenized as "avion" (plane).

Note that StandardTokenizer sees " ' " as a space, and cuts it out.

Author:
Mathieu Lecarme
See Also:
Elision in Wikipedia

Field Summary
 
Fields inherited from class org.apache.lucene.analysis.TokenFilter
input
 
Constructor Summary
protected ElisionFilter(TokenStream input)
          Constructs an elision filter with standard stop words
  ElisionFilter(TokenStream input, Set articles)
          Constructs an elision filter with a Set of stop words
  ElisionFilter(TokenStream input, String[] articles)
          Constructs an elision filter with an array of stop words
 
Method Summary
 Token next()
          Returns the next input Token whith termText() without elisioned start
 void setArticles(Set articles)
           
 
Methods inherited from class org.apache.lucene.analysis.TokenFilter
close
 
Methods inherited from class org.apache.lucene.analysis.TokenStream
next, reset
 
Methods inherited from class java.lang.Object
clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait
 

Constructor Detail

ElisionFilter

protected ElisionFilter(TokenStream input)
Constructs an elision filter with standard stop words


ElisionFilter

public ElisionFilter(TokenStream input,
                     Set articles)
Constructs an elision filter with a Set of stop words


ElisionFilter

public ElisionFilter(TokenStream input,
                     String[] articles)
Constructs an elision filter with an array of stop words

Method Detail

setArticles

public void setArticles(Set articles)

next

public Token next()
           throws IOException
Returns the next input Token whith termText() without elisioned start

Overrides:
next in class TokenStream
Throws:
IOException


Copyright © 2000-2008 Apache Software Foundation. All Rights Reserved.