Stemming text in java

Question

im searching for a possibility to stemm strings in java. First I wanted to do it with lucene but all the examples I found in the web were deprecated. (SnowballAnalyzer, PorterStemmer, ...) I just want to stemm whole sentences.

public static String stemSentence(String sentence) {
    ...
    return stemmedSentence;
}

How can i do it?

Answer 1

Make this:

public static String stem(String string) throws IOException {
    TokenStream tokenizer = new StandardTokenizer(Version.LUCENE_47, new StringReader(string));
    tokenizer = new StandardFilter(Version.LUCENE_47, tokenizer);
    tokenizer = new LowerCaseFilter(Version.LUCENE_47, tokenizer);
    tokenizer = new PorterStemFilter(tokenizer);

    CharTermAttribute token = tokenizer.getAttribute(CharTermAttribute.class);

    tokenizer.reset();

    StringBuilder stringBuilder = new StringBuilder();

    while(tokenizer.incrementToken()) {
        if(stringBuilder.length() > 0 ) {
            stringBuilder.append(" ");
        }

        stringBuilder.append(token.toString());
    }

    tokenizer.end();
    tokenizer.close();

    return stringBuilder.toString();
}