Search code examples
rmachine-learningnlpsentiment-analysissnowball

Stemmer function in R Slow


I am trying to run stemmer function on a dataset(uploaded through data.table package) in R of around 40000 rows,but its taking forever to run. My code looks like this:

data[, Description := map(Description, function(k) stemmer(k))]

If manually stop the process, it shows more than 50 warnings as: Image Link

Is there an alternative to run it faster. My computer has 8Gb ram.


Solution

  • Use lapply, your function will run faster