Search code examples
solrcassandradatastax-enterprisedatastax

DSE 3.2 SOLR FileNotFoundException


Just updated to DSE 3.2 from 3.1 using the guide to run the update, now the logs littered with this exception. When querying via SOLR we are getting missing data, however it seems that when querying using cqlsh or the cli, the data is there.

ERROR [IndexPool work thread-6] 2013-11-18 22:32:18,748 AbstractSolrSecondaryIndex    .java (line 912) _yaqn8_Lucene41_0.tip
java.io.FileNotFoundException: _yaqn8_Lucene41_0.tip
    at org.apache.lucene.store.bytebuffer.ByteBufferDirectory.fileLength(    ByteBufferDirectory.java:129)
    at org.apache.lucene.store.NRTCachingDirectory.sizeInBytes(NRTCachingDirectory    .java:158)
    at org.apache.lucene.store.NRTCachingDirectory.doCacheWrite(    NRTCachingDirectory.java:289)
    at org.apache.lucene.store.NRTCachingDirectory.createOutput(    NRTCachingDirectory.java:199)
    at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(    TrackingDirectoryWrapper.java:62)
    at org.apache.lucene.codecs.compressing.CompressingStoredFieldsWriter.<init>(    CompressingStoredFieldsWriter.java:107)
    at com.datastax.bdp.cassandra.index.solr.CassandraStoredFieldsWriter.<init>(    CassandraStoredFieldsWriter.java:25)
    at com.datastax.bdp.cassandra.index.solr.CassandraStoredFieldsFormat.    fieldsWriter(CassandraStoredFieldsFormat.java:39)
    at org.apache.lucene.index.StoredFieldsProcessor.initFieldsWriter(    StoredFieldsProcessor.java:86)
    at org.apache.lucene.index.StoredFieldsProcessor.finishDocument(    StoredFieldsProcessor.java:119)
    at org.apache.lucene.index.TwoStoredFieldsConsumers.finishDocument(    TwoStoredFieldsConsumers.java:65)
    at org.apache.lucene.index.DocFieldProcessor.finishDocument(DocFieldProcessor.    java:274)
    at org.apache.lucene.index.DocumentsWriterPerThread.updateDocument(    DocumentsWriterPerThread.java:274)
    at org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.    java:376)
    at org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:1485)
    at org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.    java:201)
    at com.datastax.bdp.cassandra.index.solr.CassandraDirectUpdateHandler2.addDoc(    CassandraDirectUpdateHandler2.java:103)
    at com.datastax.bdp.cassandra.index.solr.AbstractSolrSecondaryIndex.doIndex(    AbstractSolrSecondaryIndex.java:929)
    at com.datastax.bdp.cassandra.index.solr.AbstractSolrSecondaryIndex.    doUpdateOrDelete(AbstractSolrSecondaryIndex.java:586)
    at com.datastax.bdp.cassandra.index.solr.ThriftSolrSecondaryIndex.    updateColumnFamilyIndex(ThriftSolrSecondaryIndex.java:114)
    at com.datastax.bdp.cassandra.index.solr.AbstractSolrSecondaryIndex$3.run(    AbstractSolrSecondaryIndex.java:896)
    at com.datastax.bdp.cassandra.index.solr.concurrent.IndexWorker.run(    IndexWorker.java:38)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.    java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.    java:615)
    at java.lang.Thread.run(Thread.java:724)    

alo this:

ERROR 22:53:01,426 auto commit error...:org.apache.solr.common.SolrException: org.apache.solr.common.SolrException: Error opening new searcher
    at com.datastax.bdp.cassandra.index.solr.CassandraDirectUpdateHandler2.commit(CassandraDirectUpdateHandler2.java:318)
    at org.apache.solr.update.CommitTracker.run(CommitTracker.java:216)
    at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:178)
    at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:292)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:724)
Caused by: org.apache.solr.common.SolrException: Error opening new searcher
    at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1457)
    at org.apache.solr.core.SolrCore.getSearcher(SolrCore.java:1569)
    at org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:557)
    at com.datastax.bdp.cassandra.index.solr.CassandraDirectUpdateHandler2.commit(CassandraDirectUpdateHandler2.java:276)
    ... 9 more
Caused by: java.io.FileNotFoundException: _xfgfw_Lucene41_0.tim
    at org.apache.lucene.store.bytebuffer.ByteBufferDirectory.fileLength(ByteBufferDirectory.java:129)
    at org.apache.lucene.store.NRTCachingDirectory.sizeInBytes(NRTCachingDirectory.java:158)
    at org.apache.lucene.store.NRTCachingDirectory.doCacheWrite(NRTCachingDirectory.java:289)
    at org.apache.lucene.store.NRTCachingDirectory.createOutput(NRTCachingDirectory.java:199)
    at org.apache.lucene.store.TrackingDirectoryWrapper.createOutput(TrackingDirectoryWrapper.java:62)
    at org.apache.lucene.codecs.lucene42.Lucene42FieldInfosWriter.write(Lucene42FieldInfosWriter.java:49)
    at org.apache.lucene.index.DocFieldProcessor.flush(DocFieldProcessor.java:88)
    at org.apache.lucene.index.DocumentsWriterPerThread.flush(DocumentsWriterPerThread.java:493)
    at org.apache.lucene.index.DocumentsWriter.doFlush(DocumentsWriter.java:422)
    at org.apache.lucene.index.DocumentsWriter.flushAllThreads(DocumentsWriter.java:559)
    at org.apache.lucene.index.IndexWriter.getReader(IndexWriter.java:365)
    at org.apache.lucene.index.StandardDirectoryReader.doOpenFromWriter(StandardDirectoryReader.java:270)
    at org.apache.lucene.index.StandardDirectoryReader.doOpenIfChanged(StandardDirectoryReader.java:255)
    at org.apache.lucene.index.DirectoryReader.openIfChanged(DirectoryReader.java:250)
    at org.apache.solr.core.SolrCore.openNewSearcher(SolrCore.java:1393)
    ... 12 more

Solution

  • That looks like some files did not flush correctly on shutdown. You will have to do a full re-index (with deleting) on nodes showing those errors to get the lucene indexes to rebuild.

    This page shows how to initiate a re-index. http://www.datastax.com/docs/datastax_enterprise3.2/solutions/dse_search_upload#reloading-a-solr-core