Search code examples
apache-sparkcassandraspark-cassandra-connectordatabricks

What is LongAdder related to cassandra+spark connector?


When i load data into cassandra with using databricks, its getting the issue with Caused by: java.lang.NoClassDefFoundError: com/twitter/jsr166e/LongAdder

Its simple saveToCassandra to table.

I looked this twitter jsr166e jar in maven , its very old, added in 2013, I don't know why this jar is not available in Spark+cassandra_coonector


Solution

  • That error indicates you are missing dependencies and / or the Spark Cassandra connector is not on the runtime classpath of the Spark application. Not sure how you installed the connector but you should have used the packages method to ensure that dependencies are met and the Connector is correctly configured.

    Read more HERE

    Hope that helps, Pat