Search code examples
Unable to push the data from the written kafka topic to Postgres table...


apache-sparkpysparkapache-kafka-connectspark-structured-streamingspark-kafka-integration

Read More
Spark AQE Post-Shuffle partitions coalesce don't work as expected, and even make data skew in so...


apache-sparkapache-spark-sqlspark-kafka-integrationspark3

Read More
PySpark - NoClassDefFoundError: kafka/common/TopicAndPartition...


javaapache-sparkpysparkapache-kafkaspark-kafka-integration

Read More
NoSuchMethodError: org.apache.spark.internal.Logging...


scalaapache-sparkspark-kafka-integration

Read More
Spark 3.x Integration with Kafka in Python...


apache-sparkpysparkapache-kafkaspark-structured-streamingspark-kafka-integration

Read More
Error while pulling kafka jks certificates from hdfs (trying with s3 as well) in spark...


apache-sparkamazon-s3hdfsspark-structured-streamingspark-kafka-integration

Read More
How to add Kafka dependencies for PySpark on a Jupyter notebook...


pysparkapache-kafkajupyterspark-kafka-integration

Read More
How to use kafka.group.id and checkpoints in spark 3.0 structured streaming to continue to read from...


scalaapache-sparkapache-kafkaspark-structured-streamingspark-kafka-integration

Read More
Spark 3 structured streaming use maxOffsetsPerTrigger in Kafka source with Trigger.Once...


apache-sparkapache-kafkaspark-structured-streamingspark-kafka-integration

Read More
How to map a message to a object with `schema` and `payload` in Spark structured streaming correctly...


scalaapache-sparkapache-kafkaspark-structured-streamingspark-kafka-integration

Read More
Difference between spark-streaming-kafka-0-10 vs spark-sql-kafka-0-10...


scalaapache-sparkapache-kafkaspark-kafka-integration

Read More
Getting Error for org.apache.spark.sql.Encoder and missing or invalid dependency find while loading ...


scalaapache-sparkspark-streamingspark-kafka-integration

Read More
Connecting Pyspark with Kafka...


apache-sparkpysparkapache-kafkaspark-structured-streamingspark-kafka-integration

Read More
I have more data in a kafka topic but when i extract data using my pyspark application, I am getting...


apache-sparkapache-kafkaspark-kafka-integration

Read More
testing kafka and spark with testcontainers...


scalaapache-sparktestcontainersspark-kafka-integration

Read More
java.lang.ClassNotFoundException: org.apache.spark.sql.kafka010.KafkaSourceRDDPartition...


apache-sparkpysparkspark-structured-streamingspark-kafka-integration

Read More
How to writestream to specific kafka cluster in Azure databricks? " Topic mytopic not present i...


apache-sparkpysparkapache-kafkaspark-structured-streamingspark-kafka-integration

Read More
PySpark Structured Streaming with Kafka - Scaling Consumers for multiple topics with different loads...


apache-sparkpysparkapache-kafkaspark-structured-streamingspark-kafka-integration

Read More
Spark Structured Streaming - Kafka - Missing required configuration "partition.assignment.strat...


dockerapache-sparkpysparkapache-kafkaspark-kafka-integration

Read More
NoSuchMethodError: org.apache.spark.sql.kafka010.consumer...


scalaapache-sparkapache-kafkaspark-structured-streamingspark-kafka-integration

Read More
Spark Streaming - Kafka - Java -jar not working but running by Java application it works...


javamavenapache-sparkapache-kafkaspark-kafka-integration

Read More
pyspark: how to perform structured streaming using KafkaUtils...


pysparkapache-kafkaspark-streamingspark-kafka-integration

Read More
Get 2 different data from 1 kafka topic into 2 dataframes...


pythonapache-sparkapache-kafkaspark-kafka-integration

Read More
How to run Spark structured streaming using local JAR files...


apache-sparkamazon-emrspark-structured-streamingspark-kafka-integration

Read More
Spark structured stream with tumbling window delayed and duplicate data...


javaapache-sparkspark-structured-streamingspark-kafka-integration

Read More
Kafka Spark Structured Streaming with SASL_SSL authentication...


scalaapache-sparkapache-kafkaspark-structured-streamingspark-kafka-integration

Read More
How can i send my structured streaming dataframe to kafka?...


apache-sparkpysparkapache-kafkaspark-structured-streamingspark-kafka-integration

Read More
Structured Streaming startingOffest and Checkpoint...


apache-sparkspark-structured-streamingspark-kafka-integration

Read More
spark struct streaming writeStream output no data but no error...


pysparkapache-kafkaspark-structured-streamingspark-kafka-integrationspark3

Read More
Why Spark Streaming with kafka always poll(0) before seektoEnd...


apache-sparkapache-kafkaspark-streamingspark-kafka-integration

Read More
BackNext