google-cloud-dataproc Examples and Free Source Code

How to extract the query result from a Hive job output logs using DataprocHiveOperator?...

python pandas hive airflow google-cloud-dataproc

Can you trigger Python Scripts from Dataproc?...

python hadoop google-cloud-platform google-cloud-dataproc google-cloud-storage

Bigquery as metastore for Dataproc...

apache-spark google-bigquery google-cloud-dataproc spark-bigquery-connector

ClassNotFoundException: Failed to find data source: bigquery...

java maven apache-spark google-bigquery google-cloud-dataproc

Dataproc Serverless - how to set javax.net.ssl.trustStore property to fix java.security.cert.CertPat...

google-cloud-platform ssl-certificate google-cloud-dataproc google-cloud-dataproc-serverless

GCP Dataproc custom image Python environment...

python google-cloud-platform pyspark google-cloud-dataproc

Serverless Dataproc Error- Batch ID is required...

google-cloud-platform google-cloud-dataproc google-cloud-dataproc-serverless

Is there a way to import and run functions from saved .py files in a Jupyter notebook running on a G...

python google-cloud-platform jupyter-notebook cluster-computing google-cloud-dataproc

Custom Container Image for Google Dataproc pyspark Batch Job...

pyspark google-cloud-dataproc google-cloud-dataproc-serverless

Component Gateway with DataprocOperator on Airflow...

python google-cloud-platform airflow google-cloud-dataproc

StructuredStreaming withWatermark - TypeError: 'module' object is not callable...

apache-spark google-cloud-platform spark-structured-streaming google-cloud-dataproc windowing

Why is my hdfs capacity not remainng constant?...

apache-spark hadoop apache-spark-sql google-cloud-dataproc dataproc

GCP Dataproc - Failed to construct kafka consumer, Failed to load SSL keystore dataproc.jks of type ...

ssl google-cloud-platform apache-kafka spark-structured-streaming google-cloud-dataproc

GCP dataproc - java.lang.NoClassDefFoundError: org/apache/kafka/common/serialization/ByteArraySerial...

apache-spark google-cloud-platform pyspark apache-kafka google-cloud-dataproc

How to store the result of remote hive query to a file...

hive hiveql google-cloud-dataproc

GCP Dataproc - cluster creation failing when using connectors.sh in initialization-actions...

shell apache-spark google-cloud-platform google-cloud-dataproc

(gcloud.dataproc.batches.submit.spark) unrecognized arguments: --subnetwork=...

apache-spark gcloud google-cloud-dataproc

Dataproc Cluster creation is failing with PIP error "Could not build wheels"...

python-3.x pip airflow google-cloud-dataproc python-wheel

Why is there just 1 job id in dataproc when there are multiple actions in the pyspark script?...

apache-spark pyspark google-cloud-dataproc dataproc

PySpark runs in YARN client mode but fails in cluster mode for "User did not initialize spark c...

apache-spark pyspark hadoop-yarn google-cloud-dataproc dataproc

Where to find spark log in dataproc when running job on cluster mode...

pyspark google-cloud-dataproc dataproc

Dataproc Java client throws NoSuchMethodError setUseJwtAccessWithScope...

java google-cloud-platform google-cloud-dataproc

Need information on dataproc image version 1.5.54...

google-cloud-dataproc

How are spark jobs submitted in cluster mode?...

apache-spark pyspark google-cloud-dataproc spark-submit dataproc

Can run code in pyspark shell but the same code fails when submitted with spark-submit...

apache-spark pyspark hadoop-yarn google-cloud-dataproc spark-submit

Facing Issue with DataprocCreateClusterOperator (Airflow 2.0)...

python airflow google-cloud-dataproc google-cloud-composer airflow-2.x

Run a Data Fusion pipeline only when a file exist...

google-cloud-platform etl google-cloud-dataproc google-cloud-data-fusion

Dataproc: What is the primary use case of local Hive metastore?...

google-cloud-dataproc

Why is adding org.apache.spark.avro dependency is mandatory to read/write avro files in Spark2.4 whi...

scala apache-spark google-cloud-dataproc spark-avro

NoClassDefFoundError com/microsoft/aad/adal4j/AuthenticationException while connecting to Azure SQL ...

java apache-spark google-cloud-platform azure-sql-database google-cloud-dataproc