Search code examples
I want to pass schema (metadata) as an argument from Spark dataframe/dataset (dataframe name as an a...


scaladataframeapache-sparkapache-spark-sqlapache-spark-dataset

Read More
How can I print the content of rows in a Dataset using Java and the Spark SQL?...


javaapache-spark-sqlapache-spark-dataset

Read More
Extract nested objects in an object using dataset api in spark...


apache-sparkapache-spark-dataset

Read More
Scala Spark groupBy/Agg functions...


scalaapache-sparkapache-spark-datasetapache-spark-2.0

Read More
How to store Spark Streaming Checkpoint Location into S3?...


apache-sparkspark-streamingspark-structured-streamingapache-spark-datasetspark-checkpoint

Read More
Spark dataset alias column on-the-fly like for a dataframe...


apache-sparkapache-spark-dataset

Read More
Spark Dataset : data transformation...


apache-sparkapache-spark-sqlapache-spark-dataset

Read More
Spark Dataset -Aggregate query to sum of BigInt sums as zero...


apache-spark-sqlapache-spark-dataset

Read More
Scala Spark Dataset change class type...


scalaapache-sparkapache-spark-sqlapache-spark-dataset

Read More
Mapping Spark DataSet row values into new hash column...


scalaapache-sparkapache-spark-sqlapache-spark-dataset

Read More
How to parse a multiline json in dataset apache spark java...


javajsonhadoopapache-sparkapache-spark-dataset

Read More
Convert nested json string in Dataset to Dataset/Dataframe in Spark Scala...


apache-sparkapache-spark-sqldatasetapache-spark-dataset

Read More
spark data frame compare and show only values that are different...


dataframeapache-sparkapache-spark-sqlapache-spark-dataset

Read More
Create Spark Dataset from a CSV file...


apache-sparkapache-spark-dataset

Read More
FileNotFoundException: Spark save fails. Cannot clear cache from Dataset[T] avro...


apache-sparkcachingapache-spark-sqlapache-spark-datasetspark-avro

Read More
Which is better among RDD, Dataframe, Dataset for doing avro columnar operations in spark?...


dataframeapache-sparkapache-spark-sqlrddapache-spark-dataset

Read More
Convert Arrays into Spark DataSet in Scala...


arraysscalaapache-sparkapache-spark-dataset

Read More
scala spark dataframe modify column with udf return value...


scaladataframeapache-sparkuser-defined-functionsapache-spark-dataset

Read More
spark scala convert a nested dataframe to nested dataset...


scaladataframeapache-sparkapache-spark-dataset

Read More
Create new dataset from specific columns from 2 other datasets in scala...


scalaapache-sparkapache-spark-dataset

Read More
Spark dataset encoders: kryo() vs bean()...


apache-sparkapache-spark-datasetencoderkryo

Read More
"ValueArray is not declared" exception when using spark map functions on dataset containin...


apache-sparkapache-spark-dataset

Read More
Spark: How can DataFrame be Dataset[Row] if DataFrame's have a schema...


scalaapache-sparkapache-spark-sqlapache-spark-dataset

Read More
Avoiding duplicate coulmns after nullSafeJoin scala spark...


scalaapache-sparkapache-spark-dataset

Read More
Unable to collect spark dataset as list or map with No applicable constructor error...


apache-sparkapache-spark-dataset

Read More
Using the Apache Spark RDD map method (Java API) to produce a non-columnar result...


javaapache-sparkrddapache-spark-dataset

Read More
How to use approxQuantile by group?...


apache-sparkapache-spark-sqlapache-spark-dataset

Read More
Spark : How do I exploded data and add column name also in pyspark or scala spark?...


apache-sparkapache-spark-sqlapache-spark-dataset

Read More
Iterating rows of a Spark Dataset and applying operations in Java API...


javaapache-sparkapache-spark-dataset

Read More
Spark: object not serializable...


scalaapache-sparkspark-structured-streamingapache-spark-dataset

Read More
BackNext