0

As per Apache Spark documentation, to create DataSet we need to create case class in Scala. Instead of case class can we use use normal class because we can't create more than 32 fields in case class in Scala . In that case how can we create DataSet if we are concerned about Type-safe.

thebluephantom
  • 16,458
  • 8
  • 40
  • 83
Avinash Sreethalam
  • 23
  • 2
  • 2
    Might be helpful https://stackoverflow.com/questions/20258417/how-to-get-around-the-scala-case-class-limit-of-22-fields – olzhas Feb 16 '20 at 08:40
  • 2
    Does this answer your question? [How to create a DataSet with 29 columns in Spark](https://stackoverflow.com/questions/46341253/how-to-create-a-dataset-with-29-columns-in-spark) – Thilo Feb 16 '20 at 12:24
  • 2
    That limit was removed in Scala 2.11, which recent versions of Spark support as well. – Thilo Feb 16 '20 at 12:26

0 Answers0