7

Question as the title,I am learning sparkSQL,but I can't get a good understanding of the difference between them. Thanks.

thebluephantom
  • 16,458
  • 8
  • 40
  • 83
Sean
  • 87
  • 1
  • 6

1 Answers1

7

There is no difference between spark.table & spark.read.table function.

Inside of spark.read.table is again calling spark.table function.

Check below code.

spark.table It is available inside package org.apache.spark.sql.SparkSession

SparkSession

package org.apache.spark.sql.SparkSession

def table(tableName: String): DataFrame = {
  table(sessionState.sqlParser.parseTableIdentifier(tableName))
}

spark.read.table function is available in package org.apache.spark.sql.DataFrameReader & It is again calling spark.table function.

DataFrameReader

package org.apache.spark.sql.DataFrameReader

def table(tableName: String): DataFrame = {
   assertNoSpecifiedSchema("table")
   sparkSession.table(tableName)
}
Srinivas
  • 8,957
  • 2
  • 12
  • 26
  • 1
    This is always why spark confuses me, many apis can do similar or even same things, making me lost and don't know why what's the difference and why – avocado Aug 18 '22 at 16:49