Question as the title,I am learning sparkSQL,but I can't get a good understanding of the difference between them. Thanks.
Asked
Active
Viewed 9,669 times
1 Answers
7
There is no difference between spark.table
& spark.read.table
function.
Inside of spark.read.table
is again calling spark.table
function.
Check below code.
spark.table
It is available inside package org.apache.spark.sql.SparkSession
package org.apache.spark.sql.SparkSession
def table(tableName: String): DataFrame = {
table(sessionState.sqlParser.parseTableIdentifier(tableName))
}
spark.read.table
function is available in package org.apache.spark.sql.DataFrameReader
& It is again calling spark.table
function.
package org.apache.spark.sql.DataFrameReader
def table(tableName: String): DataFrame = {
assertNoSpecifiedSchema("table")
sparkSession.table(tableName)
}

Srinivas
- 8,957
- 2
- 12
- 26
-
1This is always why spark confuses me, many apis can do similar or even same things, making me lost and don't know why what's the difference and why – avocado Aug 18 '22 at 16:49