I'm trying to get the schema from the Glue catalog in AWS Glue studio but the job keeps running and not returning. This is the code:
from pyspark.context import SparkContext
from awsglue.context import GlueContext
from awsglue.dynamicframe import DynamicFrame
sc = SparkContext()
glueContext = GlueContext(sc)
df_s3= glueContext.create_dynamic_frame.from_catalog(database = "mydb", table_name = "myfile")
It keeps running for over 30 min. Any suggestions?