Questions tagged [spark-thriftserver]

95 questions
0
votes
1 answer

apache thrift monitor a hdfs file

Im planning to use Apache Thrift to monitor any change on my local changes and push that data to the client(the changed data). When I check the thrift documentation Im seeing multiple transport layers but do not understand which transport layer…
user1050619
  • 19,822
  • 85
  • 237
  • 413
0
votes
1 answer

SPARK SQL CREATE VIEW

I have noticed that there seems to be some max length of the create view statement. Below is a SQL query I can run (select statement). If I put a create view in front, it works as long as I limit the columns in the sub-query. The view itself…
Jeremy S
  • 3
  • 1
  • 5
0
votes
1 answer

Spark 2.x using HiveThriftServer2 with sqlContext

My requirement is to enable ODBC/JDBC access to a SparkSQL temporary table, for which there was a DataFrame in Spark (mix of JSON-based and streaming). I made it working in Spark 1.6, and then recently upgraded to Spark to 2.1.1. I adjusted my code…
Roman
  • 238
  • 1
  • 14
0
votes
1 answer

Create external table from S3 on Spark Beeline

Made below change to /etc/dse/spark/hive-site.xml on each node in the 4 node cluster. fs.s3.awsAccessKeyId **** fs.s3.awsSecretAccessKey
1 2 3 4 5 6
7