Questions tagged [pyathena]

Resources:

50 questions
0
votes
1 answer

Python athena query

How many queries can execute python athena in one secound.I'm using python pyathena library. athena_cursor = connect(aws_access_key_id=CREDENTIALS_DICTIONARY['AWS_ACCESS_KEY'], …
waruna k
  • 842
  • 10
  • 20
0
votes
1 answer

Why my PyAthena generate a csv and a csv meta data file in s3 location while reading a GLUE table?

I started to pull GLUE table via using pyathena since last week. However, one annoying thing I noticed that is if I wrote my code as shown below, sometimes it works and returns a pandas dataframe but other times, this piece of codes will create a…
ASU_TY
  • 617
  • 2
  • 7
  • 12
0
votes
0 answers

How to pivot rows into columns in Athena when you dont have the entire list of values or if the list is too long

Like below in amazon Athena. DATA ID , CODE a , 123 b , 345 a , 123 a , 345 c , 246 d , 678 Grouped Data I have grouped above data with ID and CODE to get the frequency/count of the combination as below. ID , CODE ,FREQ a , 123 , 2 a ,…
Pavan
  • 1
  • 3
0
votes
1 answer

athena create table using python

All: On trying to create external table using pyathenajdbc with python, it had error as: def create_tbl(self): #res = None full_s3_abs_path = self.check_files() conn_db = self.conn() #try: with conn_db.cursor() as…
Sridhar
  • 19
  • 7
-1
votes
1 answer

SYNTAX_ERROR: '"LastName"' must be an aggregate expression or appear in GROUP BY clause

I have a two tables, main_table & staging_table, main_table contains original data whereas staging_table contains the few of the updated records that I have to add into with main_table data, and for that I am using unique id -PersonID and arrival…
The Joker
  • 204
  • 1
  • 5
  • 22
1 2 3
4