Pig script not working using Amazon EMR

Question

I cannot get this script to work:

raw = LOAD 's3://xxxxxxxxx/*' AS (name:chararray, year:float, occurrences:float, books:float);
B = GROUP raw BY name;
C = FOREACH B GENERATE B.name, (SUM(B.occurrences) / SUM(B.books)) AS average;
D = ORDER C BY average DESC;
E = LIMIT D 10;
STORE E INTO 's3://xxxxxx';

what is the problem you faced – Sravan K Reddy Mar 28 '15 at 03:26 — Sravan K Reddy, Mar 28 '15 at 03:26

score 0 · Answer 1 · answered Mar 28 '15 at 05:19

The statement C is not right, you can't access the variable name,occurrences and books using Relation B. This should be accessible only by relation raw. Can you change your stmt C something like this?

C = FOREACH B GENERATE group, SUM(raw.occurrences)/SUM(raw.books) AS average;

here group refer to variable name

If you face any other issues, please paste your error logs.

Pig script not working using Amazon EMR

1 Answers1