Treasure Data is a Hadoop-based Big Data as-a-Service service.
Questions tagged [treasure-data]
16 questions
4
votes
1 answer
UNION ALL / UNION on Presto
I am using treasure data for data analytics and having trouble with union statement in presto db.
How do i do a Union All on presto. I dont understand the documentation. everytime I try to do UNION like so:
SELECT
COUNT(*) AS…
Javier
- 249
- 1
- 6
- 16
3
votes
1 answer
td-agent2 shows warning: WARN: Unresolved specs during Gem::Specification.reset: json (>= 1.4.3)
td-agent2 shows warning below:
# sudo /opt/td-agent/embedded/bin/fluent-gem list
WARN: Unresolved specs during Gem::Specification.reset:
json (>= 1.4.3)
WARN: Clearing out unresolved specs.
Please report a bug if this causes…
Matt - sanemat
- 5,418
- 8
- 37
- 41
1
vote
1 answer
SQL and Snowflake, create a sequence of dates from -182 days from time t to 40 days after time t, and then attach columns to those returned rows
Currently in the old system we have, the code generates a sequence of dates, and then that sequence is joined against the inner query it's created from. What this ends up with (the eventual result), is a table that returns information about a…
1
vote
2 answers
How to send logs from Log4J to Fluentd editind lo4j.properties
I'm have a fluentd setup currently using TCP as a source to receive some logs, it's working fine. Now I need to set up another application that uses Log4J, but i musnt change the source code, only the config files. How can I setup log4j.properties…
Thiago Casa Nova
- 208
- 1
- 4
- 14
1
vote
1 answer
Why is urllib3/idna complaining about a wildcard in an X509 cert? How do I fix it?
I'm running under a virtual env with the following:
setuptools==26.1.1
td-client==0.5.0
urllib3[secure]==1.17
Using urllib3 due to a SNIMissingWarning if I don't use it:
http://urllib3.readthedocs.io/en/latest/user-guide.html#ssl-py2
I also have…
Marc Swingler
- 181
- 10
1
vote
1 answer
Driver manager not using the correct driver for the DB url
I have a java application which is able create a connection to multiple DB.
We are loading these drivers:
Class.forName("org.mariadb.jdbc.Driver");
Class.forName("com.treasure_data.jdbc.TreasureDataDriver");
When I try to connect to aurora DB I…
2Big2BeSmall
- 1,348
- 3
- 20
- 40
1
vote
1 answer
SQL query that gives me the count of records with unique column value in table
I am new to SQL and learning some basic things with Treasure Data. I have many records of reservation in a table with 11 distinct resource values that users can reserve.
This gives me the resources in a table:
SELECT
DISTINCT resource
FROM
…
james
- 519
- 3
- 10
- 19
0
votes
1 answer
Trying to compare a list of emails in TreasureData with a list of emails in DBeaver to find missing emails
I have lists of emails from DBeaver and the same lists from TreasureData but with some emails missing.
My task is to compare the lists to find out which emails are missing from the corresponding list but I am not sure how to go about doing so.
I…
JPA
- 1
0
votes
1 answer
Can I validate that a string is a valid date in Presto
I would like to check if a sales_date field is a valid date before trying to parse out the month in a select query:
Right now, I am doing this: and the query errors out if the sales_date is not a valid date
SELECT CAST(YEAR(DATE(sales_date)) from…
DShultz
- 4,381
- 3
- 30
- 46
0
votes
2 answers
Why is ORDER BY not working in a Presto query?
I have a fairly simple Presto query, that is not ORDERing by the column I specified:
(SELECT
tag_monitor_domains.property_name,
count(*) as HourCount
FROM pageviews
INNER JOIN tag_monitor_domains
ON pageviews.property_id =…
DShultz
- 4,381
- 3
- 30
- 46
0
votes
0 answers
How do I get result from treasure data query into pandas dataframe?
I have some trouble loading result of query in treasure data to pandas dataframe. What I tried so far:
import pytd.pandas_td as td
engine = td.create_engine('presto:dbname')
df = td.read_td(['SELECT * FROM shop_items'], engine, index_col='time',…
Duniel Lundu
- 1
- 1
0
votes
1 answer
Install td-agent (treasure data fluentd) on ubuntu 16.04
From http://docs.fluentd.org/v0.12/articles/install-by-deb, I can only find the instructions to install td-agent 2.3.5 where as I need to install td-agent 2.3.4 as there are some plugins which I needed tested only on 2.3.4.
I looked at the sources…
GMS
- 16
- 4
0
votes
1 answer
How to build my own rpm file via omnibus, for example td-agent rpm
What I'd like to do:
I'd like to run two versions of td-agent on CentOS 7.x.
So, I'd like to register both default td-agent and td-agent-my-own in my yum repo server.
And, for that, I'd like to create my own rpm file of td-agent;…
wiz
- 2,887
- 5
- 18
- 18
0
votes
1 answer
Query Treasure Data DB with simple Java client code
i have tried to create a simple select count query:
Treasure data Guide
Properties props = new Properties();
props.setProperty("user", "someUser");
props.setProperty("password", "password1");
// Alternatively, you can use API key…
2Big2BeSmall
- 1,348
- 3
- 20
- 40
0
votes
0 answers
SQL querying on separate parts of a timestamp
I have a reservations table that has the resource reserved and a timestamp attached to each reservation.
reservation_table
resource | timestamp
I want to be able to break down the utilization of each resource on a per month, per hour, per…
Javier
- 249
- 1
- 6
- 16