Stack Overflow
Stack Overflow

Questions tagged [td-agent]

Please use this tag for question regarding td-agent, a data collection daemon. https://support.treasuredata.com/hc/en-us/articles/360000687108-Overview-of-Server-Side-Agent-td-agent-

Arm Treasure Data provides Server-Side Agent called Treasure Agent (td-agent), to collect server-side logs and events. You can continuously import data using td-agent.

71 questions
0
votes
1 answer

Update mongo records with fluentd

We need to save our nodejs application logs as records at MongoDB. Most of the records we should create, but there are some records that needs only update. We want to use Fluentd. I see it has option to insert log to mongo, but I couldn't find a way…
user2503775
  • 4,267
  • 1
  • 23
  • 41
0
votes
1 answer

td-agent is unable to ship logs from file when the file contains a single multiline log

td-agent unable to ship logs from line when log file contains single multiline logs. The logs are not picked up by td-agent until a new line is added Installed td-agent on a windows machine. configured the td-agent.conf file to pick logs from a file…
Paras Bothra
  • 37
  • 7
0
votes
0 answers

Parser filter plugin not working Td-agent [Fluentd]

My environment for running fluentd using td-agent is below:- fluentd or td-agent version. td-agent 1.3.3 Environment information: Operating system: cat /etc/os-release NAME="Ubuntu" VERSION="16.04.5 LTS (Xenial…
iAviator
  • 1,310
  • 13
  • 31
0
votes
1 answer

td-agent fluentd fails to send messages to Kafka

I had a td-agent sending messages to a Kafka queue with no problem. But now I get the following error. I restarted the agent with no luck. I flushed the buffer manually with no luck. Any advice on what is happeing is welcome 2019-03-20 16:44:06…
Marcel
  • 21
  • 5
0
votes
2 answers

RPM install/uninstall deadlock

i'd have a problem: can't install package "TD-agent". Cause there are deadlock: If u try to install (sudo rpm -ivh /my/pass/td-agent-3.2.1-0.el7.x86_64.rpm) - u have an error: Preparing... #################################…
Antispam Antispam
  • 7
  • 6
0
votes
1 answer

No luck updating timestamp/time_key with log time in fluentd

I have a fluentd client which forwards logs to logstash and finally gets viewed through Kibana. I've tried several configurations to update timestamp to the time entry from log files. However, no luck in doing so. Here is my parse section of…
sj_24
  • 41
  • 2
  • 8
0
votes
1 answer

td-agent won't work on amazon linux 2

I'd like to know how to have td-agent read apache log files on Amazon linux2. It seems td-agent doesn't have permission to read log file but I cannot fix this. I installed amazon linux2 into virtualbox using…
Takumi
  • 1
  • 1
0
votes
2 answers

Syslog entries in Mongodb

When using the command db["my_collectionName"].find() in the mongo shell, my queries return: "message" : "Permission denied @ rb_sysopen - /var/log/syslog". How do I go about solving this permission issue?
AspEng
  • 11
  • 5
-1
votes
1 answer

How to fix uninitialized constant Fluent::TailInput (NameError)?

I use my custom fluentd plugin and it does not work with ubuntu20 but for other ubuntu version is no problem. Here is my error Traceback (most recent call last): 22: from /usr/sbin/td-agent:15:in `
' 21: from /usr/sbin/td-agent:15:in…
leanghy
  • 50
  • 6
-1
votes
1 answer

external command fails td-agent

This bash command "etcdctl get system config/log/timestamp" returns time type either UTC or System. Now i want to use this to convert time to same format. How can i do that? I tried this but it failed td-agent running. @type exec …
arun kushwaha
  • 36
  • 1
  • 6
-2
votes
1 answer

Index not found exception while sending data to Opensearch AWS using td agent

I have set up Opensearch in AWS. I have installed td-agent in Ubuntu 18.04. Below is my td-agent.conf file: @type tail path /home/rocket/PycharmProjects/EFK/log.json pos_file /home/rocket/PycharmProjects/EFK/log.json.pos format…
S Andrew
  • 5,592
  • 27
  • 115
  • 237
1 2 3 4
5