Questions tagged [netflow]

is a Cisco standard IP traffic reporting format, summarizing network sessions in terms of endpoints, port/protocol, bytes transferred, and other data.

NetFlow is a standard network session reporting format, developed by Cisco to summarize network communications between hosts. This data generally includes:

  • endpoint IP addresses, including the initiator
  • IP protocol (by IANA number)
  • port where applicable (generally only TCP or UDP)
  • bytes transferred according to direction

and other data. (A fuller listing can be found at the Wikipedia article on NetFlow)

A NetFlow exporter (which may include a router, switch, or other device; or a software exporter sniffing local traffic) maintains a list of tracked connections by analyzing the headers of packets visible to it. NetFlow does not require deep packet inspection; by default it summarizes only IP header and protocol header information. The exporting device periodically exports information on these connections to "collector" software, usually via UDP at the default port 2055. Such a collector may receive updates from multiple exporters on a push basis, with each datagram reporting identifying information for its exporter. Each datagram can include multiple sets of NetFlow sessions.

A number of free/OSS and commercial products are available to collect and analyze NetFlow data, as well as similar data sources such as sFlow and JFlow. Such products may support storage and search, monitoring for security purposes, traffic visualizations, network-based forensic procedures, or statistical analysis. For development, flowd is an open source flow collector implementation.

There are multiple versions of NetFlow, but NetFlow 5 and NetFlow 9 are the predominant ones. NetFlow 5 is a fixed format, with the same fields in the same position for every export. NetFlow 9 has a range of optional fields, some of which are vendor-specific. In order to decode a NetFlow 9 datagram, it is necessary to match the datagram to a numbered template (templates are exported in the datagram stream periodically). Each template will contain an in-order listing of the items to be found in NetFlow records exported according to that template. The NetFlow 9 standard is described in RFC 3954.

NetFlow 9 is the basis of the IPFIX standard, and has been adapted as the basis for formats such as NSEL (NetFlow Security Event Logging). Because IPFIX is built on NetFlow 9, libipfix may be useful to NetFlow developers.

101 questions
1
vote
1 answer

YAF terminating on error (couldn't create connected TCP socket)

I've installed and configured YAF (v. 2.8.4) + SiLK(v. 3.12.1) on Debian 8.2, and I faced with 2 problems: 1st. Every time I start yaf, as long as a TCP connection established, yaf process terminated with this error: [2016-05-25 08:13:36] yaf…
MrRolling
  • 2,145
  • 1
  • 24
  • 33
1
vote
1 answer

How to feed shell script output to kafka?

I am trying to feed some netflow data into kafka. I have some netflow.pcap files which I read like tcpdump -r netflow.pcap and get such an output: 14:48:40.823468 IP abts-kk-static-242.4.166.122.airtelbroadband.in.35467 >…
HackCode
  • 1,837
  • 6
  • 35
  • 66
1
vote
3 answers

can sflow work for monitoring ddos

I have a budget minded client who want to see when there is a ddos attack on the network so they can blackhole route the attack with a homespun tool. Currently they have devices exporting only sflow traffic. The sysadmin says that they need…
p0werus3r
  • 13
  • 4
1
vote
1 answer

What is the use of netflow templates

I am trying to understand netflow v9 & I have few doubts on netflow v9 1) how and why will templates change on a netflow router ? I undertsnad netflow v9 was created so that many different templates can be specified . But why would a person…
MAG
  • 2,841
  • 6
  • 27
  • 47
1
vote
2 answers

How to convert pcap file to nfcapd file

I have a pcap file of size 1.4 GB. I am trying to convert this file to nfcapd. But I cannot convert it. First of all, I typed nfcapd -p 12345 -l ./ Then the computer creates some nfcapd file continuously. I tried it 2 days ago and the computer…
1
vote
1 answer

Bash column altering

I have some data in columns, however some data is confusing my column numbers making bash opperations confusing, the data below is what I am working with (however there are over 1 million lines of). I am interested in the numbers in 8th and 9th…
user3770935
  • 298
  • 1
  • 3
  • 17
1
vote
1 answer

How to determine weather recently appeared strings in a file are new(unique) using perl?

Lets say I have this kind of file with internet flow information in it (file contains unlimited amount of strings): startTime sourceIP destinationIP 2015-03-31 08:47:27.671 10.0.26.48 10.0.26.255 2015-03-31…
1
vote
1 answer

Nfcapd to pcap conversion?

I've got few NetFlow dumps captured by nfcapd deamon. Is there any possibility to convert them to .pcap format so I can analyse ones with my software?
kozooh
  • 2,035
  • 1
  • 21
  • 31
1
vote
1 answer

How can I find out what NetFlow version my nfcapd is capturing?

What version are my NetFlows? I have an appliance that is exporting NetFlow to my NetFlow collector. My collector is collecting with nfcapd. The only information I can find is that nfcapd will capture different NetFlow versions "transparently". My…
harperville
  • 6,921
  • 8
  • 28
  • 36
1
vote
1 answer

Timestamps on netflow

I'm having a problem where I'm using a product called netflow, which reads network flow data. When I read some of the netflow data captured, the timestamps on the network flows aren't in milliseconds. I've showed a line of the data below; Date flow…
Shane
  • 461
  • 2
  • 8
  • 23
1
vote
2 answers

Cisco Netflow with nfdump

I've been using nfdump to read netflow data from my router but my problem is that the flow duration field is measured in milliseconds. I'd like for this to me measured in micro or nanoseconds if possible. Does anyone know anything about nfdump or…
Shane
  • 461
  • 2
  • 8
  • 23
1
vote
1 answer

what exactly is 'flow' in nfdump? can i get tcp sessions with nfdump?

i need to create some statistics from packets in my network interface, but i'm concerned only for my tcp sessions. i thought i could do that with nfdump and nfsen. because i'm new to this stuff, i dont really get what nfdump defines as…
1
vote
1 answer

Incorrect field id in netflow v9

While analyzing Netflow V9, I am able to get most of the fields ids correctly along with their values as that is defined in http://www.iana.org/assignments/ipfix/ipfix.xml but I am getting 40000 ,40001, 40002, ... instead of 224, 225, 226, ...…
Zangetsu
  • 1,900
  • 17
  • 25
0
votes
2 answers

How do I include flow-tools in a C++ program?

In our C++ program we want to process NetFlow data. The only tool for doing this that we've found is flow-tools, which we've installed and are running perfectly from the command line (Linux). flow-tools is written in c, therefore we thought it might…
andersem
  • 724
  • 1
  • 8
  • 19
0
votes
2 answers

Packet profile from netflow

I have netflow data from previous month in files per 5 minutes and I would like to do a packet profile of all this traffic. I need percentage representation of 1 packet flows, 2 packet flows etc. It is possible to do it in categories like 1 packet…
matejuh
  • 396
  • 4
  • 13