Questions tagged [netflow]

is a Cisco standard IP traffic reporting format, summarizing network sessions in terms of endpoints, port/protocol, bytes transferred, and other data.

NetFlow is a standard network session reporting format, developed by Cisco to summarize network communications between hosts. This data generally includes:

  • endpoint IP addresses, including the initiator
  • IP protocol (by IANA number)
  • port where applicable (generally only TCP or UDP)
  • bytes transferred according to direction

and other data. (A fuller listing can be found at the Wikipedia article on NetFlow)

A NetFlow exporter (which may include a router, switch, or other device; or a software exporter sniffing local traffic) maintains a list of tracked connections by analyzing the headers of packets visible to it. NetFlow does not require deep packet inspection; by default it summarizes only IP header and protocol header information. The exporting device periodically exports information on these connections to "collector" software, usually via UDP at the default port 2055. Such a collector may receive updates from multiple exporters on a push basis, with each datagram reporting identifying information for its exporter. Each datagram can include multiple sets of NetFlow sessions.

A number of free/OSS and commercial products are available to collect and analyze NetFlow data, as well as similar data sources such as sFlow and JFlow. Such products may support storage and search, monitoring for security purposes, traffic visualizations, network-based forensic procedures, or statistical analysis. For development, flowd is an open source flow collector implementation.

There are multiple versions of NetFlow, but NetFlow 5 and NetFlow 9 are the predominant ones. NetFlow 5 is a fixed format, with the same fields in the same position for every export. NetFlow 9 has a range of optional fields, some of which are vendor-specific. In order to decode a NetFlow 9 datagram, it is necessary to match the datagram to a numbered template (templates are exported in the datagram stream periodically). Each template will contain an in-order listing of the items to be found in NetFlow records exported according to that template. The NetFlow 9 standard is described in RFC 3954.

NetFlow 9 is the basis of the IPFIX standard, and has been adapted as the basis for formats such as NSEL (NetFlow Security Event Logging). Because IPFIX is built on NetFlow 9, libipfix may be useful to NetFlow developers.

101 questions
0
votes
1 answer

Synthesizing Packets with Scapy

Today, I was handed a 300 million entry csv file of netflow records, and my objective is to convert the netflow data to synthesized packets by any means necessary. After a bit of researching, I've decided Scapy would be an incredible tool for this…
NolanRudolph
  • 106
  • 11
0
votes
1 answer

What is the structure of the binary files produced by nfcapd (one of the nfdump tools)?

I want to split files produced by nfcapd (a netflow producing daemon) into multiple files, because the file initially produced by nfcapd might be too big. My problem is that I have no idea what the structure of the files produced are, I suppose…
Robin Louis
  • 141
  • 4
0
votes
0 answers

Debian - port redirect

I have device, that sends some RAW data (NetFlow v9). I can set only IP adress and PORT of "data collector". For Example 192.168.0.10:8080. Is it some simple solution at Debian to redirect this to specific php script on common webserver port (:80),…
Voju
  • 116
  • 2
0
votes
1 answer

Decode raw Netflow Data to human readable text in Python

I manage to collect some raw Netflow Data and with the usuage of scapy to decode my packets to Netflow version 9. However, I am stuck and unable to move on to convert the field values to human readable text. The code below is how I view the data…
z.yea
  • 73
  • 1
  • 7
0
votes
1 answer

Is a netflow record equal to a session?

Because I don't very understand a session definition in network I have a puzzle that whether a netflow record equal to a session? If I upload some files to the server through FTP at a time, and there produce 50 netflow records(same source and…
張皓翔
  • 341
  • 1
  • 4
  • 16
0
votes
1 answer

Decode UDP Packet to Netflow

I've come across the Wireshark decode as feature where I can decode UDP packet as CFLOW to get my Netflow data. Is it possible to code a script that decode the UDP Packet and get the Netflow data? Currently I am trying it out using python3-scapy.…
z.yea
  • 73
  • 1
  • 7
0
votes
1 answer

lots of erros while executing step "configure && make && make install"

I am trying to install f2k in my ubuntu14 machine by cloning the git repo and executing the the step "./configure && make && make install". However, I'm getting lots of "no such header file errors". Please find below the snippet that I got after…
Yogesh Jilhawar
  • 5,605
  • 8
  • 44
  • 59
0
votes
1 answer

Anyone please do have Netflow data using nfdump in csv file?

I had collected data using tcpdump but i want data from nfdump as a csv file.
0
votes
1 answer

Nfsen install issue

Does someone else have issues with nfsen installation on CentOS 6.7? Every package needed is installed but I still have an error: [root@eog nfsen-1.3.8]# ./install.pl etc/nfsen.conf Check for required Perl modules: All modules found. Setup…
Ajdin
  • 9
  • 3
0
votes
1 answer

Can a Mobile Operator use Netflow same as used by a WireLine Operator

Can a Mobile Operator use Netflow same as used by a WireLine Operator to gain insights in to subscriber behavior. The reason I am asking this question is because the network typologies are very different.
0
votes
1 answer

real time anomaly detection packages

Is anyone aware of any open source codes for Netflow Anomaly detection for DDOS and tunneling? I am a newbie in this area . I did find very few on github but anyone who has more experience with it, do advise. Just want to try a few to understand…
venu
  • 1
0
votes
1 answer

wrong times tamps in netflow data generated by ESXi

I have a problem in "Date first seen" column in the result generated by nfdump. I have enabled netflow on an ESXi 5.5 to send netflow data to a netflow server. up to now everything is OK and I can capture netflow data with nfcapd with the following…
Sinai
  • 620
  • 1
  • 14
  • 36
0
votes
0 answers

Collect network operation data with logstash in Windows

I am trying to get network operation data from my localhost. I know packetbeat can do some of the jobs. However, I would like to collect data with logstash but my configuration didn't output anything. Is there anyone who can give me some…
Kennedy Kan
  • 273
  • 1
  • 7
  • 20
0
votes
1 answer

NfDump What is the meaning of obyt?

According to the documentation i've found for NfDump, obyt is the number of output byte. What does it means ? In all my data, obyt is equal to 0 . Does it means that all the packet are dropped ?
CharybdeBE
  • 1,791
  • 1
  • 20
  • 35
0
votes
1 answer

how to find my netflow data version number?

Is there any option to know the version number of my netflow data. I have pcap file generated using tcpdump. Then using some opensource (which depends on tshark) I converted the pcap data into netflow. I am not able to find out which version of…
RG1
  • 105
  • 1
  • 1
  • 11