Questions tagged [netflow]

is a Cisco standard IP traffic reporting format, summarizing network sessions in terms of endpoints, port/protocol, bytes transferred, and other data.

NetFlow is a standard network session reporting format, developed by Cisco to summarize network communications between hosts. This data generally includes:

  • endpoint IP addresses, including the initiator
  • IP protocol (by IANA number)
  • port where applicable (generally only TCP or UDP)
  • bytes transferred according to direction

and other data. (A fuller listing can be found at the Wikipedia article on NetFlow)

A NetFlow exporter (which may include a router, switch, or other device; or a software exporter sniffing local traffic) maintains a list of tracked connections by analyzing the headers of packets visible to it. NetFlow does not require deep packet inspection; by default it summarizes only IP header and protocol header information. The exporting device periodically exports information on these connections to "collector" software, usually via UDP at the default port 2055. Such a collector may receive updates from multiple exporters on a push basis, with each datagram reporting identifying information for its exporter. Each datagram can include multiple sets of NetFlow sessions.

A number of free/OSS and commercial products are available to collect and analyze NetFlow data, as well as similar data sources such as sFlow and JFlow. Such products may support storage and search, monitoring for security purposes, traffic visualizations, network-based forensic procedures, or statistical analysis. For development, flowd is an open source flow collector implementation.

There are multiple versions of NetFlow, but NetFlow 5 and NetFlow 9 are the predominant ones. NetFlow 5 is a fixed format, with the same fields in the same position for every export. NetFlow 9 has a range of optional fields, some of which are vendor-specific. In order to decode a NetFlow 9 datagram, it is necessary to match the datagram to a numbered template (templates are exported in the datagram stream periodically). Each template will contain an in-order listing of the items to be found in NetFlow records exported according to that template. The NetFlow 9 standard is described in RFC 3954.

NetFlow 9 is the basis of the IPFIX standard, and has been adapted as the basis for formats such as NSEL (NetFlow Security Event Logging). Because IPFIX is built on NetFlow 9, libipfix may be useful to NetFlow developers.

101 questions
0
votes
1 answer

Is there a well established incremental algorithm to maintain a history of values with accumulation over specific time frames?

I have practically completed one, but wanted to compare mine with a well researched an possibly academic algorithm. There may be a library of statistical objects which either directly or in-combination solve my particular need. My system (which I…
Kind Contributor
  • 17,547
  • 6
  • 53
  • 70
0
votes
1 answer

NETFLOW PACKET VERSION 5 convert byte 24-27 to datetime

i have a plan to gather netflow packets(v5) come from a mikrotik router in c# app, i open a udp listener on the port which packets come and read the byte array, i split the packet byte array by looking at packet format caligare.com, as the packet…
ali
  • 1,023
  • 2
  • 14
  • 38
-1
votes
1 answer

what is bcount in network tuple received

I am trying to analyse network traffic received from fprobe. Sample tuples Im receiving are like this- { "bcount": 52, "protocol": 6, "Timestamp": "2017-11-15 12:07:20.049+0530", "etime": 1048514968, "daddr":…
Yogesh Jilhawar
  • 5,605
  • 8
  • 44
  • 59
-1
votes
1 answer

Can routers/servers/clients be identified in a netflow data export?

I am writing a thesis concerning the identification of patterns in a network traffic. The input file contains thousands of data lines, each providing information as timestamps, source and destination IP addresses, source and destination ports,…
-1
votes
1 answer

IPFIX/NetFlow v5 Duplicate ToS Flows

I've got a problem recently where my netflow Analyzer is reporting more than 100% utilization on an interface. Having looked at some of the packets in a pcap, I can see that some of the "flows" appear to be duplicate. You can see one example…
another_one
  • 356
  • 4
  • 13
-1
votes
1 answer

How to identify Application associated with a IP without DPI

I am getting a netflow traffic feed, I need to identify the application associated with the IP. Is there any kind of global database that I can use map the global IP with the application it is used to serve? Ex: IP A for Amazon Prime IP B for…
-1
votes
1 answer

Getting IP addresses from big nfcapd binary files

I need to get information about source IPs and destination IPs from nfcapd binary file. The problem is in file's size. I know that it is not desirable to open and read very large (more than 1 GB) files with io or os package. Here is my hacking and…
memu
  • 77
  • 1
  • 13
-1
votes
1 answer

HSQLDB sqllog error

I'm using Cisco Configuration Professional and I have some issues with the Netflow collector. After a series of attempts and guessing I restricted the problem to a database problem. In particular the collector is able to write in the database only…
-1
votes
1 answer

The router exports IPFIX data and templates from two different source id

I configure Netflow Flexible use IPFIX protocol on a Cisco ASR 1001-X router and receive IPFIX packet from it successfully. The router exports data-sets with an exporter (Observation Domain ID = 0) and template-sets with another exporter…
Foad Tahmasebi
  • 1,333
  • 4
  • 16
  • 33
-1
votes
2 answers

Using Python, how can I return a JSON file after performing functions on it and converting it to a dictionary?

I am currently working with netflow data in a json file. My job is to parse the json file and perform specific actions on the data within it. After doing so, I'm creating a new file and adding each new updated json object to it. What's happening is…
Ria
  • 1
  • 3
-1
votes
1 answer

Netflow gives absurd values in bps

I have been using netflow to collect n/w data and dumped it into my db. Netflow gives me NoOfBytes transfered as well as Traffic speed (bps). But, there seems to be inconsistency between this. My formula to calculate bps is : (NoOfBytes * 8) /…
unbesiegbar
  • 471
  • 2
  • 7
  • 19
1 2 3 4 5 6
7