These are the specifications for network flows format, used both internally and when exporting flows to Kafka.
This is the specification of the network flows format, used both internally and when exporting flows to Kafka.
The document is organized in two main categories: Labels and regular Fields. This distinction only matters when querying Loki. This is because Labels, unlike Fields, must be used in stream selectors.
If you are reading this specification as a reference for the Kafka export feature, you must treat all Labels and Fields as regular fields and ignore any distinctions between them that are specific to Loki.
Optional
SrcK8S_Namespace: string
Source namespace
Optional
DstK8S_Namespace: string
Destination namespace
Optional
SrcK8S_OwnerName: string
Source owner, such as Deployment, StatefulSet, etc.
Optional
DstK8S_OwnerName: string
Destination owner, such as Deployment, StatefulSet, etc.
FlowDirection: FlowDirection
(see the following section, Enumeration: FlowDirection)
Flow direction from the node observation point
Optional
_RecordType: RecordType
Type of record: 'flowLog' for regular flow logs, or 'allConnections', 'newConnection', 'heartbeat', 'endConnection' for conversation tracking
SrcAddr: string
Source IP address (ipv4 or ipv6)
DstAddr: string
Destination IP address (ipv4 or ipv6)
SrcMac: string
Source MAC address
DstMac: string
Destination MAC address
Optional
SrcK8S_Name: string
Name of the source matched Kubernetes object, such as Pod name, Service name, etc.
Optional
DstK8S_Name: string
Name of the destination matched Kubernetes object, such as Pod name, Service name, etc.
Optional
SrcK8S_Type: string
Kind of the source matched Kubernetes object, such as Pod, Service, etc.
Optional
DstK8S_Type: string
Kind of the destination matched Kubernetes object, such as Pod name, Service name, etc.
Optional
SrcPort: number
Source port
Optional
DstPort: number
Destination port
Optional
SrcK8S_OwnerType: string
Kind of the source Kubernetes owner, such as Deployment, StatefulSet, etc.
Optional
DstK8S_OwnerType: string
Kind of the destination Kubernetes owner, such as Deployment, StatefulSet, etc.
Optional
SrcK8S_HostIP: string
Source node IP
Optional
DstK8S_HostIP: string
Destination node IP
Optional
SrcK8S_HostName: string
Source node name
Optional
DstK8S_HostName: string
Destination node name
Proto: number
L4 protocol
Optional
Interface: string
Network interface
Optional
IfDirection: InterfaceDirection
(see the following section, Enumeration: InterfaceDirection)
Flow direction from the network interface observation point
Optional
Flags: number
TCP flags
Optional
Packets: number
Number of packets
Optional
Packets_AB: number
In conversation tracking, A to B packets counter per conversation
Optional
Packets_BA: number
In conversation tracking, B to A packets counter per conversation
Optional
Bytes: number
Number of bytes
Optional
Bytes_AB: number
In conversation tracking, A to B bytes counter per conversation
Optional
Bytes_BA: number
In conversation tracking, B to A bytes counter per conversation
Optional
IcmpType: number
ICMP type
Optional
IcmpCode: number
ICMP code
Optional
PktDropLatestState: string
Pkt TCP state for drops
Optional
PktDropLatestDropCause: string
Pkt cause for drops
Optional
PktDropLatestFlags: number
Pkt TCP flags for drops
Optional
PktDropPackets: number
Number of packets dropped by the kernel
Optional
PktDropPackets_AB: number
In conversation tracking, A to B packets dropped counter per conversation
Optional
PktDropPackets_BA: number
In conversation tracking, B to A packets dropped counter per conversation
Optional
PktDropBytes: number
Number of bytes dropped by the kernel
Optional
PktDropBytes_AB: number
In conversation tracking, A to B bytes dropped counter per conversation
Optional
PktDropBytes_BA: number
In conversation tracking, B to A bytes dropped counter per conversation
Optional
DnsId: number
DNS record id
Optional
DnsFlags: number
DNS flags for DNS record
Optional
DnsFlagsResponseCode: string
Parsed DNS header RCODEs name
Optional
DnsLatencyMs: number
Calculated time between response and request, in milliseconds
TimeFlowStartMs: number
Start timestamp of this flow, in milliseconds
TimeFlowEndMs: number
End timestamp of this flow, in milliseconds
TimeReceived: number
Timestamp when this flow was received and processed by the flow collector, in seconds
Optional
TimeFlowRttNs: number
Flow Round Trip Time (RTT) in nanoseconds
Optional
_HashId: string
In conversation tracking, the conversation identifier
Optional
_IsFirst: string
In conversation tracking, a flag identifying the first flow
Optional
numFlowLogs: number
In conversation tracking, a counter of flow logs per conversation