What is log ingestion?¶
Log ingestion is the process by which a monitoring, analytics or security platform receives and accepts log data into its own system.
It is the point at which source records become available for storage, parsing, searching or correlation.
Avoid this assumption: That ingestion time is the same as the time the underlying activity occurred. It often is not.
An event may be created on a device, wait in a local file, pass through a collector and then be ingested by a central platform. Each stage can introduce delay.
During ingestion, the platform may parse the event, add metadata, reject malformed records, remove duplicates or route different events to different storage locations. Some events may be accepted immediately; others may be queued or processed later.
Ingestion records can help show when the destination platform received the data. They can also reveal collection delays, outages and backlogs.
But ingestion does not prove the source event was accurate. It only shows that the platform accepted a record purporting to come from a source. The source clock, event content and collection path still need to be considered.
Investigators should identify the source timestamp, collector timestamp and ingestion timestamp separately. Ask whether the platform records all three and which one appears by default in the dashboard.
Where sequence matters, sort and compare events using the appropriate field. A sudden group of events with old source times but similar ingestion times may indicate delayed delivery rather than simultaneous activity.
Preserve ingestion metadata where it helps explain gaps or timing differences.
Operational takeaway¶
Log ingestion records when a destination platform received data, not necessarily when the underlying event occurred, so source and ingestion times must not be treated as interchangeable.