eghuro/log_ingest
1
0
Fork 0
Code Pull Requests Releases Activity
Files
feature/search
log_ingest/Cargo.toml

17 lines
328 B
TOML
Raw Permalink Normal View History

Add log ingestion tool for loading signature logs into SQLite - Parse signature messages from log files extracting app info, device details, and feature flags (autofill, touchID, offline login, etc.) - Support both plain .log and gzip compressed .log.gz files - File discovery by date range (YYYY/mm/dd directory structure) - Batch inserts for performance with large files (10GB+ per day) - Index on session_id and version for efficient queries - Extensible parser architecture via MessageParser trait - Parallel file processing for multi-day ingestion Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-21 22:34:48 +01:00
[package]
name = "log_ingest"
Bump version
2026-02-20 22:29:23 +01:00
version = "0.0.2"
Add log ingestion tool for loading signature logs into SQLite - Parse signature messages from log files extracting app info, device details, and feature flags (autofill, touchID, offline login, etc.) - Support both plain .log and gzip compressed .log.gz files - File discovery by date range (YYYY/mm/dd directory structure) - Batch inserts for performance with large files (10GB+ per day) - Index on session_id and version for efficient queries - Extensible parser architecture via MessageParser trait - Parallel file processing for multi-day ingestion Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
2026-01-21 22:34:48 +01:00
authors = ["Alexandr Mansurov"]
edition = "2024"
[dependencies]
clap = { version = "4.5.42", features = ["derive"] }
rusqlite = { version = "0.35", features = ["bundled"] }
chrono = "0.4"
regex = "1"
flate2 = "1"
anyhow = "1"
rayon = "1"
crossbeam-channel = "0.5"
Expansion
2026-02-20 21:14:41 +01:00
tempfile = "3"
Copy Permalink