Clean and validate messy CSV uploads before they hit your database

flowchart TD trig>"CSV file uploaded"]:::trig s0["detect and fix formatting"]:::task s1[["validate each row"]]:::mi s2[("save valid rows to database")]:::store trig --> s0 s0 -->|"one per each row in the file"| s1 gx{"× is the row valid"}:::gate s1 --> gx p00["save to database"]:::task gx -->|"valid rows"| p00 p10["log error and alert"]:::task gx -->|"invalid rows"| p10 p00 --> s2 p10 --> s2 out[/"clean records with error log"/]:::out pay{{"reliable data without manual review"}}:::pay s2 --> out out --> pay s1 -. "failures recorded, run continues" .-> out classDef task fill:#e7f6fe,stroke:#34b8f0,color:#2c2a29 classDef svc fill:#f6f8fa,stroke:#7c8795,color:#2c2a29 classDef mi fill:#e7f6fe,stroke:#0079a8,color:#2c2a29,stroke-width:2px classDef human fill:#fff,stroke:#0079a8,color:#0079a8 classDef store fill:#f6f8fa,stroke:#0079a8,color:#2c2a29 classDef trig fill:#00a4eb,stroke:#0079a8,color:#fff,font-weight:bold classDef trigtime fill:#00a4eb,stroke:#0079a8,color:#fff,font-weight:bold classDef trigdata fill:#8ad4f5,stroke:#0079a8,color:#06314c,font-weight:bold classDef gate fill:#fff,stroke:#e8a23d,color:#6b4708,font-weight:bold classDef out fill:#1f9d6b,stroke:#167a53,color:#fff,font-weight:bold classDef pay fill:#06314c,stroke:#021f33,color:#fff