Mark Gregory
b1bce0c166
Previously, the progress bar updated only after completing an entire table. For large tables such as LIBARC, this could make the application appear to have stopped responding. Phase 10 updates the interface while rows are being exported.
735 B
735 B
Phase 11 — Streaming SQL import
- Reads SQL dumps in 64 KiB file chunks, buffering only a line and the current SQL statement.
- Supports DELIMITER directives, SQL quoting, line/block comments and routine bodies.
- Reports statement number and starting line on SQL execution errors.
- Reports approximate byte progress and allows cancellation between statements.
- Verifies SHA-256 sidecar before import if present.
Limitations
- A single huge SQL statement or line is still buffered in memory.
- Import is nontransactional and cancellation can leave partial changes.
- Parser assumes UTF-8 input and standard MySQL SQL mode (not NO_BACKSLASH_ESCAPES).
- This has not been built with Xcode or integration-tested against MySQL.