Files
craft-libs/crates/csv
aiongg ac3dfd1f53 Merge storytold main into next (17 Nov sync)
storytold main 83cb1133dd (291 commits) into the integration head bab1a99b85; 47 conflicted files.

- Domain test files (metafile, prepress, pdf plates, settings store, heif, media-testkit, atomic): tests next cut stay cut; tests new on main are kept, as trials where the crate's test target runs trials.
- atomic: main's group-bits test and Faulty::set_group go to src/tests.rs. audio: main's GSM and SBC oracles join tests/main.rs. cms constructors, pdf knockout_backdrop and testing_pdf join their crates' one test binary; timeline's preflight tests become src/preflight_tests.rs trials.
- update: main's changes to detect, install (linux, macos) and the tests land in next's split modules. The app's own offer is inspected on a thread of its own, picked up by tick's polling; settle_for_tests settles offers too. Later on a ready update drops the close it asked for. updater_pin_tests.rs stays deleted; its new pin test is in tests/it/update.rs.
- craft-color: main added a different crate at crates/color (the colour tags of compositor and display frames); it is next's craft-color module `tags`, re-exported at the root.
- Old crates/ui (combo, docking, testing, README) and keymap's ui/view.rs stay deleted; main's new crates/ui/src/testing files are dropped with them.
- New crates in the craft facade: ai, control, dds, frame, ipc, media-source, palette, press-print, score, ssip. testkit and xtask are listed outside it.
- Cargo.lock: the union of both locks, resolved by cargo metadata. Workflow: main's nextest Windows leg, with next's --keep-going clippy.
2026-11-17 12:44:52 +00:00
..

craft-csv

Delimited text (CSV, TSV and their relatives) and SYLK (.slk). No unsafe; the only dependency is thiserror.

Fields are text. Reading a field as a number or a date, deciding how a value is written, and mapping a SYLK sheet onto a document are the caller's work.

Delimited text

Function What it does
decode_text(bytes) UTF-8 and UTF-16 byte order marks; without one, valid UTF-8 is kept; other bytes are Windows-1256 when they read as Arabic, else Windows-1252
sniff_delimiter(text, quote) comma, semicolon or tab: the one with the most consistent field count over the first 20 non-blank records in a 64 KiB sample; when no candidate finds coherent complete records with a delimiter in each, a candidate that finds no complete record counts the delimiters of the first record up to the end of the sample, or up to a quoted field still open there, and a quote inside a field that does not start with one makes that record incoherent; quote boundaries must be coherent, and ties prefer tab, comma, then semicolon
parse_records(text, delim, quote, max_fields, on_record) records of fields, one callback per record (return false to stop); CR, LF and CRLF line ends; quoted fields with doubled quotes and line breaks; a quote in the middle of a field is text
records(text, delim, quote, max_records, max_fields) the same, collected
push_field(out, field, delim), field_len(field, delim) one field as written, quoted only when it holds the delimiter, a quote or a line break; its exact length, to enforce a size cap before writing

max_fields bounds what one record keeps, so a row of endless delimiters cannot allocate a string per field. The delimiter between fields and the line end are the writer's own.

SYLK

sylk::read(bytes) gives a sylk::Sheet: cells by (row, column) with a value, the formula in A1 notation (the file's R1C1 text with its references rewritten, not checked for syntax) and the number format code; column widths in characters; and the number of cell records skipped because their position is outside the grid. sylk::r1c1_formula_to_a1 is the rewrite on its own.

Files over 512 MB are refused, positions outside 1,048,576 rows by 16,384 columns are skipped, and at most 1,024 column-width records are kept.

Origin

Moved from GridCraft: crates/xlsx/src/csv.rs (decoding, sniffing, the record parser and the quoting of its writer) and crates/engine/src/io/sylk.rs, at 5cf52c5f. GridCraft keeps the parts that depend on its model: typed values and dates from fields, and the sheet it builds.