storytold main 83cb1133dd (291 commits) into the integration head bab1a99b85; 47 conflicted files.
- Domain test files (metafile, prepress, pdf plates, settings store, heif, media-testkit, atomic): tests next cut stay cut; tests new on main are kept, as trials where the crate's test target runs trials.
- atomic: main's group-bits test and Faulty::set_group go to src/tests.rs. audio: main's GSM and SBC oracles join tests/main.rs. cms constructors, pdf knockout_backdrop and testing_pdf join their crates' one test binary; timeline's preflight tests become src/preflight_tests.rs trials.
- update: main's changes to detect, install (linux, macos) and the tests land in next's split modules. The app's own offer is inspected on a thread of its own, picked up by tick's polling; settle_for_tests settles offers too. Later on a ready update drops the close it asked for. updater_pin_tests.rs stays deleted; its new pin test is in tests/it/update.rs.
- craft-color: main added a different crate at crates/color (the colour tags of compositor and display frames); it is next's craft-color module `tags`, re-exported at the root.
- Old crates/ui (combo, docking, testing, README) and keymap's ui/view.rs stay deleted; main's new crates/ui/src/testing files are dropped with them.
- New crates in the craft facade: ai, control, dds, frame, ipc, media-source, palette, press-print, score, ssip. testkit and xtask are listed outside it.
- Cargo.lock: the union of both locks, resolved by cargo metadata. Workflow: main's nextest Windows leg, with next's --keep-going clippy.
craft-csv
Delimited text (CSV, TSV and their relatives) and SYLK (.slk). No unsafe; the only
dependency is thiserror.
Fields are text. Reading a field as a number or a date, deciding how a value is written, and mapping a SYLK sheet onto a document are the caller's work.
Delimited text
| Function | What it does |
|---|---|
decode_text(bytes) |
UTF-8 and UTF-16 byte order marks; without one, valid UTF-8 is kept; other bytes are Windows-1256 when they read as Arabic, else Windows-1252 |
sniff_delimiter(text, quote) |
comma, semicolon or tab: the one with the most consistent field count over the first 20 non-blank records in a 64 KiB sample; when no candidate finds coherent complete records with a delimiter in each, a candidate that finds no complete record counts the delimiters of the first record up to the end of the sample, or up to a quoted field still open there, and a quote inside a field that does not start with one makes that record incoherent; quote boundaries must be coherent, and ties prefer tab, comma, then semicolon |
parse_records(text, delim, quote, max_fields, on_record) |
records of fields, one callback per record (return false to stop); CR, LF and CRLF line ends; quoted fields with doubled quotes and line breaks; a quote in the middle of a field is text |
records(text, delim, quote, max_records, max_fields) |
the same, collected |
push_field(out, field, delim), field_len(field, delim) |
one field as written, quoted only when it holds the delimiter, a quote or a line break; its exact length, to enforce a size cap before writing |
max_fields bounds what one record keeps, so a row of endless delimiters cannot allocate a
string per field. The delimiter between fields and the line end are the writer's own.
SYLK
sylk::read(bytes) gives a sylk::Sheet: cells by (row, column) with a value, the formula in A1
notation (the file's R1C1 text with its references rewritten, not checked for syntax) and the
number format code; column widths in characters; and the number of cell records skipped because
their position is outside the grid. sylk::r1c1_formula_to_a1 is the rewrite on its own.
Files over 512 MB are refused, positions outside 1,048,576 rows by 16,384 columns are skipped, and at most 1,024 column-width records are kept.
Origin
Moved from GridCraft: crates/xlsx/src/csv.rs (decoding, sniffing, the record parser and the
quoting of its writer) and crates/engine/src/io/sylk.rs, at 5cf52c5f. GridCraft keeps the
parts that depend on its model: typed values and dates from fields, and the sheet it builds.