Split out of #762, which #780 otherwise finishes. Numbers are against #780.
odr-private/ods/efficiency-big-1.ods decodes into 3.16M registry elements for
1.05M cells: parse_sheet creates a sheet_cell element and then
parse_any_element_children builds a paragraph and a text for the cell's
<text:p>Genius</text:p>. Every row of that file is the same three cells and the
rows are not number-rows-repeated-compressed, so each one is distinct and
none of the collapsing added in #776 applies.
Empty cells already cost nothing — is_cell_empty registers a range entry with a
null element id and no element at all — and since #776 a repeated cell with
content is one entry too. This is the remaining case: a distinct non-empty
cell, expanded eagerly.
What it costs
Per cell, after #780:
|
|
sheet_cell, paragraph, text elements |
3 x 32 B |
m_sheet_cells entry (position + repeated flag) |
16 B |
m_texts entry (the run's last node) |
16 B |
sheet index Cell (range end, element id, node) |
16 B |
|
144 B |
which is ~150 MB of the 626 MB peak on that file. Making the children lazy is
worth the paragraph, the text and the m_texts entry — ~85 MB — and leaves
~68 MB for the cells themselves.
HtmlConfig::spreadsheet_limit and spreadsheet_cell_limit do not bound any of
it: they are applied in sheet_rendered_extent (internal/html/document_element.cpp),
long after odf::Document's constructor has built the whole tree. A 100-row,
2000-cell budget costs exactly as much as the default one.
Options
- Lazy children.
ElementRegistry::Sheet::Cell already holds the
pugi::xml_node, so a cell's children can be built on first access. The
registry is a pre-built tree today and traversal is const, so this needs an
on-demand builder and a decision about what an element id means before its
element exists.
- Bound the parse. Let the cell budget reach decode time so the parser stops
registering content past it. Cheaper, but it makes the model depend on the
render config, which the architecture deliberately keeps apart.
The first is the one that generalises: it is the same lifetime question a
streaming decode asks (see the sibling issue), so it is worth doing first and
learning from cheaply.
Split out of #762, which #780 otherwise finishes. Numbers are against #780.
odr-private/ods/efficiency-big-1.odsdecodes into 3.16M registry elements for1.05M cells:
parse_sheetcreates asheet_cellelement and thenparse_any_element_childrenbuilds a paragraph and a text for the cell's<text:p>Genius</text:p>. Every row of that file is the same three cells and therows are not
number-rows-repeated-compressed, so each one is distinct andnone of the collapsing added in #776 applies.
Empty cells already cost nothing —
is_cell_emptyregisters a range entry with anull element id and no element at all — and since #776 a repeated cell with
content is one entry too. This is the remaining case: a distinct non-empty
cell, expanded eagerly.
What it costs
Per cell, after #780:
sheet_cell, paragraph, text elementsm_sheet_cellsentry (position + repeated flag)m_textsentry (the run's last node)Cell(range end, element id, node)which is ~150 MB of the 626 MB peak on that file. Making the children lazy is
worth the paragraph, the text and the
m_textsentry — ~85 MB — and leaves~68 MB for the cells themselves.
HtmlConfig::spreadsheet_limitandspreadsheet_cell_limitdo not bound any ofit: they are applied in
sheet_rendered_extent(internal/html/document_element.cpp),long after
odf::Document's constructor has built the whole tree. A 100-row,2000-cell budget costs exactly as much as the default one.
Options
ElementRegistry::Sheet::Cellalready holds thepugi::xml_node, so a cell's children can be built on first access. Theregistry is a pre-built tree today and traversal is
const, so this needs anon-demand builder and a decision about what an element id means before its
element exists.
registering content past it. Cheaper, but it makes the model depend on the
render config, which the architecture deliberately keeps apart.
The first is the one that generalises: it is the same lifetime question a
streaming decode asks (see the sibling issue), so it is worth doing first and
learning from cheaply.