Release loose-parser scanner bookkeeping when shift returns - #373
Open
OskarEichler wants to merge 1 commit into
Open
Release loose-parser scanner bookkeeping when shift returns#373OskarEichler wants to merge 1 commit into
OskarEichler wants to merge 1 commit into
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Ensure the loose parser releases its current scanner keep when a caller exits through
shiftor an early block return. Skip that cleanup after transferring ownership to the robust parser.Reproduction
After 10,000 calls to
CSV.new("a,b\n" * 10_000).shifton the same CSV object, the release retains 10,000 scanner positions. The removal of the persistent enumerator in #363 exposed the missing non-local-return cleanup.Verification
1,211 focused checks pass in each parser mode, including incremental line access, quoting transitions, headers and alternate separators. The repeated 10,000-shift reproduction retains zero positions with this patch rather than 10,000.
This isolated patch passes the unchanged upstream suite in both normal and
CSV_PARSER_SCANNER_TEST=yesmodes: 527 tests / 4,050 assertions in each mode, zero failures/errors. Commands use Ruby 4.0.6 through rbenv (bundle exec ruby run-test.rb). Syntax andgit diff --checkpass. The combined release-based consumer branch also passes gem build andrake warning:error rdoc.No tests were added or changed, per the requesting project's explicit no-new-tests policy. Focused checks and measurements live outside this repository. The upstream no-RuboCop policy is respected. Verification was local on macOS/Ruby 4.0.6; the supported OS/Ruby matrix was not run locally. Current main and installed 3.3.6 share base commit
0873ab362d996f12796c3c3e8998b5be657a9b12; no unrelated changes are included.Breaking changes and limitations
None. Parsed data, line access and incremental-reading behavior remain unchanged; unnecessary scanner bookkeeping is released.