Skip to content

Minor changes for debugging DFO stop timeouts - #523

Open
bieryAtFnal wants to merge 8 commits into
developfrom
kbiery/dfo_stop_testing
Open

bieryAtFnal wants to merge 8 commits into
developfrom
kbiery/dfo_stop_testing

Conversation

@bieryAtFnal

@bieryAtFnal bieryAtFnal commented Nov 6, 2026 •

Copy link
Copy Markdown
Collaborator

Description

Added a DataWriter OpMon metric for the maximum time that is spent writing a TriggerRecord.

Also, modified the insufficient_disk_space_test.py and large_trigger_record_test.py integtests so that they enable useful TRACE debug messages.

Also, modified the large_trigger_record_test.py so that it uses a DFO stop timeout of 10 seconds. The goal of that change is to help make the stopping of a run more likely to succeed without experiencing DFO stop timeouts or TriggerRecordToken message leakage between runs.

In general, these changes were in response to my debugging of DFO timeout error messages and Token message leakage between runs seen in the two integtests mentioned above when they are run on np04-srv-019.

Type of change

  • Optimization (non-breaking change that improves code/performance)
  • Bug fix (non-breaking change which fixes an issue)

Testing checklist

  • Unit tests pass (e.g. dbt-build --unittest)
  • Minimal system quicktest passes (pytest -s minimal_system_quick_test.py)
  • Full set of integration tests pass (dunedaq_integtest_bundle.sh)

Further checks

  • Code is commented where needed, particularly in hard-to-understand areas

@bieryAtFnal bieryAtFnal changed the title Kbiery/dfo stop testing Minor changes for debugging DFO stop timeouts Nov 6, 2026
@bieryAtFnal
bieryAtFnal marked this pull request as ready for review November 10, 2026 22:12
@bieryAtFnal
bieryAtFnal requested a review from eflumerf November 10, 2026 22:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant