Skip to content

feat(security): Add a communication auth_key for NCCL and HCCL. - #320

Merged
z0o0ey merged 2 commits into
modelscope:mainfrom
z0o0ey:main
Oct 16, 2026
Merged

z0o0ey merged 2 commits into
modelscope:mainfrom
z0o0ey:main

Conversation

@z0o0ey

@z0o0ey z0o0ey commented Oct 16, 2026

Copy link
Copy Markdown
Collaborator

PR type

  • Bug Fix
  • New Feature
  • Document Updates
  • More Models or Datasets Support

PR information

  • Create zmq_auth.py with generate_auth_key, send_auth_pyobj, recv_auth_pyobj
  • Refactor HCCLCheckpointEngine to use the shared helpers
  • Add HMAC authentication to NCCLCheckpointEngine's PUB/SUB channel
  • Broadcast auth_key via MasterMetadata so workers share the secret
  • Export new auth utilities from checkpoint_engine package

…o NCCL engine

- Create zmq_auth.py with generate_auth_key, send_auth_pyobj, recv_auth_pyobj
- Refactor HCCLCheckpointEngine to use the shared helpers
- Add HMAC authentication to NCCLCheckpointEngine's PUB/SUB channel
- Broadcast auth_key via MasterMetadata so workers share the secret
- Export new auth utilities from checkpoint_engine package
@z0o0ey
z0o0ey merged commit 96dab68 into modelscope:main Oct 16, 2026
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants