Skip to content

feat(activevln): share resident model with bounded text planning - #20

Draft
yufoo1 wants to merge 2 commits into
BUAA-CI-LAB:mainfrom
yufoo1:feat/activevln-shared-text
Draft

yufoo1 wants to merge 2 commits into
BUAA-CI-LAB:mainfrom
yufoo1:feat/activevln-shared-text

Conversation

@yufoo1

@yufoo1 yufoo1 commented Nov 2, 2026 •

Copy link
Copy Markdown
Collaborator

Summary

Allow an optional text-planning client to borrow the same resident ActiveVLN model used for navigation. /v1/text validates bounded conversations and model-instance identity; text owns private KV state and yields between tokens to waiting navigation. The inference server returns raw text and never parses or executes RPent tools.

ActiveVLN owns checkpoint-specific text decoding, reference rotary/attention semantics and opt-in text decode graphs. The generic server owns the optional text protocol and execution admission. Refit changes invalidate the advertised identity rather than silently continuing with stale state.

Dependency and scope

Depends on #19 (Go2 recurrent serving). Review the isolated change with the branch comparison. The PR targets main and includes that dependency until it merges. RPent's planner/tools/Go2 integration are in BUAA-CI-LAB/EmbodiRun#15; no planner or deployment code is imported here.

Verification

  • ActiveVLN text/shared-service/navigation/attention tests with CUDA_VISIBLE_DEVICES='': 84 passed.
  • HTTP serving, batching, schema aliases, shared-text and compatibility preflight tests: 58 passed, 1 skipped.
  • Ruff lint/format and git diff --check: passed.
  • The newer base's rotary configuration helper is preserved in both normal and text graph paths.

No fresh CUDA graph, real-checkpoint parity or physical robot validation was performed while splitting the PR. The feature stays opt-in and does not claim planning accuracy or a navigation speedup. The local broader CPU environment has the independently reproduced Pi05/Transformers baseline incompatibility documented in the dependency PR.

Signed-off-by: yufoo1 <yufoo1.cs@gmail.com>
Signed-off-by: yufoo1 <yufoo1.cs@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant