Add interactive segmentation and text query features #1582
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
- Add prediction-error event handler in useModeManager.ts - Show prompt dialog when segmentation service fails to initialize - Subscribe and unsubscribe to prediction-error event properly
- Add editorMenuRef and onTextQueryServiceReady to Viewer.vue - Forward text-query-init, text-query, text-query-all-frames events from EditorMenu through Viewer - Add text query handlers to web ViewerLoader.vue - Errors now properly propagate to show error dialog instead of infinite loading
When text query fails to load, show 'Unable to load text query model' instead of 'Unable to load segmentation module' for better clarity.
When users clicked the segmentation button and then quickly switched to polygon mode, the async initialization would complete ~2 seconds later and call completeActivation(), which emitted an 'activate' event that kicked the user out of polygon mode. Added a pendingActivation flag that: - Is set when async initialization starts - Is checked before completing activation - Is cleared in deactivate() to cancel in-flight async activation This ensures switching modes during segmentation loading doesn't cause the mode to be overridden when the async init completes. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Point the desktop segmentation service to interactive_segmenter_default.conf and the stereo service to interactive_stereo_default.conf, both under the VIAME install configs/pipelines directory. The config files are approach-agnostic, so the command-line args no longer specify model details. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Rename vital_segmentation_service.py to viame_segmentation_service.py and VitalSegmentationService to ViameSegmentationService - Remove all sam2/sam3 references: backend detection, hardcoded algorithm types, SAM-specific env vars, and backward-compat aliases - Algorithm creation is now config-driven, reading the type from the VIAME config file rather than probing for specific Python modules - Consolidate duplicate sam2/sam3 API endpoints into generic ones: segmentation_predict, segmentation_status, text_query - Update web client endpoint URLs to match Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Register Electron IPC handlers for the stereo service (enable, disable, set-frame, transfer-line, transfer-points, calibration, status) and expose corresponding async functions from the desktop frontend API. Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
- Add stereoSettings (interactiveModeEnabled, loading state) to client settings with a toggle in TrackSettingsPanel for stereo datasets - Emit stereo annotation-complete events from useModeManager when interactive stereo mode is enabled (box, line, polygon, segmentation) - Include control points in segmentation prediction results so they can be forwarded for stereo warping - Pass isStereoDataset prop through Sidebar and Viewer to conditionally show the stereo settings section - Wire up ViewerLoader to handle stereo annotation completion Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Summary
Test plan
🤖 Generated with Claude Code