Skip to content

feat: unify limiter config path and add hypervisor local mode#343

Open
0x5457 wants to merge 4 commits intomainfrom
feat/config-with-local-mode
Open

feat: unify limiter config path and add hypervisor local mode#343
0x5457 wants to merge 4 commits intomainfrom
feat/config-with-local-mode

Conversation

@0x5457
Copy link
Collaborator

@0x5457 0x5457 commented Jan 20, 2026

Local Testing with Hypervisor Local Mode

For local development and testing without Kubernetes, use the hypervisor local command:

# Terminal 1: Start hypervisor in local mode
hypervisor local --devices 0 --target-util 0.7 --api-port 8080 -v

# Terminal 2: Run your CUDA application
export HYPERVISOR_IP=127.0.0.1
export HYPERVISOR_PORT=8080
export SHM_PATH=/tmp/tensor-fusion-local
export CUDA_VISIBLE_DEVICES=0

LD_PRELOAD=./target/release/libcuda_limiter.so python your_script.py

@0x5457 0x5457 force-pushed the feat/config-with-local-mode branch from f2f0de3 to 53a0768 Compare January 29, 2026 02:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant