Circuit-Forge/raven
3
0
Fork 0
Code Issues 24 Pull requests Projects Releases Packages Wiki Activity Actions

SkeletonFeatures extractor — joint angles and velocities from 3D landmarks #15

New issue
Open
opened 2026-04-26 21:46:24 -07:00 by pyr0ball · 0 comments
pyr0ball commented 2026-04-26 21:46:24 -07:00
Owner
Copy link

Phase B feature extractor for full-body skeleton input (25+ joints from structured light or Lighthouse).

Input: 3D landmark array from DepthFusion layer (format matches MediaPipe Pose: 33 body landmarks in phase A, extended to 25+ via depth hardware in Phase B).

Features extracted:

  • Joint angles (elbow, shoulder, wrist — bend angles in degrees)
  • Angular velocities (rate of change between frames)
  • Limb extension ratios (arm reach as fraction of max reach)
  • Proximity: distance of hand landmark to camera origin

New mappable actions:

  • Shoulder shrug → user-defined action
  • Arm reach direction (left/right/up/down) → directional input
  • Hand proximity to camera → slider control (distance → value)
  • Wrist rotation (pronation/supination) → scroll or value adjust

Tests: synthetic joint angle sequences, verify angle computation on known landmark configurations.

Phase B feature extractor for full-body skeleton input (25+ joints from structured light or Lighthouse). **Input:** 3D landmark array from DepthFusion layer (format matches MediaPipe Pose: 33 body landmarks in phase A, extended to 25+ via depth hardware in Phase B). **Features extracted:** - Joint angles (elbow, shoulder, wrist — bend angles in degrees) - Angular velocities (rate of change between frames) - Limb extension ratios (arm reach as fraction of max reach) - Proximity: distance of hand landmark to camera origin **New mappable actions:** - Shoulder shrug → user-defined action - Arm reach direction (left/right/up/down) → directional input - Hand proximity to camera → slider control (distance → value) - Wrist rotation (pronation/supination) → scroll or value adjust Tests: synthetic joint angle sequences, verify angle computation on known landmark configurations.
pyr0ball added this to the Phase B — Depth and High-Fidelity Spatial Input milestone 2026-04-26 21:46:24 -07:00
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
main
No results found.
Labels
Clear labels
No items
No labels
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: Circuit-Forge/raven#15
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?