User Device Input Path

[PolygonalSun]

User Device Input Path

Tasks:

• Milestone 1 – Full Pointer Support in Native

  • Update NativeInput to Handle New Pointers
  • Mouse Implementation
    • Win32
    • UWP
    • MacOS
    • Linux (X11)
  • Touch Implementation
    • Win32
    • UWP
    • iOS
    • Android

• Milestone 2 – Build up Testing Platform (Tracked in Design Test Plan For Input #12661)

  • Create Test Environment with Necessary Mock Objects
  • Create Unit Tests to Test Input System on JS
  • Integrate Safari testing into CI
  • Convert Babylon Native to use Jest
  • Create Input Recorder (Removing from Milestone)

• Milestone 3 – Performance and Stability Improvements (Tracked in Input Performance and Stability Improvements #12898)

  • Improve Input Perf (frame call reduction)
  • Clean up and flatten Input enum/file structure
  • Move Browser-Specific Logic into DeviceInputSystem for more uniform cross-browser experience
  • Implement Lazy Picking (Turn on/instantiate picking elements when picking is first explicitly used)

• Milestone 4 – Keyboard Support in Native- Update NativeInput to Handle Keyboards: Pre-lim keyboard work is in draft PR

  • Update NativeInput to Handle Keyboard Input
  • Keyboard Implementation
    • Win32
    • UWP
    • Linux
    • MacOS
  • Add Testing for Keyboard (and focus, potentially)

Bugs:

[PolygonalSun]

Status as of 5/20:
Win32 Implemenation (Keyboard): In Draft PR: BabylonJS/BabylonNative#1042
UWP Implemenation (Keyboard): In Draft PR: BabylonJS/BabylonNative#1042
Linux Implemenation (Keyboard): Building Keycode Conversion Table
MacOS Implemenation (Keyboard): Investigating issue where event isn’t firing properly

pointerUpPredicate not working/unable to disable up pick (PR: #12524)
Multiple Canvases causing crash - User is attempting to produce repro

[PolygonalSun]

Status as of 5/27:
Create custom mock window object for testing input and events: Working on window, testing for missing logic
Create Unit Tests to Test Input System on JS: Started writing tests and finding all test cases

Win32 Implemenation (Keyboard): In Draft PR: BabylonJS/BabylonNative#1042
UWP Implemenation (Keyboard): In Draft PR: BabylonJS/BabylonNative#1042
Linux Implemenation (Keyboard): Building Keycode Conversion Table
MacOS Implemenation (Keyboard): Investigating issue where event isn’t firing properly

Multiple Canvases causing crash - User is attempting to produce repro

[PolygonalSun]

Status as of 6/3:
Create custom mock window object for testing input and events: Identified object gaps, beginning environment implementation
Create Unit Tests to Test Input System on JS: Prototyped tests for baseline, will refine tests as environment implementation is completed

Win32 Implemenation (Keyboard): In Draft PR: BabylonJS/BabylonNative#1042
UWP Implemenation (Keyboard): In Draft PR: BabylonJS/BabylonNative#1042
Linux Implemenation (Keyboard): Building Keycode Conversion Table
MacOS Implemenation (Keyboard): Investigating issue where event isn’t firing properly

Multiple Canvases causing crash - User is attempting to produce repro

[thomlucc]

Closing as it is now tracked as a project