UWP version of Holofunk

[Noemata]

If and when the UWP version the Kinect SDK becomes available and you consider a UWP port of Holofunk, I am willing to give you some help.

Reply with an email address if you would like to discuss this.

[RobJellinghaus]

Thanks, I appreciate the offer! I am not holding my breath for the full UWP SDK -- no idea when or if it will actually appear. And an equally big issue is that the app uses the ASIO API for low latency audio round-tripping -- I have no idea if UWP supports an equally low-latency audio interface, but I am not hopeful. Do you know? And discussing it here is fine, I don't actually know how to send PMs on Github and I don't want to post my email address on a public thread :-)

[RobJellinghaus]

Also I am working on getting it happy with Win10... have not FNA and SharpDX 3 branches in my repo now, but still issues with both. Will update once it works again. Until then it may not be worth pulling.

[Noemata]

Low latency audio support is very good under UWP, as is general audio management with the revised audio graph facility. The only bits missing from Kinect support are the skeletal data, not that it's a small detail. Microsoft promised full UWP support for the last half of this year. Starting to look like the last quarter now. If you know someone on the inside, give them a nudge.

[RobJellinghaus]

Looks like they have come out with what they claim is adequate UWP access to skeletal data: https://blogs.windows.com/buildingapps/2016/11/04/kinect-demo-code-and-new-driver-for-uwp-now-available/

I have not tried it myself yet but I will be soon.

[Noemata]

The basics are there. It's certainly possible to get most things working with UWP provided you make up for the deficit in the API with your own replacements for what is currently in the Kinect SDK. I've decided to wait a bit longer to see if someone decides to jump in and do some of the heavy lifting needed to fill in the UWP API gaps. I have a couple projects that could make immediate use of the Kinect within my UWP apps, but I'm not inclined to be on the bleeding edge on this one. I'm still struggling with integration of C#/3D. Yet another big whole in the UWP API set as far as C# development is concerned. Win2D is great ... now I need Win3D also. Maybe by next summer we'll be all the way there.

…

Rob Jellinghaus ***@***.***> November 26, 2016 3:43 AM Looks like they have come out with what they claim is adequate UWP access to skeletal data: https://blogs.windows.com/buildingapps/2016/11/04/kinect-demo-code-and-new-driver-for-uwp-now-available/ I have not tried it myself yet but I will be soon. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#1 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AGUze5mectbEdIBWNPPh76wxZkrTmuJIks5rB_EZgaJpZM4KFswc>.

[RobJellinghaus]

Well, I have decided to go full UWP, so I am starting on a UWP / C# / Unity / new-UWP-Kinect-drivers / AudioGraph version. https://github.com/RobJellinghaus/Holofunk2/

Keep an eye on it. I am going to start with a touchscreen C# / Unity / AudioGraph version (so my kids can play with it on their tablets), then add in Kinect support, and then mixed reality support once the Win10 Creator Update ships next summer.

[Noemata]

If you are interesting in a slightly different approach that includes all of your described elements except Unity, then I have something that may be of interest to you. I've been merging monogame, aspects of the SharpDX Toolkit, Caliburn.Micro and some custom bits in support of things that I am working on that are very audio centric. If you're interested we can sort out a private channel to discuss this.

…

Rob Jellinghaus ***@***.***> November 27, 2016 4:14 PM Well, I have decided to go full UWP, so I am starting on a UWP / C# / Unity / new-UWP-Kinect-drivers / AudioGraph version. https://github.com/RobJellinghaus/Holofunk2/ Keep an eye on it. I am going to start with a touchscreen C# / Unity / AudioGraph version (so my kids can play with it on their tablets), then add in Kinect support, and then mixed reality support once the Win10 Creator Update ships next summer. — You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub <#1 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AGUzex27c1ojShzX71xqvsTEx1P6vxtRks5rCfLFgaJpZM4KFswc>.

[RobJellinghaus]

Does that approach work as a UWP app? My app needs to go UWP in order to run on HoloLens.

[Noemata]

UWP is my main focus also, so I am only opting for approaches that play nice with UWP. I also need Xbox to be fully supported by the UWP implementation. I need to have a solution out by the end of January that will feature fairly complex audio/Kinect/digital camera integration hopefully all running on an Xbox.

[RobJellinghaus]

https://github.com/jmarcincin/MultiK2 turns out to be the fantastic solution for me (UWP, C#, full Kinect access including hand pose).

[Noemata]

Thank you very much for the suggestion! That looks pretty darn good. Will dig into it in a couple days. At the moment I'm struggling with UWP Midi. Turns out there's no equivalent of Multimedia Timers, so I'm still trying to resolve the best alternative. That said, the new MIDI API does the job in every other respect so I have to temper my complaints.