View source for TPAC2015/session-foxeye

← TPAC2015/session-foxeye

You do not have permission to edit this page, for the following reason:

The action you have requested is limited to users in one of the groups: Users, 106, 100-chairs, 93058-chairs, 35125-chairs.

You can view and copy the source of this page.

* Breakout: [https://www.w3.org/wiki/TPAC/2015/SessionIdeas#Project_FoxEye FoxEye, video processing]
* Proposed by: Chia-Hung Tai, Tzuhao Kuo
* Minutes: 
* Summary:
<blockquote>
There are a lot of valuable inputs during FoxEye session. Kaku filed all the issues to the github for tracking. Please feel free to join the open discussion. Let's make the Web more friendly for video processing and computer vision.

1. Decouple VideoProcessor from Workers ([https://github.com/w3c/mediacapture-worker/issues/30 #30]): This issue is suggested by Mathieu. I will make a new API design for decoupling from worker. I think the issue [https://github.com/w3c/mediacapture-worker/issues/31 #31] might be not necessary. I believe we don't need a canvas for processor case.

2. Using worklet ([https://github.com/w3c/mediacapture-worker/issues/32 #32]): WebAudio will move from AudioWorker to AudioWorklet. So we might align with Audio to adopt worklet. But it's still an open question. I will implement on worker first anyway. Let's talk more on this in Github.

3. Processing offline context ([https://github.com/w3c/mediacapture-worker/issues/33 #33]): After talk with padenot, he suggested we might take WHATWG Streams as the carrier for offline processing case. This also an open question so far. Let's talk more on this in Github. But in Gecko implementation, we might use MSG MediaStream to implement the prototype and verify the concept first.

4. Elaborate the backpressure handling ([https://github.com/w3c/mediacapture-worker/issues/34 #34]) and Security Considerations ([https://github.com/w3c/mediacapture-worker/issues/35 #35]): We will elaborate more in the spec.

5. Re-sample the video frame rate ([https://github.com/w3c/mediacapture-worker/issues/36 #36]): A new use case we haven't considered yet. We thought this might be useful in offline case. So we will try to figure out how to deal with in offline processing.

FoxEye information:
* Spec: https://github.com/w3c/mediacapture-worker
* Wiki: https://wiki.mozilla.org/Project_FoxEye
* Bugzilla meta bug: https://bugzilla.mozilla.org/show_bug.cgi?id=1100203
* OpenCV.js: https://github.com/CJKu/opencv
* Demo: https://www.youtube.com/watch?v=prybkXsTGXY
</blockquote>

Return to TPAC2015/session-foxeye.

Retrieved from "https://www.w3.org/wiki/TPAC2015/session-foxeye"