add VideoFrameTexture for use with WebCodecs API and example/docs #30269
+13,745
−362
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![github-advanced-security[bot]](https://avatars.githubusercontent.com/in/57789?s=60&v=4){kind=small}
|
|
||
| let camera, scene, renderer; | ||
| let stats; | ||
| let video, material, mesh; |
Check notice
Code scanning / CodeQL
Unused variable, import, function or class Note
| }); | ||
|
|
||
| // Fetch and demux the media data. | ||
| const demuxer = new MP4Demuxer("textures/sintel.mp4", { |
Check notice
Code scanning / CodeQL
Unused variable, import, function or class Note
📦 Bundle sizeFull ESM build, minified and gzipped.
🌳 Bundle size after tree-shakingMinimal build including a renderer, camera, empty scene, and dependencies.
|
|
Thanks for filing the PR! It was very helpful to understand the use case. Let me file an other PR based on this one with minimal changes to the library. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
We use the WebCodecs API to decode video Frames to be able to use custom streaming and stitching and inter-stream synchronisation. It is not clear how exactly to feed these to Three.js and doing it naively can leave lots of performance on the table, so I added a VideoFrameTexture class together with documentation and an example.
This contribution is funded by GameOn