trying out headless-gl [DO NOT MERGE]

[tech4GT]

cc @jywarren

[jywarren]

How did it go? Cool!!!

…

On Sun, Mar 31, 2019, 10:12 AM Varun Gupta ***@***.***> wrote: cc @jywarren <https://github.com/jywarren> ------------------------------ You can view, comment on, or merge this pull request online at: #964 Commit Summary - trying this out File Changes - *M* package-lock.json <https://github.com/publiclab/image-sequencer/pull/964/files#diff-0> (4211) - *M* package.json <https://github.com/publiclab/image-sequencer/pull/964/files#diff-1> (3) - *M* src/modules/FisheyeGl/Module.js <https://github.com/publiclab/image-sequencer/pull/964/files#diff-2> (386) - *A* src/modules/FisheyeGl/images/grid-fixed.png <https://github.com/publiclab/image-sequencer/pull/964/files#diff-3> (0) - *A* src/modules/FisheyeGl/images/grid.png <https://github.com/publiclab/image-sequencer/pull/964/files#diff-4> (0) - *A* src/modules/FisheyeGl/images/gridGuide.png <https://github.com/publiclab/image-sequencer/pull/964/files#diff-5> (0) - *A* src/modules/FisheyeGl/shaders.js <https://github.com/publiclab/image-sequencer/pull/964/files#diff-6> (8) - *A* src/modules/FisheyeGl/shaders/fragment.glfs.js <https://github.com/publiclab/image-sequencer/pull/964/files#diff-7> (27) - *A* src/modules/FisheyeGl/shaders/fragment2.glfs.js <https://github.com/publiclab/image-sequencer/pull/964/files#diff-8> (32) - *A* src/modules/FisheyeGl/shaders/fragment3.glfs.js <https://github.com/publiclab/image-sequencer/pull/964/files#diff-9> (30) - *A* src/modules/FisheyeGl/shaders/method1.glfs.js <https://github.com/publiclab/image-sequencer/pull/964/files#diff-10> (31) - *A* src/modules/FisheyeGl/shaders/method2.glfs.js <https://github.com/publiclab/image-sequencer/pull/964/files#diff-11> (31) - *A* src/modules/FisheyeGl/shaders/vertex.glvs.js <https://github.com/publiclab/image-sequencer/pull/964/files#diff-12> (14) Patch Links: - https://github.com/publiclab/image-sequencer/pull/964.patch - https://github.com/publiclab/image-sequencer/pull/964.diff — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#964>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AABfJ3zLDwjLp_PxtpCYF_yTPvy_T96lks5vcMItgaJpZM4cUVQR> .

[tech4GT]

Hi @jywarren I think we might need to re-write a lot of the code for this to work, at which point it only makes sense to separate the node and browser code for gl based modules.
Can you list some basic functions which I can try and implement from scratch using the 'gl' module.

[tech4GT]

Okay so I have narrowed done the current issue, it lies with the gl.texImage2D() function, it is not loading the image into gl properly

[jywarren]

Let's not give up and do a big refactor just yet... if you do want a simple WebGL demo to try, you could look at:

• https://developer.mozilla.org/en-US/docs/Web/API/WebGL_API/Basic_2D_animation_example
• maybe something from https://developer.mozilla.org/en-US/docs/Web/API/WebGL_API/Tutorial ?

You could also potentially search the headless-gl repo for texImage2D - @Divy123 already posted on this but there's evidence that the function does exist: https://github.com/stackgl/headless-gl/search?q=texImage2D&type=Issues

[jywarren]

Noted links in @Divy123's issue here: stackgl/headless-gl#143

[tech4GT]

@jywarren SO the official documentation says we can just drop a Uint8 array image data and it should work, but that clearly is not working since that is generating a type error. One of the accepted types was ImageData which I am using but the pixels in gl just remain the same even after running texImage2D

[tech4GT]

The documentation does say there is no explicit support for this.

[tech4GT]

https://www.npmjs.com/package/headless-gl#how-are-image-and-video-elements-implemented

[jywarren]

Hmm, ok, so perhaps we should add to/rename/open new issue for asking specifically: 1. for any example code showing this in use, 2. a test exhibiting this? We can also ask if they can point us at the section of code where this is accepted as a parameter and inspect how it's used there to ensure we know exactly the format they are expecting... and/or dig ourselves a bit!

…

On Mon, Apr 1, 2019 at 10:29 AM Varun Gupta ***@***.***> wrote: https://www.npmjs.com/package/headless-gl#how-are-image-and-video-elements-implemented — You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub <#964 (comment)>, or mute the thread <https://github.com/notifications/unsubscribe-auth/AABfJ4KE90VIRda1Z2uSm1_z8LRuLSXLks5vchejgaJpZM4cUVQR> .

[tech4GT]

@jywarren Yeah! I also tried it the way they mentioned here https://github.com/stackgl/headless-gl/pull/53/files#diff-c24e210c8552e30550810a8b75aa1cdaR101
This is also not working, all I am getting is a black image.

[tech4GT]

@jywarren Should I open an issue over at their repository or would you?? 😄

[jywarren]

If you could, that'd be great! Link back here please? Thank you!

[harshkhandeparkar]

We use pupeteer now. Also this solution is not very good. We'll have to do something new. I will try to figure something out.