Question

[vqalex]

I'm trying to do basic calculations by using "headlessgl" and have some performance issues when pushing a lot of data (~1M inputs), it works but really slow, 100s times slower than CPU. VRAM utilization is going up but GPU stays within the same 5-6%. I'm using GTX 1060.

  gpu = new GPU({mode:'headlessgl'});
  var set1 = db_input1
  var set2 = db_input2

  const differnce = gpu.createKernel(function(set1, set2) {
    return set1 - set2;
  }).setOutput([1]);

  gpu.destroy();

[robertleeplummerjr]

You are a quick one! I'm still working on it! LOL. Can you share all your source, or is it just this one run? If it is just this one run, then the issue is the build time and compilation to translate js to glsl, and then to attach to headlessgl. If not, however, I'd need more information.

[vqalex]

I have no patience anymore :). Code is above, basic calculation..feels like there some memory leak..more VRAM consumed slower it is, and then at the end I'm getting out of VRAM and PC hangs :) I'm using ubuntu.

[darionco]

I'm guessing that the issue is that you have to upload the big array to video memory, the process goes as follows:

1. create kerel
2. pass array to kernel
3. convert array to array buffer
4. upload arraybuffer to gpu
5. run shader code

as you can see all the way to number 4 the program is preparing things to run on the GPU, that takes time and memory, I am still reading through the source code but there should be a way to use ArrayBuffer as a parameter (I believe it's possible through the use of the Input class) so it doesn't have to convert the JS Array to an ArrayBuffer, also there should be a way to pre-upload the data to the GPU

[robertleeplummerjr]

I've currently been working to just make nodejs GPU support work. We'll soon start to address performance issues.

[robertleeplummerjr]

Much of this has been handled now that we use a single upload array and have broken up the kernel argument and constant handlers into KernelValue classes. Would there be a way you could test this and see if the situation has improved?