Add asynchronous concurrent execution #3687
Conversation
neon60
force-pushed
the
async-doc
branch
2 times, most recently
from
1484d67 to
f81588d
Compare
neon60
requested review from
chrispaquot,
gandryey,
saleelk,
mangupta and
rakesroy
as code owners
neon60
force-pushed
the
async-doc
branch
4 times, most recently
from
fd5af51 to
6a139c6
Compare
| or from the GPU concurrently with kernel execution. Applications can query this | ||
| capability by checking the ``asyncEngineCount`` device property. Devices with | ||
| an ``asyncEngineCount`` greater than zero support concurrent data transfers. | ||
| Additionally, if host memory is involved in the copy, it should be page-locked |
There was a problem hiding this comment.
Is there a reference we can provide such as Memory Management or something?
There was a problem hiding this comment.
I didn't find. The only thing that I found is:
https://rocm.docs.amd.com/projects/HIP/en/latest/doxygen/html/structhip_device_prop__t.html#a24ee882099e1b02e95f6c245ff1ea0cf
There was a problem hiding this comment.
I think my comment was related to the "if host memory is involved in the copy, it should be page-locked to ensure optimal performance" text. This seems like it could use a reference to some additional details, or maybe just indicate how page-locked ensures optimal performance?
There was a problem hiding this comment.
Sorry, I misunderstood you.
Yes, you are right, I tried to extend the content and I added a link to host memory.
|
|
||
| It is also possible to perform intra-device copies simultaneously with kernel | ||
| execution on devices that support the ``concurrentKernels`` device property | ||
| and/or with copies to or from the device (for devices that support the |
There was a problem hiding this comment.
| and/or with copies to or from the device (for devices that support the | |
| and/or with copies to or from the device (for devices that support the |
Are copies to or from the device intra-device copies?
There was a problem hiding this comment.
No, intra-device copying is data transfer within the same device.
Thank you for drawing my attention to it. The text was misleading, so I rephrased it.
matyas-streamhpc
force-pushed
the
async-doc
branch
from
495e166 to
9835194
Compare
neon60
force-pushed
the
async-doc
branch
3 times, most recently
from
6b15a56 to
ed7e05f
Compare
No description provided.