Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TL/MLX5: device memory and topo init #780

Merged
merged 11 commits into from
Jun 2, 2023

Conversation

samnordmann
Copy link
Collaborator

@samnordmann samnordmann commented May 18, 2023

What

Implements device memory allocation and update the gtests
Also add topo init at team creation

@samnordmann samnordmann changed the title TL/MLX5: device memory TL/MLX5: device memory and topo init May 18, 2023
src/components/tl/mlx5/tl_mlx5_dm.c Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5.h Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5.h Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_dm.c Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_dm.c Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_dm.c Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_dm.c Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_team.c Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_team.c Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_dm.c Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_dm.c Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_dm.c Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_dm.c Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_dm.c Outdated Show resolved Hide resolved
status = ucc_mpool_init(&team->dm_pool, 0, sizeof(ucc_tl_mlx5_dm_chunk_t),
0, UCC_CACHE_LINE_SIZE, cfg->dm_buf_num,
cfg->dm_buf_num, &ucc_tl_mlx5_dm_ops,
UCC_THREAD_MULTIPLE, "mlx5 dm pool");
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

pls use actualy thread mode instead of UCC_THREAD_MULTIPLE

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you confirm it is ok ?

src/components/tl/mlx5/tl_mlx5.h Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_dm.c Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_dm.c Outdated Show resolved Hide resolved
@manjugv manjugv requested a review from vspetrov May 24, 2023 17:20
@samnordmann samnordmann force-pushed the tl_mlx5/dm_alloc branch 2 times, most recently from 3cb2c87 to e99de8f Compare May 25, 2023 10:13
src/components/tl/mlx5/tl_mlx5_dm.c Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_dm.c Outdated Show resolved Hide resolved
src/components/tl/mlx5/tl_mlx5_team.c Show resolved Hide resolved
@samnordmann
Copy link
Collaborator Author

bot:retest

@Sergei-Lebedev Sergei-Lebedev merged commit 447c786 into openucx:master Jun 2, 2023
janjust pushed a commit to janjust/ucc that referenced this pull request Jan 31, 2024
* TL/MLX5: device memory allocation

* TL/MLX5: topo init

* TL/MLX5: fix mask in wait-on-data WQE

* TEST: update tl/mlx5 gtest

* TL/MLX5: minor comments

* TL/MLX5: minor revisions

* TL/MLX5: gather global status after dm alloc

* TL/MLX5: cleanup team if dm alloc fails

* CODESTYLE: clang format

* TL/MLX5: minor comments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants