Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Remove openib and affiliated stuff #6270

Merged

Conversation

jsquyres
Copy link
Member

Per https://github.com/open-mpi/ompi/wiki/5.0.x-FeatureList, remove the openib BTL.

As a consequence, also:

  • Update README
  • Move the ibv_fork_check functionality to oshmem/mca/sshmem/verbs
  • Remove opal/mca/common/verbs and opal/mca/common/verbs_usnic

Need to check with Mellanox on the status of oshmem/mca/sshmem/verbs. If it's still used, we can fold much of config/opal_check_openfabrics.m4 and config/opal_check_verbs.m4 into oshmem/mca/sshmem/verbs. If it's no longer used / deprecated, we can just remove all of that functionality.

@hoopoepg @yosefe Can you guys comment on whether oshmem/mca/sshmem/verbs is still used? I.e., should I fold the verbs configury stuff up into oshmem/mca/sshmem/verbs? Or should oshmem/mca/sshmem/verbs go away, along with all the verbs configury?

Fixes #6265.

@yosefe
Copy link
Contributor

yosefe commented Jan 10, 2019

@jsquyres oshmem/mca/sshmem/verbs is deprecated.
BTW, how do we plan to run OpenMPI now with iWarp devices, for example?

@jsquyres
Copy link
Member Author

@yosefe Didn't someone validate that iWARP devices work in UCX?

@jsquyres
Copy link
Member Author

@yosefe Just to be clear: should I also remove oshmem/mca/sshmem/verbs as part of this PR?

@thananon
Copy link
Member

thananon commented Jan 10, 2019

Just giving my 2 cents here...

  1. btl/uct is still not ready to fully replace btl/openib for infiniband. At least on the multithreaded part, sometimes uct segfaults. I can provide full detail on that later. Right now I'm using openib as a 'fallback' btl. That being said, I can maintain openib btl in a separated branch.

  2. Mellanox is pushing pml/ucx. With the btl, maybe it adds more confusion. So I can see why removing it can be a good idea.

@jsquyres
Copy link
Member Author

Rats -- we forgot to talk about this today on the 2019-01-15 webex...

@jsquyres
Copy link
Member Author

@yosefe Just to be clear: should I also remove oshmem/mca/sshmem/verbs as part of this PR?

@yosefe
Copy link
Contributor

yosefe commented Jan 22, 2019

@jsquyres yes, need to remove also oshmem/mca/sshmem/verbs

@jsquyres jsquyres force-pushed the pr/remove-openib-and-affiliated-stuff branch from bb6eb54 to 6f3e19a Compare January 22, 2019 20:22
@jsquyres
Copy link
Member Author

@yosefe Updated. Could you please check to make sure I didn't break anything in the OSHMEM layer?

@hppritcha
Copy link
Member

bot:ompi:retest

So long BTL openib!  After many years of (mostly) faithful service, it
is time to remove the openib BTL.  It has been fully replaced by other
components, such as the UCX PML and OFI MTL.

Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
So long sshmem/verbs!  After many years of (mostly) faithful service,
it is time to remove the sshmem verbs component.  It has been fully
replaced by other components, such as the UCX PML and OFI MTL.

Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
@jsquyres jsquyres force-pushed the pr/remove-openib-and-affiliated-stuff branch from 6f3e19a to 9915c30 Compare February 7, 2019 13:34
The verbs and verbs_usnic components are now no longer necessary / no
longer used anywhere in the code base.

Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
Now that all components that use libibverbs are gone, remove
OPAL_CHECK_VERBS and the confusingly-named OPAL_CHECK_OPENFABRICS
(which really just checked for verbs things -- not all the possible
OpenFabrics APIs/libraries).

The only code left in Open MPI that calls verbs is hwloc -- and that's
just the APIs that takes an IBV device and returns topological
information about it.  Since nothing in the Open MPI code base uses
the "ibv_*" API any more, we have no need for this hwloc functionality
so we'll even remove the --with-verbs configure options.

Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
Now that all use of libibverbs is gone from Open MPI, and all
verbs-based configury is also removed, update README to remove all
references to --with-verbs.

Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
Since --with-verbs has been removed, then remove it from all the
platform files, too.

Signed-off-by: Jeff Squyres <jsquyres@cisco.com>
@jsquyres jsquyres force-pushed the pr/remove-openib-and-affiliated-stuff branch from 9915c30 to 99553eb Compare February 7, 2019 13:38
@jsquyres jsquyres added the NEWS label Feb 7, 2019
@jsquyres jsquyres merged commit f53a4f2 into open-mpi:master Feb 7, 2019
@jsquyres jsquyres deleted the pr/remove-openib-and-affiliated-stuff branch February 7, 2019 14:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants