Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

cfea89fab Breaks build #809

Open
ilikenwf opened this issue Jul 26, 2023 · 11 comments
Open

cfea89fab Breaks build #809

ilikenwf opened this issue Jul 26, 2023 · 11 comments

Comments

@ilikenwf
Copy link

ilikenwf commented Jul 26, 2023 •
edited
Loading

Read from #809 (comment) to the end, please.
@ilikenwf
Copy link
Author

c979299 builds
9395192 builds
b206d71 builds

I'm not sure what's going on so far...but I'll try and find the commit that broke things for me...if I can find it.

@ilikenwf
Copy link
Author

cfea89f appears to be the breaking change.

@ilikenwf
Copy link
Author 

Installing collected packages: xformers
  Attempting uninstall: xformers
    Found existing installation: xformers 0.0.21+b206d71.d20230726
    Uninstalling xformers-0.0.21+b206d71.d20230726:
      Successfully uninstalled xformers-0.0.21+b206d71.d20230726
  Running setup.py develop for xformers
    error: subprocess-exited-with-error
    
    × python setup.py develop did not run successfully.
    │ exit code: 1
    ╰─> [125 lines of output]
        No ROCm runtime is found, using ROCM_HOME='/opt/rocm'
        running develop
        /usr/lib/python3.11/site-packages/setuptools/command/develop.py:40: EasyInstallDeprecationWarning: easy_install command is deprecated.
        !!
        
                ********************************************************************************
                Please avoid running ``setup.py`` and ``easy_install``.
                Instead, use pypa/build, pypa/installer or other
                standards-based tools.
        
                See https://github.com/pypa/setuptools/issues/917 for details.
                ********************************************************************************
        
        !!
          easy_install.initialize_options(self)
        /usr/lib/python3.11/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
        !!
        
                ********************************************************************************
                Please avoid running ``setup.py`` directly.
                Instead, use pypa/build, pypa/installer or other
                standards-based tools.
        
                See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
                ********************************************************************************
        
        !!
          self.initialize_options()
        /home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/pkg_resources/__init__.py:123: PkgResourcesDeprecationWarning: 7.94SVN is an invalid version and will not be supported in a future release
          warnings.warn(
        running egg_info
        writing xformers.egg-info/PKG-INFO
        writing dependency_links to xformers.egg-info/dependency_links.txt
        writing requirements to xformers.egg-info/requires.txt
        writing top-level names to xformers.egg-info/top_level.txt
        reading manifest file 'xformers.egg-info/SOURCES.txt'
        reading manifest template 'MANIFEST.in'
        no previously-included directories found matching 'third_party/flash-attention/csrc/flash_attn/cutlass/docs'
        adding license file 'LICENSE'
        writing manifest file 'xformers.egg-info/SOURCES.txt'
        running build_ext
        /home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py:405: UserWarning: The detected CUDA version (12.2) has a minor version mismatch with the version that was used to compile PyTorch (12.1). Most likely this shouldn't be a problem.
          warnings.warn(CUDA_MISMATCH_WARN.format(cuda_str_version, torch.version.cuda))
        /home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py:415: UserWarning: There are no g++ version bounds defined for CUDA version 12.2
          warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
        building 'xformers._C_flashattention' extension
        creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home
        creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd
        creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion
        creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui
        creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories
        creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers
        creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party
        creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention
        creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc
        creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn
        creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src
        Emitting ninja build file /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/build.ninja...
        Compiling objects...
        Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
        ninja: error: '/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/flash_api.cpp', needed by '/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/flash_api.o', missing and no known rule to make it
        Traceback (most recent call last):
          File "/home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1916, in _run_ninja_build
            subprocess.run(
          File "/usr/lib/python3.11/subprocess.py", line 571, in run
            raise CalledProcessError(retcode, process.args,
        subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.
        
        The above exception was the direct cause of the following exception:
        
        Traceback (most recent call last):
          File "<string>", line 2, in <module>
          File "<pip-setuptools-caller>", line 34, in <module>
          File "/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/setup.py", line 397, in <module>
            setuptools.setup(
          File "/usr/lib/python3.11/site-packages/setuptools/__init__.py", line 107, in setup
            return distutils.core.setup(**attrs)
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
          File "/usr/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 185, in setup
            return run_commands(dist)
                   ^^^^^^^^^^^^^^^^^^
          File "/usr/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
            dist.run_commands()
          File "/usr/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
            self.run_command(cmd)
          File "/usr/lib/python3.11/site-packages/setuptools/dist.py", line 1234, in run_command
            super().run_command(command)
          File "/usr/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
            cmd_obj.run()
          File "/usr/lib/python3.11/site-packages/setuptools/command/develop.py", line 34, in run
            self.install_for_development()
          File "/usr/lib/python3.11/site-packages/setuptools/command/develop.py", line 111, in install_for_development
            self.run_command('build_ext')
          File "/usr/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
            self.distribution.run_command(command)
          File "/usr/lib/python3.11/site-packages/setuptools/dist.py", line 1234, in run_command
            super().run_command(command)
          File "/usr/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
            cmd_obj.run()
          File "/usr/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 84, in run
            _build_ext.run(self)
          File "/usr/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 345, in run
            self.build_extensions()
          File "/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/setup.py", line 342, in build_extensions
            super().build_extensions()
          File "/home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 864, in build_extensions
            build_ext.build_extensions(self)
          File "/usr/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 467, in build_extensions
            self._build_extensions_serial()
          File "/usr/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 493, in _build_extensions_serial
            self.build_extension(ext)
          File "/usr/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 246, in build_extension
            _build_ext.build_extension(self, ext)
          File "/usr/lib/python3.11/site-packages/Cython/Distutils/build_ext.py", line 127, in build_extension
            super(build_ext, self).build_extension(ext)
          File "/usr/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 548, in build_extension
            objects = self.compiler.compile(
                      ^^^^^^^^^^^^^^^^^^^^^^
          File "/home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 677, in unix_wrap_ninja_compile
            _write_ninja_file_and_compile_objects(
          File "/home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1589, in _write_ninja_file_and_compile_objects
            _run_ninja_build(
          File "/home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1932, in _run_ninja_build
            raise RuntimeError(message) from e
        RuntimeError: Error compiling objects for extension
        [end of output]
    
    note: This error originates from a subprocess, and is likely not a problem with pip.
  Rolling back uninstall of xformers
  Moving to /home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/xformers.egg-link
   from /tmp/pip-uninstall-0d2y4xri/xformers.egg-link
error: subprocess-exited-with-error

× python setup.py develop did not run successfully.
│ exit code: 1
╰─> [125 lines of output]
    No ROCm runtime is found, using ROCM_HOME='/opt/rocm'
    running develop
    /usr/lib/python3.11/site-packages/setuptools/command/develop.py:40: EasyInstallDeprecationWarning: easy_install command is deprecated.
    !!
    
            ********************************************************************************
            Please avoid running ``setup.py`` and ``easy_install``.
            Instead, use pypa/build, pypa/installer or other
            standards-based tools.
    
            See https://github.com/pypa/setuptools/issues/917 for details.
            ********************************************************************************
    
    !!
      easy_install.initialize_options(self)
    /usr/lib/python3.11/site-packages/setuptools/_distutils/cmd.py:66: SetuptoolsDeprecationWarning: setup.py install is deprecated.
    !!
    
            ********************************************************************************
            Please avoid running ``setup.py`` directly.
            Instead, use pypa/build, pypa/installer or other
            standards-based tools.
    
            See https://blog.ganssle.io/articles/2021/10/setup-py-deprecated.html for details.
            ********************************************************************************
    
    !!
      self.initialize_options()
    /home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/pkg_resources/__init__.py:123: PkgResourcesDeprecationWarning: 7.94SVN is an invalid version and will not be supported in a future release
      warnings.warn(
    running egg_info
    writing xformers.egg-info/PKG-INFO
    writing dependency_links to xformers.egg-info/dependency_links.txt
    writing requirements to xformers.egg-info/requires.txt
    writing top-level names to xformers.egg-info/top_level.txt
    reading manifest file 'xformers.egg-info/SOURCES.txt'
    reading manifest template 'MANIFEST.in'
    no previously-included directories found matching 'third_party/flash-attention/csrc/flash_attn/cutlass/docs'
    adding license file 'LICENSE'
    writing manifest file 'xformers.egg-info/SOURCES.txt'
    running build_ext
    /home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py:405: UserWarning: The detected CUDA version (12.2) has a minor version mismatch with the version that was used to compile PyTorch (12.1). Most likely this shouldn't be a problem.
      warnings.warn(CUDA_MISMATCH_WARN.format(cuda_str_version, torch.version.cuda))
    /home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py:415: UserWarning: There are no g++ version bounds defined for CUDA version 12.2
      warnings.warn(f'There are no {compiler_name} version bounds defined for CUDA version {cuda_str_version}')
    building 'xformers._C_flashattention' extension
    creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home
    creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd
    creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion
    creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui
    creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories
    creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers
    creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party
    creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention
    creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc
    creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn
    creating /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src
    Emitting ninja build file /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/build.ninja...
    Compiling objects...
    Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
    ninja: error: '/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/flash_api.cpp', needed by '/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/flash_api.o', missing and no known rule to make it
    Traceback (most recent call last):
      File "/home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1916, in _run_ninja_build
        subprocess.run(
      File "/usr/lib/python3.11/subprocess.py", line 571, in run
        raise CalledProcessError(retcode, process.args,
    subprocess.CalledProcessError: Command '['ninja', '-v']' returned non-zero exit status 1.
    
    The above exception was the direct cause of the following exception:
    
    Traceback (most recent call last):
      File "<string>", line 2, in <module>
      File "<pip-setuptools-caller>", line 34, in <module>
      File "/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/setup.py", line 397, in <module>
        setuptools.setup(
      File "/usr/lib/python3.11/site-packages/setuptools/__init__.py", line 107, in setup
        return distutils.core.setup(**attrs)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/usr/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 185, in setup
        return run_commands(dist)
               ^^^^^^^^^^^^^^^^^^
      File "/usr/lib/python3.11/site-packages/setuptools/_distutils/core.py", line 201, in run_commands
        dist.run_commands()
      File "/usr/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 969, in run_commands
        self.run_command(cmd)
      File "/usr/lib/python3.11/site-packages/setuptools/dist.py", line 1234, in run_command
        super().run_command(command)
      File "/usr/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
        cmd_obj.run()
      File "/usr/lib/python3.11/site-packages/setuptools/command/develop.py", line 34, in run
        self.install_for_development()
      File "/usr/lib/python3.11/site-packages/setuptools/command/develop.py", line 111, in install_for_development
        self.run_command('build_ext')
      File "/usr/lib/python3.11/site-packages/setuptools/_distutils/cmd.py", line 318, in run_command
        self.distribution.run_command(command)
      File "/usr/lib/python3.11/site-packages/setuptools/dist.py", line 1234, in run_command
        super().run_command(command)
      File "/usr/lib/python3.11/site-packages/setuptools/_distutils/dist.py", line 988, in run_command
        cmd_obj.run()
      File "/usr/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 84, in run
        _build_ext.run(self)
      File "/usr/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 345, in run
        self.build_extensions()
      File "/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/setup.py", line 342, in build_extensions
        super().build_extensions()
      File "/home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 864, in build_extensions
        build_ext.build_extensions(self)
      File "/usr/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 467, in build_extensions
        self._build_extensions_serial()
      File "/usr/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 493, in _build_extensions_serial
        self.build_extension(ext)
      File "/usr/lib/python3.11/site-packages/setuptools/command/build_ext.py", line 246, in build_extension
        _build_ext.build_extension(self, ext)
      File "/usr/lib/python3.11/site-packages/Cython/Distutils/build_ext.py", line 127, in build_extension
        super(build_ext, self).build_extension(ext)
      File "/usr/lib/python3.11/site-packages/setuptools/_distutils/command/build_ext.py", line 548, in build_extension
        objects = self.compiler.compile(
                  ^^^^^^^^^^^^^^^^^^^^^^
      File "/home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 677, in unix_wrap_ninja_compile
        _write_ninja_file_and_compile_objects(
      File "/home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1589, in _write_ninja_file_and_compile_objects
        _run_ninja_build(
      File "/home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/utils/cpp_extension.py", line 1932, in _run_ninja_build
        raise RuntimeError(message) from e
    RuntimeError: Error compiling objects for extension
    [end of output]

@ilikenwf ilikenwf changed the title Unable to build using current submodule revisions cfea89fab5e42a99f961d445ac2b06d4b43126ce Breaks building Jul 26, 2023
@ilikenwf ilikenwf changed the title cfea89fab5e42a99f961d445ac2b06d4b43126ce Breaks building cfea89fab Breaks build Jul 26, 2023
@ilikenwf
Copy link
Author

It fails at the link stages as a bunch of binaries appear missing?

/usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/flash_api.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim128_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim128_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim160_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim160_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim192_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim192_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim224_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim224_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim256_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim256_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim32_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim32_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim64_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim64_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim96_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim96_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim128_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim128_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim160_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim160_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim192_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim192_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim224_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim224_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim256_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim256_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim32_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim32_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim64_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim64_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim96_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim96_fp16_sm80.o: No such file or directory
    collect2: error: ld returned 1 exit status
    error: command '/usr/bin/g++' failed with exit code 1
    [end of output]

@ilikenwf
Copy link
Author

Ok so this may be a flash-attention bug:

Dao-AILab/flash-attention#358

@ilikenwf
Copy link
Author

Despite even attempting a git submodule update --init --recursive --force I still run into this issue...so if anyone finds anything, thank you very much.

@danthe3rd
Copy link
Contributor

Can you try deleting the repo and re-cloning it again? It looks like your submodules didn't get updated (you have the old flashv1 submodule, with a build code that expects flashv2 submodule)

@ilikenwf
Copy link
Author

Can you try deleting the repo and re-cloning it again? It looks like your submodules didn't get updated (you have the old flashv1 submodule, with a build code that expects flashv2 submodule)

Is this because I'm using cuda 12.1? If so, weird that those other commits build.

Recloned, was missing a submodule or two, however:

    Compiling objects...
    Allowing ninja to set a default number of workers... (overridable by setting the environment variable MAX_JOBS=N)
    1.11.1.git.kitware.jobserver-1
    creating build/lib.linux-x86_64-cpython-311
    creating build/lib.linux-x86_64-cpython-311/xformers
    g++ -shared -Wl,-O1,--sort-common,--as-needed,-z,relro,-z,now -flto=auto -Wl,-O1,--sort-common,--as-needed,-z,relro,-z,now -flto=auto /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/flash_api.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim128_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim128_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim160_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim160_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim192_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim192_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim224_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim224_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim256_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim256_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim32_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim32_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim64_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim64_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim96_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim96_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim128_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim128_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim160_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim160_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim192_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim192_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim224_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim224_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim256_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim256_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim32_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim32_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim64_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim64_fp16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim96_bf16_sm80.o /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim96_fp16_sm80.o -L/home/sd/stable-diffusion/stable-diffusion-webui/venv/lib/python3.11/site-packages/torch/lib -L/opt/cuda/lib64 -L/usr/lib -lc10 -ltorch -ltorch_cpu -ltorch_python -lcudart -lc10_cuda -ltorch_cuda -o build/lib.linux-x86_64-cpython-311/xformers/_C_flashattention.so
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/flash_api.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim128_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim128_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim160_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim160_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim192_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim192_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim224_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim224_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim256_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim256_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim32_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim32_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim64_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim64_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim96_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_bwd_hdim96_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim128_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim128_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim160_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim160_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim192_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim192_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim224_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim224_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim256_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim256_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim32_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim32_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim64_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim64_fp16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim96_bf16_sm80.o: No such file or directory
    /usr/bin/ld: cannot find /home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/build/temp.linux-x86_64-cpython-311/home/sd/stable-diffusion/stable-diffusion-webui/repositories/xformers/third_party/flash-attention/csrc/flash_attn/src/flash_fwd_hdim96_fp16_sm80.o: No such file or directory
    collect2: error: ld returned 1 exit status
    error: command '/usr/bin/g++' failed with exit code 1
    [end of output]

@ilikenwf
Copy link
Author

Downgrading all the cuda stuff to 11.8, and gcc to v11 appears to work.

@ilikenwf
Copy link
Author

So I need to try with cuda 12.x again just for fun but it appears ninja itself, even if one modifies the call to ninja -v in torch, is causing those files not to build. Uninstalling ninja takes longer to build, however those objects appear to be getting created.

@catalpaaa
Copy link

catalpaaa commented Jul 28, 2023 •
edited
Loading

ninja might make ur pc go out of memory, i ran MAX_JOBS=2 pip install -v -U git+https://github.com/facebookresearch/xformers.git@main#egg=xformers on my 16gb ram pc and it install (slooooooowly), change the MAX_JOBS to whatever fits you

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@ilikenwf @danthe3rd @catalpaaa