Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using atomicwrites on Unix causes slowdown via fsync on the dir #6147

Closed
blueyed opened this issue Nov 7, 2019 · 0 comments
Closed

Using atomicwrites on Unix causes slowdown via fsync on the dir #6147

blueyed opened this issue Nov 7, 2019 · 0 comments

Comments

@blueyed
Copy link
Contributor

blueyed commented Nov 7, 2019

In aa95a42 (via #3390) atomicwrites was added to fix an issue on Windows (to fix #3008).

It does not appear to have been necessary for non-Windows systems, and is actually causing a slowdown there (pytest --collect-only: 5s => 8s on pytest's repo, with cleaned .pyc files of course).

The problem is that it calls fsync on the dir, which is not really necessary (untitaker/python-atomicwrites#17 (comment)).

I think we should revert / change this to only use atomicwrites on Windows.

blueyed added a commit to blueyed/pytest that referenced this issue Nov 7, 2019
blueyed added a commit to blueyed/pytest that referenced this issue Nov 7, 2019
blueyed added a commit to blueyed/pytest that referenced this issue Nov 7, 2019
blueyed added a commit to blueyed/pytest that referenced this issue Nov 7, 2019
blueyed added a commit to blueyed/pytest that referenced this issue Nov 7, 2019
@blueyed blueyed closed this as completed Nov 7, 2019
iarspider added a commit to iarspider/spack that referenced this issue Jun 3, 2020
Dropping atomicwrites dependency: pytest-dev/pytest#6147
adamjstewart pushed a commit to spack/spack that referenced this issue Jun 4, 2020
Dropping atomicwrites dependency: pytest-dev/pytest#6147
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant