Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUGFIX] Art: fix dm_only frontend #2688

Merged
merged 6 commits into from
Jun 29, 2020
Merged

[BUGFIX] Art: fix dm_only frontend #2688

merged 6 commits into from
Jun 29, 2020

Conversation

cphyc
Copy link
Member

@cphyc cphyc commented Jun 25, 2020

PR Summary

Removes tests that are intended for particle datasets. They were incorrectly run on ART, an octree dataset.

@cphyc cphyc added bug tests: running tests Issues with the test setup yt-4.0 feature targeted for the yt-4.0 release labels Jun 25, 2020
@matthewturk
Copy link
Member

Looks good to me. I think @munkm pointed out somewhere that there's a different DM-only ART sim we could test.

@munkm
Copy link
Member

munkm commented Jun 26, 2020

Yes I did in the slack. i'll update the test. It's the DMonly dataset.

@Xarthisius
Copy link
Member

Looks like DMonly dataset is not recognized as a valid ART file

@cphyc
Copy link
Member Author

cphyc commented Jun 27, 2020

Note: cbd1a68 and b5cfe9f are merely an attempt at making things work ; I am not entirely sure about them, so please feel free to overwrite them.

@Xarthisius
Copy link
Member

I had to kill the test run. It was stuck in some sort of an infinite loop and consuming 108GB of RAM...
Strace showed only this:

openat(AT_FDCWD, "/mnt/yt/DMonly/PMcrs0.0100.DAT", O_RDONLY|O_CLOEXEC) = 15
fstat(15, {st_mode=S_IFREG|0664, st_size=402653184, ...}) = 0
ioctl(15, SNDCTL_TMR_TIMEBASE or SNDRV_TIMER_IOCTL_NEXT_DEVICE or TCGETS, 0x7ffd320aaf50) = -1 ENOTTY (Inappropriate ioctl for device)
lseek(15, 0, SEEK_CUR)                  = 0
lseek(15, 0, SEEK_END)                  = 402653184
lseek(15, 0, SEEK_CUR)                  = 402653184
close(15)

@cphyc
Copy link
Member Author

cphyc commented Jun 27, 2020

I had to kill the test run. It was stuck in some sort of an infinite loop and consuming 108GB of RAM...
Strace showed only this:

openat(AT_FDCWD, "/mnt/yt/DMonly/PMcrs0.0100.DAT", O_RDONLY|O_CLOEXEC) = 15
fstat(15, {st_mode=S_IFREG|0664, st_size=402653184, ...}) = 0
ioctl(15, SNDCTL_TMR_TIMEBASE or SNDRV_TIMER_IOCTL_NEXT_DEVICE or TCGETS, 0x7ffd320aaf50) = -1 ENOTTY (Inappropriate ioctl for device)
lseek(15, 0, SEEK_CUR)                  = 0
lseek(15, 0, SEEK_END)                  = 402653184
lseek(15, 0, SEEK_CUR)                  = 402653184
close(15)

The tests should now pass, but if anyone has some experience with ART datasets, that would be valuable as I am unsure about the correctness of my fixes.

@cphyc
Copy link
Member Author

cphyc commented Jun 29, 2020

@yt-fido test this please

@munkm munkm changed the title [BUGFIX] Art: remove erroneous test [BUGFIX] Art: fix dm_only frontend Jun 29, 2020
@matthewturk
Copy link
Member

So I think this is part of a bigger problem, which is that not all of the frontends have had their range arguments implemented. But as long as this works, it's fine. In #2658 I tried to make this more formal, by making it obvious, but that one's not yet in.

@cphyc
Copy link
Member Author

cphyc commented Jun 29, 2020

Agreed. But even with #2658 in, we'd still have the problem that particle frontends with no implementation of chunking will fail, even with CHUNKSIZE=∞

@matthewturk
Copy link
Member

matthewturk commented Jun 29, 2020 via email

@munkm munkm merged commit d6485fa into yt-project:master Jun 29, 2020
@cphyc cphyc deleted the fix/ART branch June 29, 2020 18:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug tests: running tests Issues with the test setup yt-4.0 feature targeted for the yt-4.0 release
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants