Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[CI] SplitIndexIT and ShrinkIndexIT failing on Windows #34080

Closed
droberts195 opened this issue Sep 26, 2018 · 4 comments
Closed

[CI] SplitIndexIT and ShrinkIndexIT failing on Windows #34080

droberts195 opened this issue Sep 26, 2018 · 4 comments
Labels
:Distributed Indexing/Recovery Anything around constructing a new shard, either from a local or a remote source. >test-failure Triaged test failures from CI

Comments

@droberts195
Copy link
Contributor

The last couple of master branch builds on Windows have both failed in SplitIndexIT:

The underlying errors are all "access denied" errors on the mock file system, for example:

11:57:23   1> java.io.IOException: could not remove the following files (in the order of attempts):
11:57:23   1>    C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\server\build\testrun\integTest\J1\temp\org.elasticsearch.action.admin.indices.create.ShrinkIndexIT_405F969E6898DB55-001\tempDir-002\data\nodes\4\indices\B7bnisfXSMyFJxC9q7WYIw\1\index\_1.cfs: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\server\build\testrun\integTest\J1\temp\org.elasticsearch.action.admin.indices.create.ShrinkIndexIT_405F969E6898DB55-001\tempDir-002\data\nodes\4\indices\B7bnisfXSMyFJxC9q7WYIw\1\index\_1.cfs
11:57:23   1>    C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\server\build\testrun\integTest\J1\temp\org.elasticsearch.action.admin.indices.create.ShrinkIndexIT_405F969E6898DB55-001\tempDir-002\data\nodes\4\indices\B7bnisfXSMyFJxC9q7WYIw\1\index\_0.fdt: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\server\build\testrun\integTest\J1\temp\org.elasticsearch.action.admin.indices.create.ShrinkIndexIT_405F969E6898DB55-001\tempDir-002\data\nodes\4\indices\B7bnisfXSMyFJxC9q7WYIw\1\index\_0.fdt

00:02:41   1> Caused by: java.nio.file.AccessDeniedException: C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\server\build\testrun\integTest\J2\temp\org.elasticsearch.routing.PartitionedRoutingIT_5A9F10A979AB2913-001\tempDir-002\data\nodes\2\indices\KiXyWWFtR-eDKkRq7WbiQQ\0\index\recovery.2djnkuBpQRaGON-ebaigZg._0.cfs -> C:\Users\jenkins\workspace\elastic+elasticsearch+master+multijob-windows-compatibility\server\build\testrun\integTest\J2\temp\org.elasticsearch.routing.PartitionedRoutingIT_5A9F10A979AB2913-001\tempDir-002\data\nodes\2\indices\KiXyWWFtR-eDKkRq7WbiQQ\0\index\_0.cfs
00:02:41 
00:02:41   1> 	at sun.nio.fs.WindowsException.translateToIOException(WindowsException.java:83) ~[?:?]
00:02:41 
00:02:41   1> 	at sun.nio.fs.WindowsException.rethrowAsIOException(WindowsException.java:97) ~[?:?]
00:02:41 
00:02:41   1> 	at sun.nio.fs.WindowsFileCopy.move(WindowsFileCopy.java:301) ~[?:?]
00:02:41 
00:02:41   1> 	at sun.nio.fs.WindowsFileSystemProvider.move(WindowsFileSystemProvider.java:287) ~[?:?]
00:02:41 
00:02:41   1> 	at org.apache.lucene.mockfile.FilterFileSystemProvider.move(FilterFileSystemProvider.java:147) ~[lucene-test-framework-8.0.0-snapshot-7d0a7782fa.jar:8.0.0-snapshot-7d0a7782fa 7d0a7782fa7e99250bccfb4d3e995485c3f0ca19 - jimczi - 2018-09-18 14:02:40]

This feels like something similar to #30416 which was fixed by #30571, but maybe something changed in Lucene 8 that means the fix needs to be updated?
@droberts195 droberts195 added >test-failure Triaged test failures from CI :Distributed Indexing/Recovery Anything around constructing a new shard, either from a local or a remote source. labels Sep 26, 2018
@droberts195 droberts195 changed the title [CI] SplitIndexIT failing on Windows [CI] SplitIndexIT and ShrinkIndexIT failing on Windows Sep 26, 2018
@droberts195
Copy link
Contributor Author

Some repro commands are:

./gradlew :server:integTest \
  -Dtests.seed=405F969E6898DB55 \
  -Dtests.class=org.elasticsearch.action.admin.indices.create.SplitIndexIT \
  -Dtests.method="testSplitFromOneToN" \
  -Dtests.security.manager=true \
  -Dtests.locale=fr-FR \
  -Dtests.timezone=Europe/Astrakhan \
  -Dcompiler.java=10 \
  -Druntime.java=8

./gradlew :server:integTest \
  -Dtests.seed=405F969E6898DB55 \
  -Dtests.class=org.elasticsearch.action.admin.indices.create.ShrinkIndexIT \
  -Dtests.method="testCreateShrinkIndexToN" \
  -Dtests.security.manager=true \
  -Dtests.locale=nl \
  -Dtests.timezone=IST \
  -Dcompiler.java=10 \
  -Druntime.java=8

droberts195 added a commit that referenced this issue Sep 26, 2018
@droberts195
Mute testSplitFromOneToN and testCreateShrinkIndexToN on Windows
1413ace 
Relates #34080
@droberts195
Copy link
Contributor Author

I muted SplitIndexIT.testSplitFromOneToN and ShrinkIndexIT.testCreateShrinkIndexToN on Windows only in 1413ace

@s1monw
Copy link
Contributor

s1monw commented Sep 26, 2018

I am pretty sure this is entirely unrelated to the referenced PRs and issues. This seems to be an infra issue and a duplicate of #33857 @droberts195 WDYT?

@droberts195
Copy link
Contributor Author

Yes, sorry, this is a duplicate of #33857.

kcm pushed a commit that referenced this issue Oct 30, 2018
@droberts195 @kcm
Mute testSplitFromOneToN and testCreateShrinkIndexToN on Windows
9aa560e 
Relates #34080
@pxsalehi pxsalehi mentioned this issue Feb 6, 2023
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
:Distributed Indexing/Recovery Anything around constructing a new shard, either from a local or a remote source. >test-failure Triaged test failures from CI
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@s1monw @droberts195