Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add to onboarding reproduction logs #2623

Merged
merged 1 commit into from
Oct 22, 2024
Merged

Conversation

Samantha-Zhan
Copy link
Contributor

Details on my setup (e.g., operating system, environment and configuration, etc.):

  • Windows Ubuntu 24.04.1 LTS (WSL2)
  • Java 21

The setup actually took me quite some time for a couple of reasons:

  1. I jumped straight into start-here by clicking on links inside the ura doc without reading readme; therefore, I had the repo setup locally on my windows for the first task, only to redo everything on Ubuntu for the second task.
  2. My Ubuntu had Java 11, and when I tried to build I got Fatal error compiling: invalid target release: 21. Referencing to an internal post, I was able to update Java version to 21, following these steps.
  3. I also got an additional build failure, where build took 13 minutes and the error was: Crashed tests: io.anserini.search.SimpleImpactSearcherTest. I actually was not able to locate the exact cause of this issue, and instead continue building with mvn clean package -DskipTests -Dmaven.javadoc.skip=true instead of mvn clean package, since this is irrelevant to current tasks.
    image
  4. In addition, when I am trying to run bin/run.sh script to create inverted index, I got java.lang.SecurityException for anserini-0.38.1-SNAPSHOT-fatjar.jar file. I had to manually unzip the jar, remove the signatures, and zip it back up.
  5. Following experiments-msmarco-passage.md, when created inverted index, I had to modify run.sh to change the -Xms option to 2GB and -Xmx to 6GB due to insufficient memory.

With that said, the actual theoretical knowledge and scripts in the tasks are very easy to follow and understand; I was also able to figure out unexplained terms and configurations through a quick google search.

@lintool lintool self-requested a review October 21, 2024 10:30
@lintool
Copy link
Member

lintool commented Oct 21, 2024

Hi @Samantha-Zhan

  • re: (3) any more details on what happened?
  • re: (4) what security exception did you get?

This is the first I've heard/seen of these issues, so I'd like to dig into a bit more...

@Samantha-Zhan
Copy link
Contributor Author

  • (3) any more details on what happened?
    I simply ran mvn clean package after recursively pulling the repo following the installation guide. I attempted it multiple times and realized the exact test that crushed seemed to be pretty arbitrary, and time it took to crush ranging from 5 minutes to 10 minutes:
    image
    Looking deeper into the error message, Process Exit Code: 137 means the process terminated due to out of memory. So I proceed to increase memory in pom.xml file from 8gb to 12gb, but it's still reporting code 137.
  • (4) what security exception did you get?
Error: A JNI error has occurred, please check your installation and try again
Exception in thread "main" java.lang.SecurityException: Invalid signature file digest for Manifest main attributes

The same error in #2621 and #2615 ; I took the same approach as #2615 to resolve this.

@lintool
Copy link
Member

lintool commented Oct 22, 2024

Hrm... really odd, on both accounts. Apparently, you're not the first one to report (4)... but it doesn't appear to be pervasive. We'll keep an eye on it.

@lintool lintool merged commit e2eb203 into castorini:master Oct 22, 2024
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants