Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Error- HdfsLockFactory, Requested replication 3 exceeds maximum 1 #4

Open
dsmiley opened this issue Oct 5, 2014 · 0 comments
Open

Comments

@dsmiley
Copy link

dsmiley commented Oct 5, 2014

I've been trying to try this out but keep running into issues. I've gotten it to this point where one of the Solr nodes tries to start up using HDFS but fails to write the lock file (SOLR-6305 seems related):

ERROR org.apache.solr.store.hdfs.HdfsLockFactory  – Error creating lock file
org.apache.hadoop.ipc.RemoteException(java.io.IOException): file /solr1/collection1/core_node1/data/index/HdfsDirectory@5e0613e0 lockFactory=org.apache.solr.store.hdfs.HdfsLockFactory@273b003e-write.lock on client 127.0.0.1.
Requested replication 3 exceeds maximum 1

FYI I started by cloning the repo and immediately running the run-example.sh. First it failed because 4.8.0 couldn't be found at the URL indicated so I bumped the rev to 4.8.1 and got past that. Then, I ran into some odd exception pertaining to XPath, which was related to a Java 8 incompatibility with the version of Saxon Solr is using. I bumped Saxon to Saxon-HE-9.6.0-1.jar which resolves that issue. Then I ran into something else that I forget and I dropped my Java version to 1.7 to be safe. This time, the map reduce merging happened but the GoLive stage failed because it couldn't find collection1. The error I saw was confusingly "org.apache.solr.common.cloud.ZooKeeperException: Could not find configName for collection collection1 found:null". I decided to edit the bash script to exit out early before starting the solr nodes so that I could start them by hand. When I started the first node, I ultimately got the Hdfs error pertaining the replication setting that I reported above. (note: I didn't have to start them by hand; I just needed to look at Solr's log files)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant