Setting up a dev environment

[ksideris]

I am wondering what is the best way to setup a test environment for maven (extension and spark components).

[kbastani]

Hi @ksideris, the best way to setup a test environment is to use your local file system instead of HDFS, which is configurable on both the Extension and Spark module. This will of course be much slower than HDFS but it is an easy way to get up and running with development. My process for adding Scala algorithms has been to create unit tests in the Spark module and simulate the data coming in from Neo4j by randomly generating a graph with a similar complexity to what you would see in a scaled down export from Neo4j. Doing this I can develop and test algorithms pretty quickly and hopefully not need to make changes to the Extension module, making the build process pretty simple.

Let me know how you've been doing it and if you know of a better way to make this easier for contributors.