Skip to content

bearpelican/cluster

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Cluster launcher

git clone https://github.com/diux-dev/cluster.git
export AWS_DEFAULT_REGION=us-west-2
export AWS_ACCESS_KEY_ID=AKIA...
export AWS_SECRET_ACCESS_KEY=KAa...

cd cluster
pip install -r requirements.txt
./create_resources_main.py
./launch_gpubox.py --instance-type=p2.xlarge --zone=us-west-2a

This creates necessary resources and launches p2.xlarge machine in zone us-west-2a with several ports open to outside traffic (8888, 8889, 8890, 6379, 6006, 6007, 6008) and EFS mounted at /efs. The script will print ssh instructions to use to connect, but also you can use connect utility in this folder to get in.

./connect gpubox

To bring down the instance, issue following command

./terminate gpubox

AWS resources will be reused for future invocations. If you want to delete the resources for some reason (ie, for debugging) first terminate all the instances, and then issue

./delete_resources.py

This this will delete EFS and all data contained within it, networking resources, keypair and local keypair file.

About

launcher tool for DAWN submission

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 78.4%
  • Jupyter Notebook 14.7%
  • Shell 6.3%
  • C++ 0.6%