Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Some fixed to Cluster Deployment and Jumpbox configuration #4

Open
wants to merge 26 commits into
base: master
Choose a base branch
from
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
26 commits
Select commit Hold shift + click to select a range
74bde07
added cassandra's default ports to Mesos Agents configuration
clca Oct 5, 2015
5d1b260
added unzip to cluster configuration
clca Oct 8, 2015
e9080fa
added zookeeper conf and java on Jumpbox
clca Oct 12, 2015
039f386
fixed mesos agent ports
clca Oct 13, 2015
9f5410d
fixed minor issues
clca Oct 13, 2015
ea88e26
fixed issues with resolv.conf
clca Oct 14, 2015
9d324e8
more fixes for resolv.conf
clca Oct 15, 2015
5b6af33
fixed more issues
clca Oct 16, 2015
30d905d
fixed issue
clca Oct 16, 2015
721b82f
added masters' IP address in resolv.conf so jumpbox can resolve servi…
clca Oct 19, 2015
b2f4704
added masters IP addresses to jumbox's resolv.conf file
clca Oct 20, 2015
e9e919a
fixed error in azuredeploy.json file
clca Oct 20, 2015
1cba27b
fixed issue on jumpbox-linux.json file
clca Oct 20, 2015
2b1da20
fixed issue'
clca Oct 20, 2015
6ccc4aa
fixed issue with command format in jumpbox-linux.json
clca Oct 20, 2015
f7d3fbb
fixed issue
clca Oct 20, 2015
0172928
fixed issue
clca Oct 20, 2015
d0e0906
fixed error
clca Oct 21, 2015
9941bfd
bug fix
clca Oct 21, 2015
f3e24f3
bug fix
clca Oct 21, 2015
d331bee
changed permission on Docker to allow AZUREUSER to run it without hav…
clca Oct 27, 2015
47b9e76
changed owner on DCOS directory & install.sh install script
clca Nov 2, 2015
5292ad7
updated mesos_dns version
clca Dec 7, 2015
34fcead
removed some params and used a naming scheme to generate them
clca Dec 7, 2015
2474691
fixed issue with StorageNamePrefix
clca Dec 7, 2015
15fd363
fixed issue with nameserver(s) on jumpbox
clca Dec 7, 2015
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@

This Microsoft Azure template creates an Apache Mesos cluster with Marathon, and Swarm on a configurable number of machines.

<a href="https://portal.azure.com/#create/Microsoft.Template/uri/https%3A%2F%2Fraw.neting.cc%2Fanhowe%2Fmesos-scalable-cluster%2Fmaster%2Fazuredeploy.json" target="_blank">
<a href="https://portal.azure.com/#create/Microsoft.Template/uri/https%3A%2F%2Fraw.neting.cc%2Fclca%2Fmesos-scalable-cluster%2Fmaster%2Fazuredeploy.json" target="_blank">
<img src="http://azuredeploy.net/deploybutton.png"/>
</a>

Expand All @@ -16,7 +16,7 @@ Once your cluster has been created you will have a resource group containing 3 p

The following image is an example of a cluster with 1 jumpbox, 3 masters, and 3 agents:

![Image of Mesos cluster on azure](https://raw.githubusercontent.com/anhowe/mesos-scalable-cluster/master/images/mesos.png)
![Image of Mesos cluster on azure](https://raw.githubusercontent.com/clca/mesos-scalable-cluster/master/images/mesos.png)

You can see the following parts:

Expand Down
6 changes: 0 additions & 6 deletions agent-0.json
Original file line number Diff line number Diff line change
Expand Up @@ -14,12 +14,6 @@
"description": "Username for the Virtual Machine."
}
},
"adminPassword": {
"type": "securestring",
"metadata": {
"description": "Password for the Virtual Machine."
}
},
"dnsNameForApplicationPublicIP": {
"type": "string",
"metadata": {
Expand Down
6 changes: 0 additions & 6 deletions agent-gt0.json
Original file line number Diff line number Diff line change
Expand Up @@ -14,12 +14,6 @@
"description": "Username for the Virtual Machine."
}
},
"adminPassword": {
"type": "securestring",
"metadata": {
"description": "Password for the Virtual Machine."
}
},
"dnsNameForApplicationPublicIP": {
"type": "string",
"metadata": {
Expand Down
128 changes: 38 additions & 90 deletions azuredeploy.json
Original file line number Diff line number Diff line change
Expand Up @@ -2,10 +2,10 @@
"$schema": "https://schema.management.azure.com/schemas/2015-01-01/deploymentTemplate.json#",
"contentVersion": "1.0.0.0",
"parameters": {
"newStorageAccountNamePrefix": {
"clusterName": {
"type": "string",
"metadata": {
"description": "Globally Unique DNS Name Prefix for the Storage Account where the Virtual Machine's disks will be placed. An integer will be appended to the end. StorageAccounts may contain at most variables('vmsPerStorageAccount')"
"description": "name used to identify the cluster, storage, jumpbox public endpoints and other params will be based on the value of this parameter."
}
},
"adminUsername": {
Expand All @@ -15,30 +15,6 @@
"description": "User name for the Virtual Machine."
}
},
"adminPassword": {
"type": "securestring",
"metadata": {
"description": "Password for the Virtual Machine."
}
},
"dnsNameForJumpboxPublicIP": {
"type": "string",
"metadata": {
"description": "Sets the Domain name label for the jumpbox. The concatenation of the domain name label and the regionalized DNS zone make up the fully qualified domain name associated with the public IP address."
}
},
"dnsNameForContainerServicePublicIP": {
"type": "string",
"metadata": {
"description": "Sets the Domain name label for the container service. The concatenation of the domain name label and the regionalized DNS zone make up the fully qualified domain name associated with the public IP address."
}
},
"dnsNameForApplicationPublicIP": {
"type": "string",
"metadata": {
"description": "Sets the Domain name label for the application. The concatenation of the domain name label and the regionalized DNS zone make up the fully qualified domain name associated with the public IP address."
}
},
"agentCount": {
"type": "int",
"defaultValue": 1,
Expand All @@ -60,7 +36,7 @@
},
"jumpboxConfiguration": {
"type": "string",
"defaultValue": "windows",
"defaultValue": "linux",
"allowedValues": [
"none",
"linux",
Expand All @@ -70,48 +46,38 @@
"description": "Choose to have a jumpbox for debugging on the private subnet."
}
},
"masterConfiguration": {
"type": "string",
"defaultValue": "masters-are-not-agents",
"allowedValues": [
"masters-are-agents",
"masters-are-not-agents"
],
"metadata": {
"description": "Specify whether masters should act as agents or not."
}
},
"agentVMSize": {
"type": "string",
"defaultValue": "Standard_D1",
"defaultValue": "Standard_A2",
"allowedValues": [
"Standard_A1",
"Standard_D1",
"Standard_A1",
"Standard_A3",
"Standard_A4",
"Standard_A5",
"Standard_A6",
"Standard_A7",
"Standard_A8",
"Standard_D2",
"Standard_D3",
"Standard_D4",
"Standard_D11",
"Standard_D12",
"Standard_D13",
"Standard_D14"
"Standard_D13"
],
"metadata": {
"description": "The size of the Virtual Machine."
}
},
"masterVMSize": {
"type": "string",
"defaultValue": "Standard_D1",
"defaultValue": "Standard_A2",
"allowedValues": [
"Standard_A1",
"Standard_D1",
"Standard_D2",
"Standard_D3",
"Standard_D4",
"Standard_D11",
"Standard_D12",
"Standard_D13",
"Standard_D14"
"Standard_D4"
],
"metadata": {
"description": "The size of the Virtual Machine for the master."
Expand All @@ -123,25 +89,12 @@
"allowedValues": [
"Standard_A1",
"Standard_D1",
"Standard_D2",
"Standard_D3",
"Standard_D4",
"Standard_D11",
"Standard_D12",
"Standard_D13",
"Standard_D14"
"Standard_D2"
],
"metadata": {
"description": "The size of the Virtual Machine for the jumpbox."
}
},
"clusterPrefix": {
"type": "string",
"defaultValue": "c1",
"metadata": {
"description": "The prefix to identify the cluster."
}
},
"swarmEnabled": {
"type": "string",
"defaultValue": "false",
Expand Down Expand Up @@ -177,7 +130,7 @@
},
"sshRSAPublicKey": {
"type": "string",
"defaultValue": "disabled",
"defaultValue": "",
"metadata": {
"description": "Configure all linux machines with the SSH rsa public key string. Use 'disabled' to not configure access with SSH rsa public key."
}
Expand All @@ -191,15 +144,19 @@
},
"omsStorageAccountKey": {
"type": "securestring",
"defaultValue":"none",
"metadata": {
"description": "The Azure Storage account primary or secondary key for OMS log data. Use 'none' to disable."
}
}
},
"variables": {
"masterVMNamePrefix": "[concat(parameters('clusterPrefix'),'master')]",
"agentVMNamePrefix": "[concat(parameters('clusterPrefix'),'agent')]",
"jumpboxVMNamePrefix": "[concat(parameters('clusterPrefix'),'jumpbox')]",
"newStorageAccountNamePrefix": "[concat(parameters('clusterName'),'storage')]",
"dnsNameForApplicationPublicIP":"[parameters('clusterName')]",
"dnsNameForJumpboxPublicIP": "[concat(parameters('clusterName'),'jb')]",
"masterVMNamePrefix": "master",
"agentVMNamePrefix": "agent",
"jumpboxVMNamePrefix": "jb",
"osImagePublisher": "Canonical",
"osImageOffer": "UbuntuServer",
"osImageSKU": "14.04.3-LTS",
Expand All @@ -213,10 +170,10 @@
"jumpboxAddr": 4,
"masterFirstAddr": 5,
"agentFirstAddr": 50,
"nsgName": "node-nsg",
"nsgName": "agent-nsg",
"nsgID": "[resourceId('Microsoft.Network/networkSecurityGroups',variables('nsgName'))]",
"storageAccountType": "Standard_GRS",
"customScriptLocation": "https://raw.githubusercontent.com/anhowe/mesos-scalable-cluster/master/",
"customScriptLocation": "https://raw.githubusercontent.com/clca/mesos-scalable-cluster/master/",
"agentFiles": [
"agent-0.json",
"agent-gt0.json"
Expand All @@ -228,7 +185,7 @@
"resources": [
{
"type": "Microsoft.Storage/storageAccounts",
"name": "[concat(parameters('newStorageAccountNamePrefix'),'0')]",
"name": "[variables('newStorageAccountNamePrefix')]",
"apiVersion": "2015-05-01-preview",
"location": "[resourceGroup().location]",
"properties": {
Expand Down Expand Up @@ -319,7 +276,7 @@
"type": "Microsoft.Resources/deployments",
"name": "createMasterNodes",
"dependsOn": [
"[concat('Microsoft.Storage/storageAccounts/', parameters('newStorageAccountNamePrefix'), '0')]",
"[concat('Microsoft.Storage/storageAccounts/', variables('newStorageAccountNamePrefix'))]",
"[variables('vnetID')]"
],
"properties": {
Expand All @@ -330,13 +287,7 @@
},
"parameters": {
"newStorageAccountName": {
"value": "[concat(parameters('newStorageAccountNamePrefix'), '0')]"
},
"adminUsername": {
"value": "[parameters('adminUsername')]"
},
"adminPassword": {
"value": "[parameters('adminPassword')]"
"value": "[variables('newStorageAccountNamePrefix')]"
},
"dnsNameForContainerServicePublicIP": {
"value": "[parameters('dnsNameForContainerServicePublicIP')]"
Expand Down Expand Up @@ -413,13 +364,7 @@
},
"parameters": {
"newStorageAccountNamePrefix": {
"value": "[concat(parameters('newStorageAccountNamePrefix'))]"
},
"adminUsername": {
"value": "[parameters('adminUsername')]"
},
"adminPassword": {
"value": "[parameters('adminPassword')]"
"value": "[concat(varibles('newStorageAccountNamePrefix'))]"
},
"dnsNameForApplicationPublicIP": {
"value": "[parameters('dnsNameForApplicationPublicIP')]"
Expand Down Expand Up @@ -489,7 +434,7 @@
"type": "Microsoft.Resources/deployments",
"name": "createJumpbox",
"dependsOn": [
"[concat('Microsoft.Storage/storageAccounts/', parameters('newStorageAccountNamePrefix'), '0')]",
"[concat('Microsoft.Storage/storageAccounts/', variables('newStorageAccountNamePrefix'))]",
"[variables('vnetID')]"
],
"properties": {
Expand All @@ -500,14 +445,11 @@
},
"parameters": {
"newStorageAccountName": {
"value": "[concat(parameters('newStorageAccountNamePrefix'), '0')]"
"value": "[variables('newStorageAccountNamePrefix')]"
},
"adminUsername": {
"adminUsername": {
"value": "[parameters('adminUsername')]"
},
"adminPassword": {
"value": "[parameters('adminPassword')]"
},
"dnsNameForJumpboxPublicIP": {
"value": "[parameters('dnsNameForJumpboxPublicIP')]"
},
Expand All @@ -534,6 +476,12 @@
},
"sshRSAPublicKey": {
"value": "[parameters('sshRSAPublicKey')]"
},
"masterCount": {
"value": "[parameters('masterCount')]"
},
"masterFirstAddr": {
"value": "[variables('masterFirstAddr')]"
}
}
}
Expand Down
56 changes: 0 additions & 56 deletions azuredeploy.parameters.json

This file was deleted.

Loading