This repository has been archived by the owner on May 3, 2024. It is now read-only.
-
Notifications
You must be signed in to change notification settings - Fork 142
Motr deployment using motr_setup on singlenode VM
Madhavrao Vemuri edited this page Apr 29, 2021
·
44 revisions
- VM should have a enough data disks based on cluster configuration (data + parity + spare) and metadata disk for each io service.
for ex :
- for 1+0 (N+K), there should be a minimum 2 disks, 1 for data disk and 1 for metadata disk. Recommended to configure 6 disks (2 data disk for each io service, 1 metadata disk for each io service). For 4 + 2 +2, minimum 10 disks (8 for data and two for meta-data) are needed.
curl -s http://cortx-storage.colo.seagate.com/releases/cortx/third-party-deps/rpm/install-cortx-prereq.sh | bash
yum-config-manager --add-repo=http://cortx-storage.colo.seagate.com/releases/cortx/github/integration-custom-ci/release/centos-7.8.2003/custom-build-510/cortx_iso/
yum-config-manager --add-repo=http://cortx-storage.colo.seagate.com/releases/cortx/github/integration-custom-ci/release/centos-7.8.2003/custom-build-510/3rd_party/
yum-config-manager --add-repo=http://cortx-storage.colo.seagate.com/releases/cortx/github/integration-custom-ci/release/centos-7.8.2003/custom-build-510/3rd_party/lustre/custom/tcp/
yum install -y cortx-motr cortx-hare cortx-py-utils --nogpgcheck
rm -f /etc/machine-id /var/lib/dbus/machine-id
dbus-uuidgen --ensure=/etc/machine-id
dbus-uuidgen --ensure
systemctl status network
cat /etc/machine-id
post_install
- TMPL_MACHINE_ID - Machine ID, refer Create Machind ID for details
- TMPL_NAME - Name of the node, for ex : srvnode-1, srvnode-2, etc
- TMPL_DATADEVICE_00 - first Data device for group 0, default: /dev/sdc
- TMPL_DATADEVICE_01 - second Data device for group 0, default: /dev/sdd
- TMPL_METADATADEVICE_00 - first Metadata disk device for group 0, default:/dev/sdb
- TMPL_DATADEVICE_10 - first Data device for group 1, default:/dev/sdf
- TMPL_DATADEVICE_11- second Data device for group 1, default:/dev/sdg
- TMPL_METADATADEVICE_10 - first Metadata disk device for group 1, default:/dev/sde
- TMPL_CVG_NR_GROUP - Number of disk groups, default:2
- TMPL_CLUSTER_ID - Cluster ID, default:5c427765-ecf5-4387-bfa4-d6d53494b159
- TMPL_POOL_DATA - Pool configuration or cluster configuration for data units, default: 1
- TMPL_POOL_PARITY - Pool configuration or cluster configuration for parity units, default: 0
- TMPL_POOL_SPARE - Pool configuration or cluster configuration for spare units, default: 0
prepare
- TMPL_MACHINE_ID - Machine ID, refer Create Machind ID for details
- TMPL_DATADEVICE_00 - first Data device for group 0, default: /dev/sdc
- TMPL_DATADEVICE_01 - second Data device for group 0, default: /dev/sdd
- TMPL_METADATADEVICE_00 - first Metadata disk device for group 0, default:/dev/sdb
- TMPL_DATADEVICE_10 - first Data device for group 1, default:/dev/sdf
- TMPL_DATADEVICE_11- second Data device for group 1, default:/dev/sdg
- TMPL_METADATADEVICE_10 - first Metadata disk device for group 1, default:/dev/sde
- TMPL_CVG_NR_GROUP - Number of disk groups, default:2
- TMPL_IFACE_TYPE - Interface type(tcp, o2ib, etc), default:tcp
- TMPL_INTERFACE - private data interface, defaule:eth1
- TMPL_XPORT_TYPE - Transport type(lnet or libfabric), Default: lnet
- TMPL_CLUSTER_ID - Cluster ID
- TMPL_POOL_DATA - Pool config for data units, Default 1
- TMPL_POOL_PARITY - Pool config for parity units, Default 0
- TMPL_POOL_SPARE - Pool config for spare units, Default 0
config
- TMPL_MACHINE_ID - Machine ID, refer Create Machind ID for details
- TMPL_TYPE - Node type "HW or VM", Default: VM
test
- TMPL_MACHINE_ID - Machine ID, refer Create Machind ID for details
- TMPL_HOSTNAME - Hostname of the current node using hostname --fqdn
Run mini provisioner using template.
/opt/seagate/cortx/motr/bin/motr_setup post_install --config yaml:///opt/seagate/cortx/motr/conf/motr.post_install.tmpl
/opt/seagate/cortx/motr/bin/motr_setup prepare --config yaml:///opt/seagate/cortx/motr/conf/motr.prepare.tmpl
/opt/seagate/cortx/motr/bin/motr_setup config --config yaml:///opt/seagate/cortx/motr/conf/motr.config.tmpl
/opt/seagate/cortx/motr/bin/motr_setup test --config yaml:///opt/seagate/cortx/motr/conf/motr.test.tmpl
MACHINEID1=`cat /etc/machine-id`
CLUSTER_ID=5c427765-ecf5-4387-bfa4-d6d53494b159
HOSTNAME1=`hostname`
nr_grp="2"
data="1"
parity="0"
spare="0"
sed -i "s#TMPL_MACHINE_ID#$MACHINEID1#" /opt/seagate/cortx/motr/conf/motr.post_install.tmpl
sed -i "s#TMPL_NAME#srvnode-1#" /opt/seagate/cortx/motr/conf/motr.post_install.tmpl
sed -i "s#TMPL_DATADEVICE_00#/dev/sdc#" /opt/seagate/cortx/motr/conf/motr.post_install.tmpl
sed -i "s#TMPL_DATADEVICE_01#/dev/sdd#" /opt/seagate/cortx/motr/conf/motr.post_install.tmpl
sed -i "s#TMPL_METADATADEVICE_00#/dev/sdb#" /opt/seagate/cortx/motr/conf/motr.post_install.tmpl
sed -i "s#TMPL_DATADEVICE_10#/dev/sdf#" /opt/seagate/cortx/motr/conf/motr.post_install.tmpl
sed -i "s#TMPL_DATADEVICE_11#/dev/sdg#" /opt/seagate/cortx/motr/conf/motr.post_install.tmpl
sed -i "s#TMPL_METADATADEVICE_10#/dev/sde#" /opt/seagate/cortx/motr/conf/motr.post_install.tmpl
sed -i "s#TMPL_CVG_NR_GROUP#'$nr_grp'#" /opt/seagate/cortx/motr/conf/motr.post_install.tmpl
sed -i "s#TMPL_CLUSTER_ID#$CLUSTER_ID#" /opt/seagate/cortx/motr/conf/motr.post_install.tmpl
sed -i "s#TMPL_POOL_DATA#$data#" /opt/seagate/cortx/motr/conf/motr.post_install.tmpl
sed -i "s#TMPL_POOL_PARITY#$parity#" /opt/seagate/cortx/motr/conf/motr.post_install.tmpl
sed -i "s#TMPL_POOL_SPARE#$spare#" /opt/seagate/cortx/motr/conf/motr.post_install.tmpl
sed -i "s#TMPL_MACHINE_ID#$MACHINEID1#" /opt/seagate/cortx/motr/conf/motr.prepare.tmpl
sed -i "s#TMPL_DATADEVICE_00#/dev/sdc#" /opt/seagate/cortx/motr/conf/motr.prepare.tmpl
sed -i "s#TMPL_DATADEVICE_01#/dev/sdd#" /opt/seagate/cortx/motr/conf/motr.prepare.tmpl
sed -i "s#TMPL_DATADEVICE_10#/dev/sdf#" /opt/seagate/cortx/motr/conf/motr.prepare.tmpl
sed -i "s#TMPL_DATADEVICE_11#/dev/sdg#" /opt/seagate/cortx/motr/conf/motr.prepare.tmpl
sed -i "s#TMPL_CVG_NR_GROUP#'$nr_grp'#" /opt/seagate/cortx/motr/conf/motr.prepare.tmpl
sed -i "s#TMPL_IFACE_TYPE#tcp#" /opt/seagate/cortx/motr/conf/motr.prepare.tmpl
sed -i "s#TMPL_INTERFACE#eth1#" /opt/seagate/cortx/motr/conf/motr.prepare.tmpl
sed -i "s#TMPL_XPORT_TYPE#lnet#" /opt/seagate/cortx/motr/conf/motr.prepare.tmpl
sed -i "s#TMPL_CLUSTER_ID#$CLUSTER_ID#" /opt/seagate/cortx/motr/conf/motr.prepare.tmpl
sed -i "s#TMPL_POOL_DATA#'$data'#" /opt/seagate/cortx/motr/conf/motr.prepare.tmpl
sed -i "s#TMPL_POOL_PARITY#'$parity'#" /opt/seagate/cortx/motr/conf/motr.prepare.tmpl
sed -i "s#TMPL_POOL_SPARE#'$spare'#" /opt/seagate/cortx/motr/conf/motr.prepare.tmpl
sed -i "s#TMPL_MACHINE_ID#$MACHINEID1#" /opt/seagate/cortx/motr/conf/motr.config.tmpl
sed -i "s#TMPL_TYPE#VM#" /opt/seagate/cortx/motr/conf/motr.config.tmpl
sed -i "s#TMPL_MACHINE_ID#$MACHINEID1#" /opt/seagate/cortx/motr/conf/motr.test.tmpl
sed -i "s#TMPL_HOSTNAME#$HOSTNAME1#" /opt/seagate/cortx/motr/conf/motr.test.tmpl
UJJWAL: THIS STEP NEEDS TO BE AVOIDED. NOTE, THIS WILL NOT BE RUN BY CORTX PROVISIONER. THIS CAN BE DONE IN INIT INTERFACE.
- Create a cdf file, See reference section 1 for more details https://raw.githubusercontent.com/Seagate/cortx-motr/create_confstorekey/scripts/install/opt/seagate/cortx/motr/share/examples/singlenode.yaml and modify hostname - {HOSTNAME1} parameter.
- bootstrap cluster.
hctl bootstrap --mkfs /root/singlenode.yaml
Test IO Testing:
dd if=/dev/urandom of=/tmp/128M bs=1M count=128
/opt/seagate/cortx/hare/libexec/m0crate-io-conf > /tmp/m0crate-io.yaml
m0crate -S /tmp/m0crate-io.yaml