I have been trying to deploy ceph cluster via ansible. When I tried to render my deploy_ceph_cluster.sh.j2 into a shell script, I got some problems. For better illustration, I will provide a minimal working example.
Here is my inventory file:
# inventory
[local]
localhost ansible_host=127.0.0.1 ansible_connection=local
[ceph_osd]
node1 ansible_host=192.168.1.2 rules="{'rule1': {'bcache': 'none', 'disks': '["/dev/sda", "/dev/sdc", "/dev/sdd", "/dev/sde"]'}}"
node2 ansible_host=192.168.1.3 rules="{'rule1': {'bcache': 'none', 'disks': '["/dev/sda", "/dev/sdc", "/dev/sdd", "/dev/sde"]'}}"
node3 ansible_host=192.168.1.4 rules="{'rule1': {'bcache': 'none', 'disks': '["/dev/sda", "/dev/sdc", "/dev/sdd", "/dev/sde"]'}}"
My jinja2 template file:
#!/bin/sh
createOSD() {
{% for host in groups['ceph_osd'] %}
{% for rule in hostvars[host].rules.values() %}
{% if rule.bcache != 'none' %}
ssh {{ host }} make-bcache -B {{ rule.disks | join(' ') }} -C {{ rule.bcache }} --wipe-bcache
bcache_name=$(lsblk -o KNAME {{ rule.bcache }} | grep bcache)
ssh {{ host }} echo writeback > /sys/block/$bcache_name/bcache/cache_mode
ceph-deploy osd create --data /dev/$bcache_name {{ host }}
{% else %}
echo {{rule.disks}}
{% for disk in rule.disks %}
ceph-deploy osd create --data {{ disk }} {{ host }}
{% endfor %}
{% endif %}
{% endfor %}
{% endfor %}
}
createOSD
And finally, my deploy.yml is down below:
# deploy.yml file
---
- hosts: 127.0.0.1
connection: local
gather_facts: False
name: render jinja2 template
tasks:
- name: render all template_out template files in local
template: src=./deploy_ceph_cluster.sh.j2 dest=deploy_ceph_cluster.sh
...
You can use the following command to render my template file:
$ ansible-playbook deploy.yml -i inventory
PLAY [render jinja2 template] **************************************************
TASK [render all template_out template files in local] *************************
ok: [localhost]
PLAY RECAP *********************************************************************
localhost : ok=1 changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0
So far so good. But the context of deploy_ceph_cluster.sh is wrong. Its context is as follows:
#!/bin/sh
createOSD() {
echo [/dev/sda, /dev/sdc, /dev/sdd, /dev/sde]
ceph-deploy osd create --data [ node1
ceph-deploy osd create --data / node1
ceph-deploy osd create --data d node1
ceph-deploy osd create --data e node1
ceph-deploy osd create --data v node1
ceph-deploy osd create --data / node1
ceph-deploy osd create --data s node1
ceph-deploy osd create --data d node1
ceph-deploy osd create --data a node1
ceph-deploy osd create --data , node1
ceph-deploy osd create --data node1
ceph-deploy osd create --data / node1
ceph-deploy osd create --data d node1
ceph-deploy osd create --data e node1
ceph-deploy osd create --data v node1
ceph-deploy osd create --data / node1
ceph-deploy osd create --data s node1
ceph-deploy osd create --data d node1
ceph-deploy osd create --data c node1
ceph-deploy osd create --data , node1
ceph-deploy osd create --data node1
ceph-deploy osd create --data / node1
ceph-deploy osd create --data d node1
ceph-deploy osd create --data e node1
ceph-deploy osd create --data v node1
ceph-deploy osd create --data / node1
ceph-deploy osd create --data s node1
ceph-deploy osd create --data d node1
ceph-deploy osd create --data d node1
ceph-deploy osd create --data , node1
ceph-deploy osd create --data node1
ceph-deploy osd create --data / node1
ceph-deploy osd create --data d node1
ceph-deploy osd create --data e node1
ceph-deploy osd create --data v node1
ceph-deploy osd create --data / node1
ceph-deploy osd create --data s node1
ceph-deploy osd create --data d node1
ceph-deploy osd create --data e node1
ceph-deploy osd create --data ] node1
echo [/dev/sda, /dev/sdc, /dev/sdd, /dev/sde]
ceph-deploy osd create --data [ node2
ceph-deploy osd create --data / node2
ceph-deploy osd create --data d node2
ceph-deploy osd create --data e node2
ceph-deploy osd create --data v node2
ceph-deploy osd create --data / node2
ceph-deploy osd create --data s node2
ceph-deploy osd create --data d node2
ceph-deploy osd create --data a node2
ceph-deploy osd create --data , node2
ceph-deploy osd create --data node2
ceph-deploy osd create --data / node2
ceph-deploy osd create --data d node2
ceph-deploy osd create --data e node2
ceph-deploy osd create --data v node2
ceph-deploy osd create --data / node2
ceph-deploy osd create --data s node2
ceph-deploy osd create --data d node2
ceph-deploy osd create --data c node2
ceph-deploy osd create --data , node2
ceph-deploy osd create --data node2
ceph-deploy osd create --data / node2
ceph-deploy osd create --data d node2
ceph-deploy osd create --data e node2
ceph-deploy osd create --data v node2
ceph-deploy osd create --data / node2
ceph-deploy osd create --data s node2
ceph-deploy osd create --data d node2
ceph-deploy osd create --data d node2
ceph-deploy osd create --data , node2
ceph-deploy osd create --data node2
ceph-deploy osd create --data / node2
ceph-deploy osd create --data d node2
ceph-deploy osd create --data e node2
ceph-deploy osd create --data v node2
ceph-deploy osd create --data / node2
ceph-deploy osd create --data s node2
ceph-deploy osd create --data d node2
ceph-deploy osd create --data e node2
ceph-deploy osd create --data ] node2
echo [/dev/sda, /dev/sdc, /dev/sdd, /dev/sde]
ceph-deploy osd create --data [ node3
ceph-deploy osd create --data / node3
ceph-deploy osd create --data d node3
ceph-deploy osd create --data e node3
ceph-deploy osd create --data v node3
ceph-deploy osd create --data / node3
ceph-deploy osd create --data s node3
ceph-deploy osd create --data d node3
ceph-deploy osd create --data a node3
ceph-deploy osd create --data , node3
ceph-deploy osd create --data node3
ceph-deploy osd create --data / node3
ceph-deploy osd create --data d node3
ceph-deploy osd create --data e node3
ceph-deploy osd create --data v node3
ceph-deploy osd create --data / node3
ceph-deploy osd create --data s node3
ceph-deploy osd create --data d node3
ceph-deploy osd create --data c node3
ceph-deploy osd create --data , node3
ceph-deploy osd create --data node3
ceph-deploy osd create --data / node3
ceph-deploy osd create --data d node3
ceph-deploy osd create --data e node3
ceph-deploy osd create --data v node3
ceph-deploy osd create --data / node3
ceph-deploy osd create --data s node3
ceph-deploy osd create --data d node3
ceph-deploy osd create --data d node3
ceph-deploy osd create --data , node3
ceph-deploy osd create --data node3
ceph-deploy osd create --data / node3
ceph-deploy osd create --data d node3
ceph-deploy osd create --data e node3
ceph-deploy osd create --data v node3
ceph-deploy osd create --data / node3
ceph-deploy osd create --data s node3
ceph-deploy osd create --data d node3
ceph-deploy osd create --data e node3
ceph-deploy osd create --data ] node3
}
createOSD
As you can see, every disk variable is like [/dev/sda, /dev/sdc, /dev/sdd, /dev/sde]
, but in the code down below,it was splited as chars,for example, /dev/sda was splited like '/', 'd', 'e', 'v' balabala...
createOSD() {
{% for host in groups['ceph_osd'] %}
{% for rule in hostvars[host].rules.values() %}
... omit some irrelevant code
{% for disk in rule.disks %}
ceph-deploy osd create --data {{ disk }} {{ host }}
{% endfor %}
{% endfor %}
{% endfor %}
}
Do I get anything wrong? Can anyone give me some hints or suggestions? Thanks in advance.
{..., 'disks': '["/dev/sda", "/dev/sdc", "/dev/sdd", "/dev/sde"]'}
The value for key 'disks'
is in quotes, so it is, in fact, a str
rather than a list
. You need to remove the outer quotes:
{..., 'disks': ['/dev/sda', '/dev/sdc', '/dev/sdd', '/dev/sde']}