Search code examples
ansiblejinja2ceph

When I iterated a string list which generate by jinja2, I get a series of chars rather than strings. Why this happend?


I have been trying to deploy ceph cluster via ansible. When I tried to render my deploy_ceph_cluster.sh.j2 into a shell script, I got some problems. For better illustration, I will provide a minimal working example.

Here is my inventory file:

# inventory
[local]
localhost ansible_host=127.0.0.1 ansible_connection=local

[ceph_osd]
node1 ansible_host=192.168.1.2 rules="{'rule1': {'bcache': 'none', 'disks': '["/dev/sda", "/dev/sdc", "/dev/sdd", "/dev/sde"]'}}"
node2 ansible_host=192.168.1.3 rules="{'rule1': {'bcache': 'none', 'disks': '["/dev/sda", "/dev/sdc", "/dev/sdd", "/dev/sde"]'}}"
node3 ansible_host=192.168.1.4 rules="{'rule1': {'bcache': 'none', 'disks': '["/dev/sda", "/dev/sdc", "/dev/sdd", "/dev/sde"]'}}"

My jinja2 template file:

#!/bin/sh

createOSD() {
{% for host in groups['ceph_osd'] %}
{% for rule in hostvars[host].rules.values() %}
{% if rule.bcache != 'none' %}
    ssh {{ host }} make-bcache -B {{ rule.disks | join(' ') }} -C {{ rule.bcache }} --wipe-bcache
    bcache_name=$(lsblk -o KNAME {{ rule.bcache }} | grep bcache)
    ssh {{ host }} echo writeback > /sys/block/$bcache_name/bcache/cache_mode
    ceph-deploy osd create --data /dev/$bcache_name {{ host }}
{% else %}
echo {{rule.disks}}
{% for disk in rule.disks %}
    ceph-deploy osd create --data {{ disk }} {{ host }}
{% endfor %}
{% endif %}
{% endfor %}
{% endfor %}
}

createOSD

And finally, my deploy.yml is down below:

# deploy.yml file
---
- hosts: 127.0.0.1
  connection: local
  gather_facts: False
  name: render jinja2 template
  tasks:
  - name: render all template_out template files in local
    template: src=./deploy_ceph_cluster.sh.j2 dest=deploy_ceph_cluster.sh
...

You can use the following command to render my template file:

$ ansible-playbook deploy.yml -i inventory 

PLAY [render jinja2 template] **************************************************

TASK [render all template_out template files in local] *************************
ok: [localhost]

PLAY RECAP *********************************************************************
localhost                  : ok=1    changed=0    unreachable=0    failed=0    skipped=0    rescued=0    ignored=0   

So far so good. But the context of deploy_ceph_cluster.sh is wrong. Its context is as follows:

#!/bin/sh

createOSD() {
echo [/dev/sda, /dev/sdc, /dev/sdd, /dev/sde]
    ceph-deploy osd create --data [ node1
    ceph-deploy osd create --data / node1
    ceph-deploy osd create --data d node1
    ceph-deploy osd create --data e node1
    ceph-deploy osd create --data v node1
    ceph-deploy osd create --data / node1
    ceph-deploy osd create --data s node1
    ceph-deploy osd create --data d node1
    ceph-deploy osd create --data a node1
    ceph-deploy osd create --data , node1
    ceph-deploy osd create --data   node1
    ceph-deploy osd create --data / node1
    ceph-deploy osd create --data d node1
    ceph-deploy osd create --data e node1
    ceph-deploy osd create --data v node1
    ceph-deploy osd create --data / node1
    ceph-deploy osd create --data s node1
    ceph-deploy osd create --data d node1
    ceph-deploy osd create --data c node1
    ceph-deploy osd create --data , node1
    ceph-deploy osd create --data   node1
    ceph-deploy osd create --data / node1
    ceph-deploy osd create --data d node1
    ceph-deploy osd create --data e node1
    ceph-deploy osd create --data v node1
    ceph-deploy osd create --data / node1
    ceph-deploy osd create --data s node1
    ceph-deploy osd create --data d node1
    ceph-deploy osd create --data d node1
    ceph-deploy osd create --data , node1
    ceph-deploy osd create --data   node1
    ceph-deploy osd create --data / node1
    ceph-deploy osd create --data d node1
    ceph-deploy osd create --data e node1
    ceph-deploy osd create --data v node1
    ceph-deploy osd create --data / node1
    ceph-deploy osd create --data s node1
    ceph-deploy osd create --data d node1
    ceph-deploy osd create --data e node1
    ceph-deploy osd create --data ] node1
echo [/dev/sda, /dev/sdc, /dev/sdd, /dev/sde]
    ceph-deploy osd create --data [ node2
    ceph-deploy osd create --data / node2
    ceph-deploy osd create --data d node2
    ceph-deploy osd create --data e node2
    ceph-deploy osd create --data v node2
    ceph-deploy osd create --data / node2
    ceph-deploy osd create --data s node2
    ceph-deploy osd create --data d node2
    ceph-deploy osd create --data a node2
    ceph-deploy osd create --data , node2
    ceph-deploy osd create --data   node2
    ceph-deploy osd create --data / node2
    ceph-deploy osd create --data d node2
    ceph-deploy osd create --data e node2
    ceph-deploy osd create --data v node2
    ceph-deploy osd create --data / node2
    ceph-deploy osd create --data s node2
    ceph-deploy osd create --data d node2
    ceph-deploy osd create --data c node2
    ceph-deploy osd create --data , node2
    ceph-deploy osd create --data   node2
    ceph-deploy osd create --data / node2
    ceph-deploy osd create --data d node2
    ceph-deploy osd create --data e node2
    ceph-deploy osd create --data v node2
    ceph-deploy osd create --data / node2
    ceph-deploy osd create --data s node2
    ceph-deploy osd create --data d node2
    ceph-deploy osd create --data d node2
    ceph-deploy osd create --data , node2
    ceph-deploy osd create --data   node2
    ceph-deploy osd create --data / node2
    ceph-deploy osd create --data d node2
    ceph-deploy osd create --data e node2
    ceph-deploy osd create --data v node2
    ceph-deploy osd create --data / node2
    ceph-deploy osd create --data s node2
    ceph-deploy osd create --data d node2
    ceph-deploy osd create --data e node2
    ceph-deploy osd create --data ] node2
echo [/dev/sda, /dev/sdc, /dev/sdd, /dev/sde]
    ceph-deploy osd create --data [ node3
    ceph-deploy osd create --data / node3
    ceph-deploy osd create --data d node3
    ceph-deploy osd create --data e node3
    ceph-deploy osd create --data v node3
    ceph-deploy osd create --data / node3
    ceph-deploy osd create --data s node3
    ceph-deploy osd create --data d node3
    ceph-deploy osd create --data a node3
    ceph-deploy osd create --data , node3
    ceph-deploy osd create --data   node3
    ceph-deploy osd create --data / node3
    ceph-deploy osd create --data d node3
    ceph-deploy osd create --data e node3
    ceph-deploy osd create --data v node3
    ceph-deploy osd create --data / node3
    ceph-deploy osd create --data s node3
    ceph-deploy osd create --data d node3
    ceph-deploy osd create --data c node3
    ceph-deploy osd create --data , node3
    ceph-deploy osd create --data   node3
    ceph-deploy osd create --data / node3
    ceph-deploy osd create --data d node3
    ceph-deploy osd create --data e node3
    ceph-deploy osd create --data v node3
    ceph-deploy osd create --data / node3
    ceph-deploy osd create --data s node3
    ceph-deploy osd create --data d node3
    ceph-deploy osd create --data d node3
    ceph-deploy osd create --data , node3
    ceph-deploy osd create --data   node3
    ceph-deploy osd create --data / node3
    ceph-deploy osd create --data d node3
    ceph-deploy osd create --data e node3
    ceph-deploy osd create --data v node3
    ceph-deploy osd create --data / node3
    ceph-deploy osd create --data s node3
    ceph-deploy osd create --data d node3
    ceph-deploy osd create --data e node3
    ceph-deploy osd create --data ] node3
}

createOSD

As you can see, every disk variable is like [/dev/sda, /dev/sdc, /dev/sdd, /dev/sde], but in the code down below,it was splited as chars,for example, /dev/sda was splited like '/', 'd', 'e', 'v' balabala...

createOSD() {
{% for host in groups['ceph_osd'] %}
{% for rule in hostvars[host].rules.values() %}
...  omit some irrelevant code
{% for disk in rule.disks %}
    ceph-deploy osd create --data {{ disk }} {{ host }}
{% endfor %}
{% endfor %}
{% endfor %}
}

Do I get anything wrong? Can anyone give me some hints or suggestions? Thanks in advance.


Solution

  • {..., 'disks': '["/dev/sda", "/dev/sdc", "/dev/sdd", "/dev/sde"]'}
    

    The value for key 'disks' is in quotes, so it is, in fact, a str rather than a list. You need to remove the outer quotes:

    {..., 'disks': ['/dev/sda', '/dev/sdc', '/dev/sdd', '/dev/sde']}