在本地Kubernetes上安裝AWX

1. 基礎(chǔ)環(huán)境

Kubernetes 13
AWX 6.0.0
helm 2.11.0
postgresql 2.0.0

2. 準(zhǔn)備環(huán)境

2.1 Kubernetes

Kubernetes環(huán)境已自行搭建完成

2.2 AWX

默認每個pod請求的資源為 —— Memory：6GB CPU：3cores隔披，可在/installer/roles/kubernetes/defaults/main.yml中進行修改，注意修改過小蹂风，可能會導(dǎo)致環(huán)境崩潰。

2.2.1 下載官方部署文件

官方git：https://github.com/ansible/awx ，部署文件放在awx/installer/质欲，kubernetes相關(guān)在awx/installer/roles/kubernetes/目錄下咪笑。

2.2.2 修改installer/inventory文件

確保所有Openshift Install和獨立的Docker部分已被注釋唧席。

可通過kubectl config current-context獲取自己的kubernetes_context零渐。

我的inventory未注釋內(nèi)容如下

localhost ansible_connection=local ansible_python_interpreter="/usr/bin/env python"

[all:vars]

dockerhub_base=ansible

# Kubernetes Install
kubernetes_context=kubernetes-admin@kubernetes
kubernetes_namespace=awx
tiller_namespace=kube-system
# Optional Kubernetes Variables
pg_persistence_storageClass=StorageClassName
pg_cpu_limit=1000
pg_mem_limit=2

# Common Docker parameters
awx_task_hostname=awx
awx_web_hostname=awxweb
postgres_data_dir=/tmp/pgdocker
host_port=80
host_port_ssl=443
#ssl_certificate=
docker_compose_dir=/tmp/awxcompose

# pg_hostname=postgresql
pg_username=awx
# pg_password should be random 10 character alphanumeric string, when postgresql is running on kubernetes
# NB: it's a limitation of the "official" postgres helm chart
pg_password=awxpass
pg_database=awx
pg_port=5432
#pg_sslmode=require

# RabbitMQ Configuration
rabbitmq_password=awxpass
rabbitmq_erlang_cookie=cookiemonster

# This will create or update a default admin (superuser) account in AWX, if not provided
# then these default values are used
admin_user=admin
admin_password=password

# Whether or not to create preload data for demonstration purposes
create_preload_data=True

# AWX Secret key
# It's *very* important that this stay the same between upgrades or you will lose the ability to decrypt
# your credentials
secret_key=awxsecret

project_data_dir=/data/awx/projects

2.2.3修改installer/roles/kubernetes/defaults

dockerhub_version: latest

我自己不修改這兒會報could not locate file in lookup: /root/installer/../"VERSION"的錯窒舟，我就自己改了這兒，此時對應(yīng)的latest版本是6.0.0

2.2.4 helm

官方部署文件在部署的時候會檢測是否安裝了helm相恃，如果未安裝則會幫你安裝辜纲，這里我是自己已提前安裝了helm。

helm安裝：http://www.reibang.com/p/8aec2776f3f1

2.2.5 postgresql

文檔使用的postgresql 2.0拦耐，在部署過程中會檢查是否安裝耕腾，未安裝則會幫你安裝，但是因為我是本地環(huán)境沒有動態(tài)持久化存儲杀糯，通過官方環(huán)境則會出錯扫俺，需要修改一下原文件。所以我下載到本地固翰，放在git上狼纬。
postgresql2.0: https://github.com/OranYee/awx

因為沒有動態(tài)存儲，所以修改了postgresql/value.ymal骂际，否則會報pod has unbound immediate PersistentVolumeClaims的錯疗琉，應(yīng)該也可以手動添加pv，但是我自己添加的沒綁定上歉铝，我就直接這么粗暴了盈简。

persistence:
  enabled: false

修改installer/roles/kubernetes/tasks/main.yml，找到Deploy and Activate Postgres太示，將stable/postgresql修改為本地postgresql的路徑柠贤，我的是在/root/postgresql

- name: Deploy and Activate Postgres (Kubernetes)
  shell: |
    helm repo update --tiller-namespace={{ tiller_namespace | default('kube-system') }}
    helm upgrade {{ postgresql_service_name }} --install \
      --namespace {{ kubernetes_namespace }} \
      --set postgresqlUsername={{ pg_username }} \
      --set postgresqlPassword={{ pg_password | quote }} \
      --set postgresqlDatabase={{ pg_database }} \
      --set persistence.size={{ pg_volume_capacity|default('5')}}Gi \
      --version="2.0.0" \
      --tiller-namespace={{ tiller_namespace | default('kube-system') }} \
      {{ '--set persistence.storageClass='+pg_persistence_storageClass if pg_persistence_storageClass is defined else ' ' }} \
      {{ '--set resources.limits.cpu='+(pg_cpu_limit | string)+'m' if pg_cpu_limit is defined else ' ' }} \
      {{ '--set resources.limits.memory='+(pg_mem_limit | string)+'Gi' if pg_mem_limit is defined else ' ' }} \
      /root/postgresql
  when:
    - pg_hostname is not defined or pg_hostname == ''
    - postgres_svc_details is defined and postgres_svc_details.rc != 0
    - kubernetes_context is defined
  register: kubernetes_pg_activate
  no_log: no

查看postgresql是否部署成功helm list

NAME            REVISION    UPDATED                     STATUS      CHART               APP VERSION NAMESPACE
awx-postgresql  1           Wed Jul 17 11:29:56 2019    DEPLOYED    postgresql-2.0.0    10.5.0      awx

[root@k8s-master01 postgresql]# kubectl get pods -n awx
NAME                          READY   STATUS    RESTARTS   AGE
awx-postgresql-postgresql-0   1/1     Running   0          7h52m

刪除postgresql

helm del postgresql --purge

2.2.6 部署AWX

（我將installer/roles/kubernetes/templates下的deployment.yml.j2下的centos鏡像所依賴的軟件提前安裝在一個鏡像中了，kind:StatefulSet下的initContainers內(nèi)容變成了如下类缤，你也可以不進行修改臼勉。）

      initContainers:
        - image: 'oranyee/centos:awx'
          name: init-custom-venvs
          command:
            - sh
            - '-c'
            - >-
              mkdir -p {{ custom_venvs_path }} &&
{% for custom_venv in custom_venvs %}
              virtualenv -p {{ custom_venv.python | default(custom_venvs_python) }} \
                {{ custom_venvs_path }}/{{ custom_venv.name }} &&
              source {{ custom_venvs_path }}/{{ custom_venv.name }}/bin/activate &&
              {{ custom_venvs_path }}/{{ custom_venv.name }}/bin/pip install -U psutil \
                "ansible=={{ custom_venv.python_ansible_version }}" &&
{% if custom_venv.python_modules is defined %}
              {{ custom_venvs_path }}/{{ custom_venv.name }}/bin/pip install -U \
                {% for module in custom_venv.python_modules %}{{ module }} {% endfor %} &&
{% endif %}
              deactivate && 
{% endfor %}
              :
          volumeMounts:
            - name: custom-venvs
              mountPath: {{ custom_venvs_path }}
{% endif %}

在/installer/roles/kubernetes/templates/deployment.yml.j2的name: {{ kubernetes_deployment_name }}-celery的volumeMounts下添加掛載project目錄：

{% if project_data_dir is defined %}
            - name: {{ kubernetes_deployment_name }}-project-data-dir
              mountPath: "/var/lib/awx/projects"
              readOnly: false
{% endif %}

在awx目錄下，運行ansible-playbook -i inventory install.yml餐弱。等待幾分鐘后宴霸，如果沒有出錯則成功，有錯可通過修改installer/roles/kubernetes/tasks/main.yml下的對應(yīng)的任務(wù)下的no_log膏蚓，修改為yes猖败，再運行ansible-playbook -i inventory install.yml查看具體什么錯誤，或者ansible-playbook -i inventory install.yml -vvv查看更多信息降允。

2.2.7 查看AWX部署是否成功

[root@k8s-master01 ~]# kubectl get pods -n awx
NAME                          READY   STATUS    RESTARTS   AGE
awx-0                         4/4     Running   0          5d19h
awx-postgresql-postgresql-0   1/1     Running   0          6d22h

在瀏覽器訪問：ip:32641恩闻，默認賬戶和密碼分別是：admin和password，可在installer/inventory下進行修改

awx.PNG

進來的awx主頁如下：

awx-index.PNG

3. awx的簡單使用

3.1 創(chuàng)建playbook

進入awx所在的節(jié)點剧董，可通過kubectl get pods -n awx -owide查看awx—0在哪個節(jié)點幢尚，我的是在k8s-master02

[root@k8s-master01 ~]# kubectl get pods -n awx -owide
NAME                          READY   STATUS    RESTARTS   AGE     IP            NODE
awx-0                         4/4     Running   0          5d20h   10.244.1.79   k8s-master02
awx-postgresql-postgresql-0   1/1     Running   0          6d23h   10.244.2.57   k8s-master03

進入awx projects掛在的目錄下，此前在inventory文件中定義在/data/awx/projects下翅楼，創(chuàng)建目錄ansible-for-devops尉剩，在ansible-for-devops目錄下創(chuàng)建測試playbook：main.yml

[root@k8s-master02 ansible-for-devops]# cat main.yml
---
- hosts: all
  gather_facts: no
  tasks:
  - name: Check the date on the server.
    command: date
  - name: Check the eth0 ip on the server.
    command: ifconfig em1