f45ac0cb6e
- Added defaults/main.yml with production-ready values for all 27 Ansible roles - Added meta/main.yml with role dependencies (DAG: prereq → namespaces → storage → traefik → cert-manager → services) - Created 4 missing Helm templates: flink-deployment, kafka-cluster, smartapp-web, smartapp-api - Fixed YAML syntax error in backup/tasks/main.yml (Velero backupStorageLocation) - Updated README with domain list, dependencies diagram, and corrected Helm chart names - All 81 YAML files pass validation
247 lines
10 KiB
Markdown
247 lines
10 KiB
Markdown
# Smart City Martinique - Déploiement Kubernetes
|
|
|
|
## Architecture
|
|
|
|
```
|
|
┌─────────────────────────────────────────────────────────┐
|
|
│ TRAEFIK (Ingress) │
|
|
│ ports 80/443 │
|
|
└─────────────────────────────────────────────────────────┘
|
|
│
|
|
┌─────────────────────────────────┼─────────────────────────────────┐
|
|
│ │ │
|
|
┌────▼────┐ ┌──────────┐ ┌──────────▼──────────┐ ┌─────────────────┐
|
|
│ Airflow │ │ Kafka │ │ Data & Storage │ │ Monitoring │
|
|
│ │ │ Cluster │ │ │ │ │
|
|
│ web │ │ 3 brokers│ │ PostgreSQL HA │ │ Prometheus │
|
|
│ sched │ │ connect │ │ Redis Cluster │ │ Grafana │
|
|
│ worker │ │ ui │ │ MinIO │ │ Loki │
|
|
└─────────┘ └──────────┘ │ ClickHouse │ │ Promtail │
|
|
│ StarRocks │ └─────────────────┘
|
|
┌──────────┐ ┌──────────┐ │ Trino │
|
|
│ Flink │ │ IoT │ │ Delta Lake │ ┌─────────────────┐
|
|
│ │ │ │ │ DuckDB │ │ BI & Analytics │
|
|
│ jobmgr │ │ EMQX │ └─────────────────────┘ │ │
|
|
│ taskmgr │ │ Mosquitto│ │ Superset │
|
|
└──────────┘ │ Node-RED │ ┌─────────────────────┐ │ Metabase │
|
|
│ phpIPAM │ │ Git & Notebooks │ │ MindsDB │
|
|
┌──────────┐ │ ChirpStk │ │ │ └─────────────────┘
|
|
│ GIS │ └──────────┘ │ Gitea │
|
|
│ │ │ JupyterHub │ ┌─────────────────┐
|
|
│ MapStore │ ┌──────────┐ │ Zeppelin │ │ Web Apps │
|
|
│ GeoServer│ │ ODK │ └─────────────────────┘ │ │
|
|
│ FROST │ │ │ │ Smart App │
|
|
│ Stellio │ │ nginx │ ┌─────────────────────┐ │ Streamlit │
|
|
│ FIWARE │ │ service │ │ Data Collection │ │ Kepler │
|
|
└──────────┘ │ postgres │ │ │ └─────────────────┘
|
|
└──────────┘ │ Telegraf │
|
|
│ InfluxDB │
|
|
│ Simulator │
|
|
└─────────────────────┘
|
|
```
|
|
|
|
## Prérequis
|
|
|
|
### Cluster Kubernetes
|
|
- 3 nœuds minimum (1 master + 2 workers)
|
|
- Kubernetes 1.28+
|
|
- containerd
|
|
- Cilium (CNI)
|
|
|
|
### Serveur NFS
|
|
- 1 serveur NFS pour le stockage persistant
|
|
- Minimum 500Go d'espace disque
|
|
|
|
### Outils
|
|
- kubectl
|
|
- helm
|
|
- ansible 2.15+
|
|
- ansible-galaxy collection install kubernetes.core
|
|
|
|
## Installation
|
|
|
|
### 1. Cloner le repository
|
|
|
|
```bash
|
|
git clone https://gitea.digitribe.fr/eric/smart-city-digital-twin-martinique.git
|
|
cd smart-city-digital-twin-martinique/helms
|
|
```
|
|
|
|
### 2. Configurer l'inventory
|
|
|
|
Éditer `inventory/hosts.yml` avec les IPs de vos nœuds :
|
|
|
|
```yaml
|
|
k8s_masters:
|
|
hosts:
|
|
k8s-master-1:
|
|
ansible_host: "192.168.1.100"
|
|
k8s_workers:
|
|
hosts:
|
|
k8s-worker-1:
|
|
ansible_host: "192.168.1.101"
|
|
k8s-worker-2:
|
|
ansible_host: "192.168.1.102"
|
|
nfs_server:
|
|
hosts:
|
|
nfs-1:
|
|
ansible_host: "192.168.1.200"
|
|
```
|
|
|
|
### 3. Configurer les variables
|
|
|
|
Éditer `group_vars/all.yml` selon vos besoins (ressources, domaines, etc.)
|
|
|
|
### 4. Chiffrer les secrets
|
|
|
|
```bash
|
|
ansible-vault encrypt group_vars/vault.yml
|
|
```
|
|
|
|
### 5. Déployer
|
|
|
|
```bash
|
|
# Déployer toute la stack
|
|
ansible-playbook deploy.yml --ask-vault-pass
|
|
|
|
# Déployer un service spécifique
|
|
ansible-playbook deploy.yml --tags clickhouse --ask-vault-pass
|
|
ansible-playbook deploy.yml --tags trino --ask-vault-pass
|
|
ansible-playbook deploy.yml --tags streamlit --ask-vault-pass
|
|
ansible-playbook deploy.yml --tags kafka --ask-vault-pass
|
|
ansible-playbook deploy.yml --tags monitoring --ask-vault-pass
|
|
```
|
|
|
|
### 6. Vérifier
|
|
|
|
```bash
|
|
kubectl get pods --all-namespaces
|
|
kubectl get ingress --all-namespaces
|
|
```
|
|
|
|
## Services déployés
|
|
|
|
| Service | Domaine | Namespace | Helm Chart |
|
|
|---------|---------|-----------|------------|
|
|
| Traefik | traefik.digitribe.fr | traefik | traefik/traefik |
|
|
| Airflow | airflow.digitribe.fr | airflow | apache/airflow |
|
|
| Kafka | kafka-bootstrap.digitribe.fr | kafka | strimzi/kafka-operator |
|
|
| Flink | flink.digitribe.fr | flink | apache/flink-kubernetes-operator |
|
|
| ClickHouse | clickhouse.digitribe.fr | clickhouse | bitnami/clickhouse |
|
|
| StarRocks | starrocks.digitribe.fr | starrocks | community/starrocks |
|
|
| Trino | trino.digitribe.fr | trino | trinodb/trino |
|
|
| Delta Lake | deltalake.digitribe.fr | deltalake | custom |
|
|
| Streamlit | streamlit.digitribe.fr | streamlit | custom |
|
|
| DuckDB | duckdb.digitribe.fr | duckdb | custom |
|
|
| EMQX | emqx.digitribe.fr | iot | emqx/emqx-operator |
|
|
| Mosquitto | mqtt.digitribe.fr | iot | custom |
|
|
| Node-RED | nodered.digitribe.fr | iot | custom |
|
|
| phpIPAM | phpipam.digitribe.fr | phpipam | custom |
|
|
| Gitea | gitea.digitribe.fr | gitea | gitea-charts/gitea |
|
|
| JupyterHub | jupyter.digitribe.fr | jupyterhub | jupyterhub/jupyterhub |
|
|
| Superset | superset.digitribe.fr | superset | apache/superset |
|
|
| Metabase | metabase.digitribe.fr | metabase | bitnami/metabase |
|
|
| MindsDB | mindsdb.digitribe.fr | mindsdb | bitnami/mindsdb |
|
|
| ODK Central | odk.digitribe.fr | odk | custom |
|
|
| MapStore | mapstore.digitribe.fr | gis | custom |
|
|
| GeoServer | geoserver.digitribe.fr | gis | custom |
|
|
| Smart App | smartapp.digitribe.fr | smartapp | custom |
|
|
| Smart App API | api-smartapp.digitribe.fr | smartapp | custom |
|
|
| Grafana | grafana.digitribe.fr | monitoring | grafana/grafana |
|
|
| MinIO | minio.digitribe.fr | databases | bitnami/minio |
|
|
| PostgreSQL | — (interne) | databases | bitnami/postgresql-ha |
|
|
| Redis | — (interne) | databases | bitnami/redis-cluster |
|
|
|
|
## Dépendances entre rôles
|
|
|
|
```
|
|
prerequisites → namespaces → storage → traefik → cert-manager
|
|
↓
|
|
┌─────────────────────┼─────────────────────┐
|
|
↓ ↓ ↓
|
|
databases monitoring kafka
|
|
(postgres, (prometheus, ↓
|
|
redis, minio) grafana, loki) flink
|
|
↓ ↓ ↓
|
|
└─────────────────────┼─────────────────────┘
|
|
↓
|
|
┌─────────────────────┼─────────────────────┐
|
|
↓ ↓ ↓
|
|
airflow bi iot
|
|
gitea jupyterhub superset metabase emqx mosquitto
|
|
odk mindsdb trino nodered phpipam
|
|
gis clickhouse streamlit
|
|
smartapp deltalake duckdb
|
|
↓
|
|
backup (Velero)
|
|
```
|
|
|
|
## Commandes utiles
|
|
|
|
```bash
|
|
# Lister tous les pods
|
|
kubectl get pods --all-namespaces
|
|
|
|
# Voir les logs d'un pod
|
|
kubectl logs -f <pod-name> -n <namespace>
|
|
|
|
# Voir les événements
|
|
kubectl get events --all-namespaces --sort-by='.lastTimestamp'
|
|
|
|
# Voir les ingress
|
|
kubectl get ingress --all-namespaces
|
|
|
|
# Voir les PVC
|
|
kubectl get pvc --all-namespaces
|
|
|
|
# Redéployer un service
|
|
ansible-playbook deploy.yml --tags <service> --ask-vault-pass
|
|
|
|
# Supprimer un service
|
|
kubectl delete namespace <namespace>
|
|
|
|
# Supprimer toute la stack
|
|
ansible-playbook undeploy.yml
|
|
```
|
|
|
|
## Troubleshooting
|
|
|
|
### Pod en CrashLoopBackOff
|
|
```bash
|
|
kubectl describe pod <pod-name> -n <namespace>
|
|
kubectl logs <pod-name> -n <namespace> --previous
|
|
```
|
|
|
|
### PVC en Pending
|
|
```bash
|
|
kubectl get storageclass
|
|
kubectl get pv
|
|
kubectl describe pvc <pvc-name> -n <namespace>
|
|
```
|
|
|
|
### Ingress non accessible
|
|
```bash
|
|
kubectl get ingress -n <namespace>
|
|
kubectl describe ingress <ingress-name> -n <namespace>
|
|
kubectl logs -f deployment/traefik -n traefik
|
|
```
|
|
|
|
## Maintenance
|
|
|
|
### Backup
|
|
Les sauvegardes sont configurées via Velero :
|
|
```bash
|
|
kubectl get schedules -n velero
|
|
kubectl get backups -n velero
|
|
```
|
|
|
|
### Mise à jour d'un service
|
|
```bash
|
|
ansible-playbook deploy.yml --tags <service> --ask-vault-pass
|
|
```
|
|
|
|
### Scaling
|
|
```bash
|
|
kubectl scale deployment <deployment> --replicas=<n> -n <namespace>
|
|
```
|