docs: Add multi-Context Broker architecture (Orion-LD + Stellio separate pipelines)
This commit is contained in:
Eric FELIXINE
134
architecture-multi-cb.md
Normal file
134
architecture-multi-cb.md
Normal file
@@ -0,0 +1,134 @@
|
|||||||
|
# Architecture Smart City - Multi Context Broker (Updated 2026-05-06)
|
||||||
|
|
||||||
|
## Principe : 1 IoT-Agent, 1 QuantumLeap, 1 CrateDB par Context Broker
|
||||||
|
|
||||||
|
```
|
||||||
|
┌─────────────────────────────────────────────────────────────────────────────┐
|
||||||
|
│ Smart City Simulator (Python) │
|
||||||
|
│ Publie sur 3 brokers MQTT avec format IoT-Agent JSON │
|
||||||
|
└──────────┬────────────────────┬──────────────────────┬───────────────────┘
|
||||||
|
│ │ │
|
||||||
|
▼ ▼ ▼
|
||||||
|
┌──────────────────┐ ┌──────────────────┐ ┌──────────────────┐
|
||||||
|
│ EMQX Broker │ │ Mosquitto Broker │ │ BunkerM Broker │
|
||||||
|
│ (port 11883) │ │ (port 1883) │ │ (port 1900) │
|
||||||
|
└────────┬─────────┘ └────────┬─────────┘ └────────┬─────────┘
|
||||||
|
│ │ │
|
||||||
|
▼ ▼ ▼
|
||||||
|
┌──────────────────┐ ┌──────────────────┐ ┌──────────────────┐
|
||||||
|
│ IoT-Agent-EMQX │ │IoT-Agent-Mosquitto│ │IoT-Agent-BunkerM │
|
||||||
|
│ Port: 4041 │ │ Port: 4042 │ │ Port: 4043 │
|
||||||
|
│ Apikey: smart- │ │ Apikey: smart- │ │ Apikey: smart- │
|
||||||
|
│ city-api-key │ │ city-api-key │ │ city-api-key │
|
||||||
|
└────────┬─────────┘ └────────┬─────────┘ └────────┬─────────┘
|
||||||
|
│ │ │
|
||||||
|
└───────────────────────┴──────────────────────┘
|
||||||
|
│
|
||||||
|
▼
|
||||||
|
┌───────────────┴───────────────┐
|
||||||
|
│ │
|
||||||
|
▼ ▼
|
||||||
|
┌─────────────────────┐ ┌─────────────────────┐
|
||||||
|
│ Orion-LD │ │ Stellio │
|
||||||
|
│ (port 1026) │ │ (port 8080) │
|
||||||
|
│ MongoDB backend │ │ (API Gateway) │
|
||||||
|
└─────────┬───────────┘ └─────────┬───────────┘
|
||||||
|
│ │
|
||||||
|
▼ ▼
|
||||||
|
┌─────────────────────┐ ┌─────────────────────┐
|
||||||
|
│ QuantumLeap-Orion │ │ QuantumLeap-Stellio │
|
||||||
|
│ (port 8668) │ │ (port 8669) │
|
||||||
|
│ → CrateDB-Orion │ │ → CrateDB-Stellio │
|
||||||
|
└─────────┬───────────┘ └─────────┬───────────┘
|
||||||
|
│ │
|
||||||
|
▼ ▼
|
||||||
|
┌─────────────────────┐ ┌─────────────────────┐
|
||||||
|
│ CrateDB-Orion │ │ CrateDB-Stellio │
|
||||||
|
│ (port 5432/4200) │ │ (port 5433/4201) │
|
||||||
|
│ DB: quantumleap │ │ DB: quantumleap_ │
|
||||||
|
│ │ │ stellio │
|
||||||
|
└─────────┬───────────┘ └─────────┬───────────┘
|
||||||
|
│ │
|
||||||
|
└───────────────────────┬─────────┘
|
||||||
|
│
|
||||||
|
▼
|
||||||
|
┌─────────────────────┐
|
||||||
|
│ Grafana │
|
||||||
|
│ (port 3001) │
|
||||||
|
│ 2 Datasources: │
|
||||||
|
│ - CrateDB-Orion │
|
||||||
|
│ - CrateDB-Stellio│
|
||||||
|
└─────────────────────┘
|
||||||
|
```
|
||||||
|
|
||||||
|
## Services déployés (par Context Broker)
|
||||||
|
|
||||||
|
### Pour Orion-LD
|
||||||
|
| Service | Container | Port | Description |
|
||||||
|
|---------|-----------|------|-------------|
|
||||||
|
| **IoT-Agent** | smart-city-iot-agent-emqx | 4041 | Reçoit MQTT EMQX |
|
||||||
|
| **Context Broker** | smart-city-orion-ld | 1026 | Orion-LD (NGSI-v2) |
|
||||||
|
| **QuantumLeap** | smart-city-quantumleap | 8668 | Time-series pour Orion |
|
||||||
|
| **CrateDB** | smart-city-cratedb | 5432/4200 | Stockage Orion |
|
||||||
|
|
||||||
|
### Pour Stellio
|
||||||
|
| Service | Container | Port | Description |
|
||||||
|
|---------|-----------|------|-------------|
|
||||||
|
| **IoT-Agent** | smart-city-iot-agent-* | 4041-4043 | Les mêmes (envoient aussi à Stellio) |
|
||||||
|
| **Context Broker** | stellio-api-gateway | 8080 | Stellio (NGSI-LD) |
|
||||||
|
| **QuantumLeap** | smart-city-quantumleap-stellio | 8669 | Time-series pour Stellio |
|
||||||
|
| **CrateDB** | smart-city-cratedb-stellio | 5433/4201 | Stockage Stellio |
|
||||||
|
|
||||||
|
## Configuration des IoT-Agents (pour 2 Context Brokers)
|
||||||
|
|
||||||
|
Chaque IoT-Agent doit avoir **2 services** (un pour Orion, un pour Stellio) :
|
||||||
|
|
||||||
|
```json
|
||||||
|
// Service 1: Orion-LD
|
||||||
|
{
|
||||||
|
"apikey": "smartcity-api-key",
|
||||||
|
"cbroker": "http://smart-city-orion-ld:1026",
|
||||||
|
"resource": "/",
|
||||||
|
"type": "AirQualityObserved"
|
||||||
|
}
|
||||||
|
|
||||||
|
// Service 2: Stellio
|
||||||
|
{
|
||||||
|
"apikey": "smartcity-api-key-stellio",
|
||||||
|
"cbroker": "http://stellio-api-gateway:8080",
|
||||||
|
"resource": "/",
|
||||||
|
"type": "AirQualityObserved"
|
||||||
|
}
|
||||||
|
```
|
||||||
|
|
||||||
|
## Fichiers de configuration (nouveaux)
|
||||||
|
|
||||||
|
1. `docker-compose.quantumleap-stellio.yml` - QuantumLeap pour Stellio
|
||||||
|
2. `docker-compose.cratedb-stellio.yml` - CrateDB pour Stellio
|
||||||
|
3. Mise à jour `docker-compose.iot-agent.yml` - Ajouter services Stellio
|
||||||
|
|
||||||
|
## Sous-domaines (Traefik)
|
||||||
|
|
||||||
|
- `quantum-leap-stellio.digitribe.fr` → QuantumLeap-Stellio (port 8669)
|
||||||
|
- `cratedb-stellio.digitribe.fr` → CrateDB-Stellio (port 4201)
|
||||||
|
|
||||||
|
## Avantages de cette architecture
|
||||||
|
|
||||||
|
1. **Isolation** : Problème sur Stellio n'impacte pas Orion-LD
|
||||||
|
2. **Scalabilité** : Chaque Context Broker a ses propres ressources
|
||||||
|
3. **Clarté** : 1 flux = 1 pipeline complet
|
||||||
|
4. **Comparaison** : Possibilité de comparer performances Orion vs Stellio
|
||||||
|
|
||||||
|
## Inconvénients
|
||||||
|
|
||||||
|
1. **Complexité** : Plus de conteneurs à gérer
|
||||||
|
2. **Ressources** : Plus de RAM/CPU pour les CrateDB supplémentaires
|
||||||
|
3. **Maintenance** : Plus de configurations à maintenir à jour
|
||||||
|
|
||||||
|
## Recommandation
|
||||||
|
|
||||||
|
Pour un environnement de **production**, l'architecture isolée est recommandée.
|
||||||
|
Pour un **POC/test**, on peut simplifier en utilisant un seul QuantumLeap/CrateDB pour les deux Context Brokers.
|
||||||
|
|
||||||
|
---
|
||||||
|
*Dernière mise à jour : 06 Mai 2026, 17h45*
|
||||||
59
docker-compose.quantumleap-stellio.yml
Normal file
59
docker-compose.quantumleap-stellio.yml
Normal file
@@ -0,0 +1,59 @@
|
|||||||
|
# QuantumLeap for Stellio - Separate instance
|
||||||
|
# Usage: docker compose -f docker-compose.yml -f docker-compose.quantumleap-stellio.yml up -d
|
||||||
|
version: '3.8'
|
||||||
|
|
||||||
|
services:
|
||||||
|
quantumleap-stellio:
|
||||||
|
image: smartsdk/quantumleap:latest
|
||||||
|
container_name: smart-city-quantumleap-stellio
|
||||||
|
restart: unless-stopped
|
||||||
|
networks:
|
||||||
|
- smartcity-shared
|
||||||
|
- traefik-public
|
||||||
|
environment:
|
||||||
|
- CRATE_HOST=smart-city-cratedb-stellio
|
||||||
|
- CRATE_PORT=4200
|
||||||
|
- CRATE_DB_NAME=quantumleap_stellio
|
||||||
|
- QL_CONFIG_DELETE_POLICY=oasis.settings.STELLIO_DELETE_POLICY
|
||||||
|
ports:
|
||||||
|
- "8669:8668"
|
||||||
|
labels:
|
||||||
|
- traefik.enable=true
|
||||||
|
- traefik.http.routers.quantum-leap-stellio.rule=Host(`quantum-leap-stellio.digitribe.fr`)
|
||||||
|
- traefik.http.services.quantum-leap-stellio.loadbalancer.server.port=8668
|
||||||
|
healthcheck:
|
||||||
|
test: ["CMD", "curl", "-f", "http://localhost:8668/version"]
|
||||||
|
interval: 30s
|
||||||
|
timeout: 10s
|
||||||
|
retries: 3
|
||||||
|
depends_on:
|
||||||
|
- smart-city-cratedb-stellio
|
||||||
|
|
||||||
|
smart-city-cratedb-stellio:
|
||||||
|
image: crate:latest
|
||||||
|
container_name: smart-city-cratedb-stellio
|
||||||
|
restart: unless-stopped
|
||||||
|
networks:
|
||||||
|
smartcity-shared:
|
||||||
|
aliases:
|
||||||
|
- smart-city-cratedb-stellio
|
||||||
|
ports:
|
||||||
|
- "4201:4200"
|
||||||
|
- "5433:5432"
|
||||||
|
volumes:
|
||||||
|
- smart-city-cratedb-stellio-data:/data
|
||||||
|
command: -Clicense.enterprise=false -Cauth.host_based.enabled=true
|
||||||
|
healthcheck:
|
||||||
|
test: ["CMD", "curl", "-f", "http://localhost:4200/_admin/v1/health"]
|
||||||
|
interval: 30s
|
||||||
|
timeout: 10s
|
||||||
|
retries: 3
|
||||||
|
|
||||||
|
volumes:
|
||||||
|
smart-city-cratedb-stellio-data:
|
||||||
|
|
||||||
|
networks:
|
||||||
|
smartcity-shared:
|
||||||
|
external: true
|
||||||
|
traefik-public:
|
||||||
|
external: true
|
||||||
Reference in New Issue
Block a user