eric/smart-city-digital-twin-martinique
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
55 Commits 1 Branch 1 Tag
1ed03b5a57901fb1f047854a987c2ea970797fa1
Commit Graph

55 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Eric FELIXINE
1ed03b5a57 Fix Orion-LD: Add source to @context + PATCH with full payload 
- ORION_CONTEXT now includes source definition (uri.fiware.org)
- PATCH /entities/{id}/attrs now sends full entity (with @context)
- Orion-LD requires @context even in PATCH requests
- This fixes 400 Bad Request errors on update
 2026-05-04 23:12:56 -04:00
Eric FELIXINE
b2ba6f8202 Docs: Modern Data Stack (MDS) reference for Smart City 
- Data Ingestion: NiFi, Airbyte, Kafka, Flink, dlt
- Workflow Automation: Airflow, Kestra, n8n, OpenFN, Dagster
- Analytics & Transformation: dbt, Spark, RisingWave, Druid, ClickHouse
- BI & Visualization: Grafana, Superset, DataHub, Great Expectations
- Storage: MinIO, PostgreSQL/TimescaleDB, CrateDB, Iceberg, InfluxDB
- Architecture MVP et Enterprise pour Smart City Martinique
 2026-05-04 23:09:45 -04:00
Eric FELIXINE
6c8949f20f Fix publish_orion: PATCH sends attrs only (not id/type/@context) 
- PATCH /entities/{eid}/attrs now sends only attributes
- This allows updating entities with new fields (source, mqttTopic)
 2026-05-04 23:03:02 -04:00
Eric FELIXINE
1f61982e56 Simulator: Fix FROST container (frost_http-web-1 image, port 8090) 2026-05-04 22:46:37 -04:00
Eric FELIXINE
5fe800af0d Simulator: Fix INFLUX_URL (localhost:8086 not Docker internal) 2026-05-04 22:45:03 -04:00
Eric FELIXINE
d9cb0531cb Simulator: Fix FROST port 8088 + traceability fields 
- FROST_URL: localhost:8088 (avoid 8086 conflict with InfluxDB)
- Orion-LD: localhost:2026 (not Docker internal hostname)
- source field (NGSI-LD standard) for broker identification
- mqttTopic field (custom) for MQTT topic tracing
- Updated references/data-models.md with schemas
 2026-05-04 22:41:45 -04:00
Eric FELIXINE
e0bf96b9c3 Docs: Ajout référentiel data-models (source/mqttTopic) 2026-05-04 22:39:27 -04:00
Eric FELIXINE
cad1c06422 Simulator: Add source+mqttTopic traceability for Fiware brokers 2026-05-04 22:25:23 -04:00
Eric FELIXINE
36e227c27a Diagram: FROST receives from Simulator/Sensors (not from brokers) 2026-05-04 22:09:08 -04:00
Eric FELIXINE
7f0543de85 Simulator: Stellio URL to localhost:8087 (exposed container) 2026-05-04 22:01:18 -04:00
Eric FELIXINE
a2502eff91 Simulator: FROST_URL default to localhost:8086 (expose frost_http-web-1:8080) 2026-05-04 21:57:57 -04:00
Eric FELIXINE
4fc233d138 Simulator: default MQTT hosts to localhost (not host.docker.internal) 2026-05-04 21:55:25 -04:00
Eric FELIXINE
20fcca5a2b Docs: EMQX Rule Engine configuration for Fiware brokers forwarding 2026-05-04 21:53:04 -04:00
Eric FELIXINE
88f0d1e675 Simulator: use localhost URLs for Fiware brokers (Orion:2026, Stellio:8080) 2026-05-04 21:49:59 -04:00
Eric FELIXINE
5abab6cc00 Simulator: BunkerM port 1900 is MQTT simple (not TLS) - connection fix 2026-05-04 21:35:39 -04:00
Eric FELIXINE
d3e2b103c6 Diagram: FROST with MQTT brokers + OpenRemote UI above Manager (UI->ORM) 2026-05-04 21:34:59 -04:00
Eric FELIXINE
54ac36412d Diagram: add provenance labels + connect all MQTT brokers to Fiware (Orion/Stellio/FROST) 2026-05-04 21:18:20 -04:00
Eric FELIXINE
2660d5946a Simulator: re-add BunkerM (MQTTS) to broker list 2026-05-04 21:08:17 -04:00
Eric FELIXINE
428dec8509 Diagram: IoT sensors connect to all brokers + OpenRemote UI linked (ORM->UI) 2026-05-04 21:05:50 -04:00
Eric FELIXINE
25e490c758 Simulator: fix variable placement (outside docstring) + host.docker.internal support 2026-05-04 21:01:09 -04:00
Eric FELIXINE
2e15a48303 Simulator: use host.docker.internal as default (Docker robust) 2026-05-04 20:53:46 -04:00
Eric FELIXINE
816f5fcddc Simulator: use localhost for MQTT brokers (fix DNS resolution) 2026-05-04 20:53:10 -04:00
Eric FELIXINE
78b423e43d Test: simple Mermaid diagram for Gitea syntax check 2026-05-04 20:48:22 -04:00
Eric FELIXINE
d210e0de25 Mermaid: ultra-minimal version (no subgraphs, no labels, no classDef) for Gitea compatibility 2026-05-04 20:45:13 -04:00
Eric FELIXINE
150ab406f9 Mermaid: simplify diagram (remove comments, parentheses, emojis) to fix Gitea parse error 2026-05-04 20:44:14 -04:00
Eric FELIXINE
d89fb6a96d OpenRemote: MQTT Agent setup guide (UI procedure) 2026-05-04 20:41:17 -04:00
Eric FELIXINE
f0c953c81d Session resume - 04 Mai soirée (Mermaid + Grafana fixes) 2026-05-04 20:39:08 -04:00
Eric FELIXINE
d1ce116430 Grafana: Fix GeoServer + Orion-LD datasources (readOnly: false) 2026-05-04 20:38:06 -04:00
Eric FELIXINE
87238cb5df Fix Mermaid syntax: rename OR→OPENREMOTE, KC→KEYCLOAK (reserved keywords) 2026-05-04 20:36:22 -04:00
Eric FELIXINE
fc6292fc9c GeoServer: 404 web UI fix - use REST API instead (documented) 2026-05-04 20:24:29 -04:00
Eric FELIXINE
8edd09887d Grafana: Fix Orion-LD plugin type (json → grafana-simple-json-datasource) 2026-05-04 20:23:03 -04:00
Eric FELIXINE
8bf872ccbf Diagramme de flux: OpenRemote via brokers+MQTT Agent, pas de REST direct du simulateur 2026-05-04 19:09:59 -04:00
Eric FELIXINE
6c05a3b5e4 Session resume update: tâches annulées (Orion/MQTT) + points à faire 2026-05-04 19:06:22 -04:00
Eric FELIXINE
ebeb9debc9 OpenRemote MQTT Agent: API access forbidden - doc + UI workaround 2026-05-04 19:05:52 -04:00
Eric FELIXINE
3e302b0732 WIP: Orion Grafana blocked (readOnly) + move to OpenRemote MQTT 2026-05-04 19:00:23 -04:00
Eric FELIXINE
69e08ba633 Session resume 04 Mai + GeoServer géoMartinique integration doc 2026-05-04 18:59:07 -04:00
Eric FELIXINE
c69ecb5a48 WIP: Dockerfile update + Grafana dashboard JSON + InfluxDB population script 2026-05-04 18:54:22 -04:00
Eric FELIXINE
1d12a0b370 GeoServer: flux géoMartinique + XStream issue doc + workaround 2026-05-04 18:52:53 -04:00
Eric FELIXINE
ee708fb4ab Fix: InfluxDB async write + Grafana Org rename + GeoServer workspace 2026-05-04 18:37:29 -04:00
Eric FELIXINE
42d1223b14 GeoServer workspace Digitribe + InfluxDB support + data flow diagrams 2026-05-04 18:13:48 -04:00
Eric FELIXINE
fb5b98043c Add data flow diagram (Mermaid MD, HTML, PDF) for Smart City Digital Twin 2026-05-04 17:43:08 -04:00
Eric FELIXINE
df725eadbc Fix OpenRemote auth (password grant + client_secret), add Grafana dashboard, update session resume 2026-05-04 2026-05-04 17:34:24 -04:00
Eric FELIXINE
818ebbce6d fix(simulator): add async threads for FROST/Orion/Stellio 
- Non-blocking calls via threading for external brokers
- FROST_URL fixed: frost_http-web-1:8080
- Healthcheck uses Python (no wget/curl)
- InfluxDB writes no longer blocked by slow brokers

✅ Simulator now HEALTHY with async broker calls
 2026-05-04 14:56:03 -04:00
Eric FELIXINE
aa42a213bb fix: Stellio/Orion - use NGSI-LD core context only (remove raw.githubusercontent.com) 
- STELLIO_INLINE_CONTEXT: replaced long inline dict with uri.etsi.org core URL
- ORION_CONTEXT: removed raw.githubusercontent.com URLs (not accessible from containers)
- publish_stellio(): added NGSILD-Tenant header (urn:ngsi-ld:tenant:default)
- publish_stellio(): keep @context in payload (Stellio needs it to resolve vocabulary)
- Added STELLIO_URL and STELLIO_TENANT env vars for host-based execution via Traefik

Fixes: Stellio 503 JsonLdError, Orion-LD context resolution failures.
Tested: Stellio 201, Orion-LD 207.
 2026-05-04 10:35:18 -04:00
Eric FELIXINE
ba13bf1321 fix: minimal NGSI-LD context without @vocab (Stellio compatible) 2026-05-04 10:09:08 -04:00
Eric FELIXINE
16c02c91dc fix: use Gitea raw context URL for Stellio (replaces blocked ETSI URL) 2026-05-04 09:57:33 -04:00
Eric FELIXINE
a676fe18ae Add simulator contexts directory 2026-05-03 11:40:50 -04:00
Eric FELIXINE
871194a5e3 feat: Smart Data Models + FROST/NGSI-LD fixes 
- Intégration Smart Data Models (AirQualityObserved, TrafficFlowObserved, etc.)
- Payloads NGSI-LD avec @context officiels smartdatamodels.org
- FROST: Ajout FeatureOfInterest dans Observations (fix 400)
- FROST: Migration HTTP-only + suppression Locations du Thing
- URLs unités QUDT corrigées
- OpenRemote: Token realm smartcity (en attente 401)
- Orion-LD/Stellio: 204 success avec Smart Data Models
 2026-05-03 10:53:55 -04:00
Eric FELIXINE
e8270b7d73 Fix: OpenRemote token with admin-cli password grant, add OR_TOKEN_REALM, fix FROST_URL 2026-05-03 08:47:47 -04:00
Eric FELIXINE
4325d5735d docs: add session summary (2026-05-03) with commit hash as session ID for resumption v0.2.0 2026-05-03 03:14:06 -04:00