Architecture · Diagram Design · Parametric
High-level architecture · Vertical Orchestration + Security
DATA SOURCES
INGESTION
STORAGE
TRANSFORM
VISUALIZATION
ORCHESTRATION
SECURITY
OBSERVABILITY
SOURCES
EXT
PostgreSQL
CDC · SQL · API
EXT
SFTP drop
Batch · landing
EXT
Web forms
Survey · admin
EXT
Legacy system
Trade · mainframe
Orchestration / Workflow Automation
(Apache Airflow)
COLL
Apache NiFi
Collect · route · transform
VIRT
Trino
SQL · data virtualization
STORE
MinIO / S3
Object store · S3-API
ANLZ
Notebooks
Jupyter · Python · R
DASH
Superset
Dashboards · reports
Kubernetes
Identity Manager
(Keycloak · LDAP · OIDC)
Monitoring & Observability
(Prometheus · Grafana · Loki)
LEGEND
External · outside cluster
Kubernetes boundary
Focal (storage hub)
Primary path
Orchestration trigger
Query read-back