DP Integration · Diagram Design

Generic data platform integration topology

Three source patterns land in shared object storage, a query surface serves three consumer modes, and platform-wide services remain visibly cross-cutting.

RESTCSVEVENTSREADJDBCKERNELHTTPS AUTHAUTH DATA PLATFORM CRMcustomer records POS exportsdaily CSV batches Event streamnear-real-time events DAGOrchestratorschedules · retries · lineage STOREObject storageversioned data objects SQLQuery enginefederated SQL access BI tooldashboards · reports NotebooksPython · exploration Partner APIscoped data products Identity providerSSO · service identities · policy groups Centralized loggingplatform events · audit trail · retention TYPE KEYSource / consumerFocal platform surfaceOrchestrationPrimary data pathLayer-wide service

THE HEADLINE

Storage and query are the platform core

The two focal surfaces separate durable ingestion from governed access without hiding the wire protocols.

Every integration stays explicit

  • CRM arrives over REST
  • Point-of-sale data arrives as CSV
  • Consumers use JDBC, kernels, or HTTPS

Services apply to the whole layer

Identity and centralized logging terminate at the platform boundary, not at an individual component.