Scene 1 (0s)
Data -- H1 2026 Roadmap Deep Dive.
Scene 2 (6s)
Data Control Plane.
Scene 3 (12s)
Requirements & Approach. 3. Build a centralized data control layer that defines and enforces super schema standards - covering schema structure, classification, retention, and access policies To standardize and enforce uniform governance across all storage systems and access patterns. Serves as the central authority for managing configuration, policies, schemas, metadata, governance rules and its lifecycle..
Scene 4 (31s)
4. Super Schema Standards & Validation Established: Defined super schema standards and implemented automated validation to ensure consistency and compliance. Automated PR Validation Pipeline: When a PR is raised, a Harness pipeline is triggered to validate the super schema and posts detailed success/failure comments directly in the PR. Post-Merge Schema Persistence: After the PR is merged, a second Harness pipeline automatically stores the approved super schema in the Spanner database by invoking the Data Control Plane API. Super Schema Publication to DataHub: After validation, super schemas are published to DataHub via Pub/Sub for metadata visibility and discovery. Demo - Super-schema Workflow.
Scene 5 (1m 1s)
5. Onboard WAAS-Qatar Collaborate with the WAAS-Qatar team to migrate and onboard their datasets to the Spanner platform. Schema Conversion • Convert all 50 existing WAAS-Qatar table schemas into the standardized super schema format. • Store the validated super schemas in the metadata database. Spanner Table Creation • Execute DDL to create all required tables in Spanner. Productionize End-to-End Onboarding Pipeline • Build and operationalize a fully automated pipeline for super schema validation, metadata storage, DDL generation, and Spanner onboarding. • Ensure seamless, repeatable, and scalable onboarding for future portfolios..
Scene 6 (1m 28s)
Thank You.