Cortex Data Foundation

The Cortex Data Foundation is the core architectural component of Google Cloud Cortex Framework. Cortex Framework provides reference architectures, deployable solutions, and packaged implementation services to kickstart your Data and AI Cloud journey. Cortex Framework incorporates your source data into tools and services that help ingest, transform, and load it to get insights faster from pre-defined data models that can be automatically deployed for use with Google Cloud BigQuery

This repository contains the Entity Relationship (ERD) diagrams, scripts and files to deploy the Cortex Framework. For more information and instructions, see our official Cortex Framework documentation site.

Data sources and workloads

Cortex Framework focuses on solving specific problems and offers pre built solutions for business areas like Marketing, Sales, Supply Chain, Manufacturing, Finance, and Sustainability. Cortex Framework is flexible and it can include data from sources beyond what is prebuilt. The following are the data sources available. For more information about each one, click any of them.

Marketing:

• Salesforce Marketing Cloud
• Google Ads
• Campaign Manager 360 (CM360)
• TikTok
• Meta
• LiveRamp
• YouTube (with DV360)
• Google Analytics 4

Operational:

• SAP (ECC and S/4)
• Salesforce Sales Cloud
• Oracle EBS

Sustainability:

• Dun & Bradstreet with SAP

Note: If you want to know more about which entities are covered in each data source, see the Entity-Relationship Diagrams (ERD) in the docs folder.

Deployment

For Cortex Framework deployment instructions, see the following:

• Quickstart Demo: a quickstart demo to test the Cortex Framework set up process with sample data within just a few clicks. This demo deployment is not suitable for production environments.
• Deployment steps: after reading the prerequisites for Cortex Data Foundation deployment, follow the steps for deployment in production environments:
  1. Establish workloads
  2. Clone repository
  3. Determine integration mechanism
  4. Set up components
  5. Configure deployment
  6. Execute deployment

Optional steps

You can customize your Cortex Framework deployment with the following optional steps:

• Use different projects to segregate access
• Use Cloud Build features
• Configure external datasets for K9
• Enable Turbo Mode
• Telemetry

Looker Blocks and Dashboards

After Cortex Framework deployment, you can take advantage of prebuilt Looker Blocks and Dashboards for some of the Cortex Framework data sources. For more information, see Looker Blocks and Dashboards overview.

The following are the Looker Blocks and Dashboards available in Cortex Framework:

• Looker Blocks
  • Operational
    • Looker Block for SAP
    • Looker Block for Salesforce
    • Looker Block for Oracle EBS
  • Marketing
    • Looker Block for Salesforce Marketing Cloud
    • Looker Block for Meta
    • Looker Block for YouTube (with DV360)
• Looker Studio Dashboards
  • Sustainability
    • Looker Studio Dashboard for Dun & Bradstreet

Note: If you are looking for the README files before Release 6.0, see the deprecated docs folder.