IN_Senior Associate__GCP-DataPlex__ D&A_ Advisory_ Bangalore

Job Description & Summary: A career within…. A career within Data and Analytics services will provide you with the opportunity to help organizations uncover enterprise insights and drive business results using smarter data analytics. We focus on a collection of organizational technology capabilities, including business intelligence, data management, and data assurance that help our clients drive innovation, growth, and change within their organizations in order to keep up with the changing nature of customers and technology. We make impactful decisions by mixing mind and machine to leverage data, understand and navigate risk, and help our clients gain a competitive edge. 

Responsibilities:

• Design, develop, and implement data engineering solutions on GCP aligned with data governance and data mesh principles.
• Architect and manage secure, scalable data pipelines using Dataflow, BigQuery, Pub/Sub, Dataproc, Dataplex, Data Catalog, Cloud Composer, and Cloud Storage.
• Develop ETL/ELT pipelines using DBT and work with databases such as Snowflake.
• Implement data mesh architecture (domain-oriented ownership, data-as-a-product, self-serve infrastructure, federated governance).
• Define and enforce data standards, lineage, metadata management, and data quality frameworks with governance teams.
• Establish data governance policies including data classification, IAM access controls, cataloging, auditing, discoverability, traceability, and compliance.
• Implement automation and CI/CD pipelines for data workflows using Terraform or Deployment Manager (IaC).
• Translate business requirements into scalable technical solutions aligned with governance and mesh frameworks.

Mandatory skill sets:

• GCP Data Services: BigQuery, Dataflow, Pub/Sub, Dataproc, Dataplex, Cloud Storage, Data Catalog, Cloud Composer
  • Data Engineering & Data Architecture
  • Data Governance Frameworks: lineage, metadata management, data quality, security controls
  • Data Mesh architecture and domain-driven design
  • ETL/ELT development (DBT) and databases like Snowflake
  • Programming: SQL, Python and/or Java
  • Orchestration: Apache Airflow / Cloud Composer
  • Infrastructure as Code: Terraform / Deployment Manager
  • DevOps & CI/CD practices for data workflows

Preferred skill sets:

• Experience with data catalog and metadata management tools beyond GCP native tools (e.g., Apache Atlas, Amundsen).
• Knowledge of data privacy frameworks such as GDPR, CCPA.
• Familiarity with containerization (Docker, Kubernetes) for data infrastructure.

Years of experience required:

7-11

Education Qualification

B.Tech / M.Tech / MBA / MCA