Equal Opportunity Employer
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, or disability status. EEO/Disabled/Vets
Job Description :
About the Role
We are looking for a Senior Data Engineer
with experience in excellent analytical
abilities in GCP BigQuery, ETL/BI, Python,
Composer/Airflow, SQL, GCP Services -
with the ability to operate in an agile
environment and keen to detail while
understanding the larger data warehouse.
Skills & Competencies
➔ A minimum of 4.5+ years of
working experience as a hands-on
data engineering is a must
➔ Advanced Degree in the field of
Computer Science, Data
Engineering, Data Analytics or
equivalent discipline
➔ Strong programming experience
with Python, SQL, ETL and
efficiently querying big datasets
using SQL
➔ Prior experience with CircleCI
CI/CD, Terraform and Github
version control is a must
➔ Solid understanding of Data
Collection, Data Ingestion, Data
Integration, and Data Operations
& Maintenance
➔ Implement data governance
practices, including data quality,
security, and compliance, in line
with organizational standards.
➔ Domain knowledge on News,
Media & Communications is an
added advantage
R E S P O N S I B I L I T I E S
➔ Design, build, and maintain scalable
ETL/ELT pipelines in Google Cloud, using
tools like Cloud Composer (Airflow), and
BigQuery.
➔ Collaborate with cross-functional teams to
define data architecture and data
warehouse requirements
➔ Automate data pipelines, ETL/ELT
processes, and data integration workflows
using infrastructure-as-code (IaC) and
configuration management tools
➔ Deep understanding of BigQuery,
including SQL, optimization techniques,
partitioning, clustering, and performance
tuning.
➔ Deliver production quality, modular,
reproducible code in Python, SQL
➔ Implement continuous integration and
continuous deployment (CI/CD) pipelines
for data pipelines and data-related
applications
➔ Keep abreast of the latest developments
in the field through continuous learning
and proactively champion promising new
methods relevant to the problems at hand.
Our Tech Stack
● Google Cloud Platform is IaaS
● BigQuery, GCS, Python, SQL
● Composer / Airflow - orchestration
tools
● Terraform, CircleCI, CI/CD, GIthub,
Jira, Confluence
Job Category: