Group Data Cloud Platform Architect

Euronext

Role profile

Euronext is seeking a Data Cloud Platform Architect with over 10 years expertise in AWS data services, extensive exposure to data engineering, experience in European corporate environments, and you should be based in Porto. Exposure to Azure technologies is nice to have. The ideal candidate will have experience with Infrastructure as Code, and a proven ability to implement and enforce data governance and security standards. You should have a strong track record of leading large scale cloud data projects, as well as hands-on coding skills in Python and SQL for prototyping and setting technical standards.

You will be responsible for designing, implementing, and maintaining scalable data solutions, primarily on AWS, ensuring alignment with defined data architecture and governance frameworks. You will collaborate with cross functional teams to develop and optimise data pipelines, ETL processes, and orchestration workflows using tools such as Apache Airflow, AWS Step Functions, Lambda, and Glue. Experience with Iceberg tables and managing large datasets is required. Exposure to Azure platform technologies, including Databricks, is considered an advantage.

As a Data Cloud Platform Architect, you will translate business requirements into technical solutions, distribute tasks effectively within your team, and select the most appropriate tools for cost and performance. You will provide technical leadership, mentorship, and guidance, ensuring adherence to best practices in production awareness, troubleshooting, and security.

• Demonstrate deep expertise in AWS data services, including Lambda, Glue, Step Functions, and Redshift, with exposure to Azure data services.
• Lead the implementation and enforcement of data governance and security standards across cloud platforms.
• Oversee the implement Infrastructure as Code (IaC) solutions using Terraform and CloudFormation.
• Lead the optimisation projects, ensuring minimal disruption and maximum efficiency.
• Apply hands-on coding skills in Python and SQL to prototype solutions and establish coding standards.
• Develop robust solution architectures with a focus on scalability, performance, security, and cost optimisation.
• Design efficient data models and optimise query performance for large datasets.
• Manage ETL processes and data integration into Redshift, DuckDB, and PostgreSQL.
• Set up and manage logging and tracing mechanisms in AWS using services such as CloudTrail and X-Ray.
• Implement orchestration solutions using Apache Airflow and AWS Step Functions.
• Utilise Athena for interactive query analysis of large datasets in Amazon S3.
• Provide technical leadership and act as a subject matter expert in cloud data engineering.
• Write comprehensive solution and technical documentation.
• Stay updated on emerging technologies and industry trends.
• Challenge business requirements and propose innovative solutions for efficiency and performance improvement.

The base skills we are searching are:

• Deep expertise in AWS data services, with exposure to Azure data services.
• Expected to be hands-on in developing Infrastructure as Code templates (e.g., Terraform) for platform deployment.
• Proven ability to define and enforce data governance and security standards.
• Demonstrated experience leading large-scale data migration and optimisation projects.
• Strong programming skills in Python and SQL, with experience in prototyping and setting coding standards.
• Define data engineering standards by creating PoCs and production-grade prototypes.
• Responsible for establishing and optimizing CI/CD pipelines for data workloads.
• Experience with Iceberg tables and managing large datasets efficiently.
• Proficiency in designing scalable and efficient data solutions on AWS, following best practices for cloud architecture and infrastructure.
• Experience with orchestration tools such as Apache Airflow and AWS Step Functions.
• Knowledge of ETL tools and experience working with large volumes of data, with a preference for experience with Kafka.
• Proactive approach to production monitoring and troubleshooting.
• Excellent communication and teamwork skills, with the ability to provide technical leadership and mentorship.
• Strong analytical and problem-solving skills, with the ability to analyse requirements and propose innovative solutions.
• Experience in writing solution documents and technical documentation.
• Familiarity with Azure Databricks for data engineering and analytics tasks is an advantage.

Partnership

Collaborative and open minded.

Attitude to works in team to effective build a strong relationship with the other team member and the other teams   

Innovation

Open to adopt new processes / approaches / ways of working.

Excellence

Oral and written communications are tailored to their audience.

Willingly to go the extra mile, put in the effort to ensure activities are completed on time and with the quality expected.

Pro-actively seeks information/inputs from colleagues/clients.

• Must have:
  • BS/MS degree in Computer Science, Engineering or equivalent working experience
  • English (C1 or higher level)
  • Passion for technology and support.
  • Problem-solving skills.

• Nice to have:
  • Apache Flink, Kafka, and other streaming data technologies knowledge
  • Certification in AWS, Azure, or similar technologies
  • Experience with Dataiku