Big Data Developer- 5-9Years

The Institutional Data Platform is a next generation Data Fabric that functions at the core of Enterprise Data Strategy to solve the evolving Data needs of Citi’s SMB. The Fabric brings together disparate data sources for the Global Markets organization and enables seamless Regulatory reporting, Client/ Surveillance/ Supervisory reporting, industry-leading Analytics and Data Science solutions. It provides enhanced Data Quality controls, Completeness and Accuracy, Reconciliations, Entitlements, Performance, management of Data Retention and Archival per regulatory guidelines.

As part of this program build out, the team is setting up a robust platform to receive, host and deliver massive volumes of data, transforming the data management & delivery paths, developing high performance data pipelines with best-in-class control mechanisms and operational dashboards.

The ideal candidate will have a passion cum extensive experience in large scale data handling, rich expertise on BigData Transformation programs right from Architecture to Maintenance. The candidate will work closely with Enterprise Application teams, Technology partners, Enterprise Architects, Data Governance Teams, Business Analysts, Quality Engineers to meet the IDP Program objectives.

Development Value:

Candidate will be involved in design & development of the Data ingestion pipelines, developing/ leveraging reusable Frameworks, Technical data modeling, defining & implementing data controls, supporting Upgrades, thereby playing a Key Role in meeting the Enterprise Data Strategy Objectives.

Key Responsibilities:

• Design and develop reusable Frameworks for Data ingestion, extraction, report submission etc.
• Translate high-level & functional requirements, Data Modelling (dimensional, semi structured, transactional use cases) to technical design.
• Develop batch & real time data ingestion Pipelines involving wide range of technologies like Messaging middleware, Kafka, SFTP, Spark, Hive etc.
• Develop programs to migrate Historical Data from legacy platforms to the BigData platform.
• Develop programs for real time and EOD reconciliations.
• Provide SME support for development of automated QA scripts.
• Participate in UAT/ SIT Test cycles, Release cycles, triage and resolve issues.
• Setup monitoring and management for services.
• Partner with Project Manager, BA and Business stakeholders and prioritize the Book of Work.
• Perform Code reviews, test case reviews and ensure Functional & Non-Functional requirements.
• Analyse Platform & Software version upgrades, evaluate new tools and technologies for Big Data handling.
• Ensure adherence to and develop best practices supporting Citi’s Project Management Standards.
• Ensure SDLC standards are followed with artefacts to support Internal & External Audits.

Qualifications:

• 5+ years of software development experience building large scale distributed data processing systems or large-scale Web applications.
• Experience of at least 3 years in designing & developing Big Data solutions with at least one end to end implementation.
• Strong Hands-on experience in following technical skills:
  • Apache Spark
  • Java/ Scala
  • XML/ JSON/ Parquet/ Avro/ protobuf
  • SQL
  • Spring Boot/ Microservices
  • Linux
  • Hadoop Ecosystem (HDFS, Spark, Impala, HIVE, HBASE etc.)
  • Kafka
• Exposure to Cloudera offerings like Ozone, Iceberg etc. is good to have.
• Performance analysis, troubleshooting and issue resolution.
• Experience working with Software vendor teams on open issues and resolutions.
• Strong experience with SQL, building queries, analysing, troubleshooting and improving queries.
• A history of delivering against agreed objectives.
• Ability to multi-task and work under pressure.
• Enthusiastic and proactive approach with willingness to learn, ability to pick up new concepts and applying the knowledge.
• Demonstrated problem solving skills.
• Excellent analytical and process-based skills, ability to produce process flow diagrams, business modelling, and functional design.
• The candidate is expected to be dynamic, flexible with a high energy level as this is a demanding and rapidly changing environment.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

 

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.