Senior Data Engineer

Job Responsibilities:

• Design and implement end-to-end data engineering solutions by leveraging the full suite of Databricks, Fabric tools, including data ingestion, transformation, and modeling.
• Design, develop and maintain end-to-end data pipelines by using spark, ensuring scalability, reliability, and cost optimized solutions.
• Collaborate with internal teams and clients to understand business requirements and translate them into robust technical solutions.
• Conduct performance tuning and troubleshooting to identify and resolve any issues.
• Implement data governance and security best practices, including role-based access control, encryption, and auditing.
• Translate Business requirements into high-quality technical documents including, data mapping, data processes, and operational support guides.
• Work closely with architects, product managers and reporting team to collect functional and system requirements.
• Work in fast-paced environment and perform effectively in an agile development environment.

Minimum Qualifications:

• Bachelor’s Degree
• 8 years of experience in designing and implementing data solutions with 4 years of experience in data engineering.
• 4 years experience with Databricks, Fabric, including a deep understanding of its architecture, data modeling, and real-time analytics.
• 6 years of experience in Spark, PySpark and Python.
• 4 years experience in SQL, Spark SQL, data modeling & RDBMS concepts.

Additional Job Standards:

• Extensive experience with Databricks,Fabric, including a deep understanding of its architecture, data modeling, and real-time analytics.
• Strong knowledge of Data Fabric services, particularly Data engineering, Data warehouse, Data factory, and Real- time intelligence.
• Solid experience with Git, CI/CD, branching strategies.
• Experience building ingestion frameworks for legacy systems.
• Strong problem-solving skills, with ability to perform multi-tasking.
• Familiarity with security best practices in cloud environments, Active Directory, encryption, and data privacy compliance.
• Communicate effectively in both oral and written.
• Experience in AGILE development, SCRUM and Application Lifecycle Management (ALM).
• Preference given to current or former Labcorp employees.

Benefits: Employees regularly scheduled to work 20 or more hours per week are eligible for comprehensive benefits including: Medical, Dental, Vision, Life, STD/LTD, 401(k), Paid Time Off (PTO) or Flexible Time Off (FTO), Tuition Reimbursement and Employee Stock Purchase Plan. Employees regularly scheduled to work less than 20 hours, Casual, Intern, and Temporary employees are only eligible to participate in the 401(k) Plan. Employees who are regularly scheduled to work a 7 on/7 off schedule are eligible to receive all the foregoing benefits except PTO or FTO. For more detailed information, please click here.