Job Summary
Job Description
DUTIES: Provide technical leadership in designing and developing data processing software in an Agile development environment using Scala, Spark, Go (Golang), Airflow, Python, Spark SQL, MySQL, and Presto; use AWS cloud services including EKS, S3, EMR, Glue, EC2, ECS, IAM, Lambda, and ASG; build CI/CD pipelines using Docker, Terraform, and Jenkins; perform application monitoring using Grafana and Prometheus; deploy microservices using Kubernetes; perform data analysis using Snowflake and Databricks; support applications under development and customize current applications; assist with the software update process for existing applications, and roll-outs of software releases; analyze, test, and assist with the integration of new applications; document all development activity; oversee the architecture design; research, write, and edit documentation and technical requirements, including software designs, evaluation plans, test results, technical manuals, and formal recommendations and reports; monitor and evaluate competitive applications and products; review literature, patents, and current practices relevant to the solution of assigned projects; collaborate with project stakeholders to identify product and technical requirements; conduct analysis to determine integration needs; work with the Quality Assurance team to determine if applications fit specification and technical requirements; and guide and mentor junior-level engineers. Position is eligible to work remotely one or more days per week, per company policy.
REQUIREMENTS: Bachelor’s degree, or foreign equivalent, in Computer Science, Engineering, or related technical field, and seven (7) years of experience developing data processing software in an Agile development environment using Scala, Spark, Go (Golang), Airflow, Python, Spark SQL, MySQL, and Presto; using AWS cloud services including EKS, S3, EMR, Glue, EC2, ECS, IAM, Lambda, and ASG; of which five (5) years include building CI/CD pipelines using Docker, Terraform, and Jenkins; performing application monitoring using Grafana and Prometheus; deploying microservices using Kubernetes; and performing data analysis using Snowflake and Databricks
Disclaimer: This information has been designed to indicate the general nature and level of work performed by employees in this role. It is not designed to contain or be interpreted as a comprehensive inventory of all duties, responsibilities and qualifications.
Skills
Grafana, Presto, Spark SQLWe believe that benefits should connect you to the support you need when it matters most, and should help you care for those who matter most. That's why we provide an array of options, expert guidance and always-on tools that are personalized to meet the needs of your reality—to help support you physically, financially and emotionally through the big milestones and in your everyday life.
Please visit the benefits summary on our careers site for more details.