Career Techniques Inc.
Description
Our client is seeking a Lead Data Engineer as the senior software engineer in the Business Intelligence and Data Warehousing team. This role develops data ingestion to enable high-value business intelligence products. This is a senior individual contributor role with a focus on hands on development, collaborative problem solving, and mentorship of junior engineers. Successful candidates will directly influence solution designs to create a robust data platform to deliver a wide range of products. This role requires 12+ years of engineering experience including work on Azure Data Factory and Informatica Power Center / IICS.
Responsibilities:
- Design, develop, and maintain data pipelines. Deliver solutions using the MS Azure platform.
- Scope the data engineering roadmap and deliverables to assist project and sprint planning.
- Automate tasks and deploy production standard code with unit testing, continuous integration, versioning, etc.
- Work in an Agile framework and collaborate with team members to solve complex problems.
- Assist junior engineers with Production Support when needed to resolve issues.
Requirements:
Must have
- Strong recent experience working as Azure Data Engineer.
- Experience in Informatica IICS or Power Center Experience around Cloud Application Integration and Cloud Data Integration.
- Experience in developing application integration using SOAP/REST APIs and big data technologies such as Apache Spark.
- Strong experience in DevOps platforms such as GitHub with hands-on experience in branching, merge strategy, rebasing and reviewing history.
- Good knowledge of Rest V2, Swagger file generation and Python scripting.
A Plus
- Working knowledge of SQL and data analysis.
- Experience in Kubernetes, Docker, Terraform, and/or Snowflake