Career Techniques Inc.
Description
Our client is looking for a Databricks Architect for an upcoming project. The duration is expected to be about 3 months with the possibility of extension. This is a remote position, consultant needs to be able to work EST hours.
Responsibilities:
- Build and operationalize complex data solutions, correct problems, apply transformations and recommend data cleansing/quality solutions on the Databricks platform within Azure Cloud
- Configuring the data lake, create and optimize data pipelines, integrating data from different sources
- Implementing data transformations, ensuring data cleanliness
- Design data solutions
- Analyze sources to determine value and recommend data to include in analytical processes
- Incorporate core data management competencies including data governance, data security and data quality
- Collaborate within and across teams to support delivery and educate end users on data products/analytic environment
- Perform data and system analysis, assessment and resolution for defects and incidents of moderate complexity and correct as appropriate
- Test data movement, transformation code, and data components
- Perform other duties as assigned