Job Description

Lead Data Engineer

Location: Remote (EST)

Contract: 6+ months ongoing (possible contract to hire/must be eligible for conversion)

Summary: As a Lead Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure. You will be responsible for data integration, migration, and analysis using a variety of Microsoft technologies. This role requires a deep understanding of Azure Data Factory, Logic Apps, Azure Service Bus, Databricks, and advanced SQL and Python. You will work closely with the Data Lead and Technical Analyst to translate business requirements into technical solutions and ensure the seamless flow of data across our systems.

Key Responsibilities:

• Design, develop, and maintain data pipelines using Azure Data Factory, Logic Apps, and Azure Service Bus
• Implement and manage Databricks for advanced data processing and analytics
• Develop complex SQL queries and stored procedures for data extraction, transformation, and loading (ETL)
• Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications
• Ensure data quality and integrity across various data sources and systems
• Manage data integrations and migrations between diverse systems, ensuring minimal disruption to business operations
• Utilize Azure CI/CD pipelines for continuous integration and delivery of data solutions
• Create and maintain data workflows using Power Automate
• Conduct data analysis to support business decision-making processes
• Work independently and as part of a team to deliver high-quality data solutions
• Communicate effectively with stakeholders to understand their data needs and provide technical guidance

Job Tags

Similar Jobs