Senior Data Engineer (Data Lake + Python + SQL).

We are looking for a Data Engineering Specialist who is passionate about building systems that shape business outcomes. This role will play a key role in designing, building, and optimizing the data platform. You will drive and manage large-scale data migration and modernization initiatives, and work with cross-functional teams to deliver trusted, high-quality data that drives business intelligence, analytics, and innovation.
As a Data Engineering Specialist, you will be at the forefront of building scalable pipelines, architecting data solutions, and ensuring the data platforms can support real-time insights and long-term growth.

Responsibilities and Duties:

• Take ownership of coding and solution design while collaborating with internal and external engineers on design, development, and deployment of data pipelines and solutions.
• Design and implement end-to-end data migration strategies from legacy systems to modern cloud platforms.
• Manage data architecture and data modernization initiatives, ensuring alignment with business goals, data governance policies, and performance requirements.
• Develop and optimize ETL/ELT pipelines using modern tools and frameworks (e.g., Apache Spark, Databricks, Airflow, dbt).
• Work with stakeholders to gather requirements and translate them into scalable and maintainable data solutions.
• Ensure data quality, reliability, and integrity through robust testing and monitoring.
• Drive best practices in DevOps for data – CI/CD.
• Mentor and provide technical guidance to data engineers.

Qualifications Required

:
• 7+ years of relevant experience in Data Engineering / Analytics domain with at least 3 years in Digital Analytics
• 7+ years of experience in SQL
• 4+ years in Python
• Experience with building a data lake over Cloud / Azure, ADF, Synapse, and Databricks – Delta Lake
• Proven expertise with tools like ADF, Qlik Replicate, FiveTran for data integration and ETL processes.
• Strong understanding of Python scripting and use of libraries (NumPy, Pandas)
• Extensive hands-on experience with MS Fabric, including data warehousing, SQL optimization, and cluster management.
• Strong knowledge of Big Data technologies such as Data Bricks, Event driven data processing using Function Apps/Lambda is preferred
• Understanding of Web services (SOAP, XML, UDDI, WSDL)
• Strong knowledge and experience in event driven architecture using standard message queues (i.e.RabbitMQ, SQS or Kafka)
• Hands on Experience parsing NOSQL file systems such as JSON, XML, AVRO, Parquet.
• Proven track record of using Apache Spark Data Bricks.
• Hands-on experience with Azure Data Factory (ADF), Logic Apps, and Runbooks.
• Exposure to traditional BI Tools (Tableau, Power BI, Qlik, SSRS, etc.)
• Experience building web-services is a plus.

Full-time remote job