Data Engineer - Web Scraping

As a Data Engineer, you will manage and optimize website scraping configurations and data pipelines that support strategic solutions for world-class luxury brands. You will play a vital role in ensuring data integrity and performance, directly influencing how these iconic brands engage with their customers through high-quality data-driven insights.

• Maintain and manage complex website scraping configurations utilizing Python.
• Monitor scraping configurations proactively to detect and resolve errors or potential crashes.
• Oversee retrieved data sets to identify potential issues, data gaps, or site blockages.
• Develop and optimize ETL pipelines to ingest data into the Azure Datalake and perform necessary transformations.
• Coordinate with internal stakeholders to understand technical requirements and provide regular updates on scraping activities and performance.

• Proven experience in Python development specifically for data engineering and web scraping.
• Strong expertise in building and managing ETL pipelines.
• Professional experience with workflow orchestration tools, specifically Airflow.
• Hands-on experience with DBT for data transformation.
• Proficiency in both SQL and NoSQL database technologies.
• Experience working within the Azure cloud environment.

• Professional proficiency in French is highly desirable.
• Experience with Infrastructure as Code using Terraform.
• Strong version control skills using Git.
• Foundational knowledge of Data Security best practices.

• Reliability and uptime of web scraping configurations.
• Accuracy and cleanliness of data ingested into the Datalake.
• Timely delivery of data transformation projects using DBT.

5-month contract duration.

Our organization focuses on delivering high-end strategic solutions for iconic luxury brands, leveraging data to drive performance and enhance the global customer experience.

This role is 100% remote, allowing for a flexible workspace while maintaining professional standards and high output.