Lead Python Developer (Web Scraping)

  • Egypt
  • Fully Remote
  • Full-time
  • Delivery

We are seeking a highly experienced Lead Python Developer with a strong focus on web and application scraping to design, build, and maintain scalable scraping solutions. The ideal candidate will have deep hands-on expertise in Python, Selenium, and Appium, along with experience extracting data from complex sources and integrating third-party APIs.

This role involves developing and maintaining scraping applications, deploying solutions in AWS, and collaborating closely with cross-functional teams to ensure reliable and high-performing data extraction pipelines.

Key Responsibilities

  • Design and develop browser-based web scraping applications using Selenium.
  • Build and maintain Android application scrapers using the Appium framework.
  • Research third-party websites and mobile applications to implement efficient and robust scraping logic.
  • Extract and process data from multiple file formats, including PDF, Excel, and CSV.
  • Integrate scraping solutions with third-party APIs using Python.
  • Maintain and enhance existing Python-based applications to ensure performance and stability.
  • Deploy, monitor, and maintain applications in AWS environments.
  • Use Docker for containerization and application consistency.
  • Collaborate effectively with cross-functional teams to deliver scalable and reliable solutions.
  • Ensure operational excellence through monitoring, debugging, and performance optimization.

Required Skills & Experience

  • Bachelor’s or Master’s degree in Computer Science or a related field.
  • 8+ years of overall hands-on experience in Python development.
  • 5+ years of hands-on experience in Python web and application scraping.
  • Strong proficiency in Python 3.
  • Extensive hands-on experience with:
  • Selenium
  • Appium
  • API integrations / requests
  • Docker
  • BrowserStack
  • ScrapingBee
  • Solid understanding of scraping best practices, anti-bot mitigation, and data extraction workflows.
  • Experience deploying and maintaining applications in AWS.
  • Exposure to large-scale or high-volume scraping systems.
  • Strong problem-solving skills and the ability to work independently in complex environments.
  • Excellent collaboration and communication skills.

We have an amazing team of 700+ individuals working on highly innovative enterprise projects & products. Our customer base includes Fortune 100 retail and CPG companies, leading store chains, fast-growth fintech, and multiple Silicon Valley startups.

What makes Confiz stand out is our focus on processes and culture. Confiz is ISO 9001:2015 (QMS), ISO 27001:2022 (ISMS), ISO 20000-1:2018 (ITSM), ISO 14001:2015 (EMS), ISO 45001:2018 (OHSMS) Certified. We have a vibrant culture of learning via collaboration and making workplace fun.

People who work with us work with cutting-edge technologies while contributing success to the company as well as to themselves. 

To know more about Confiz Limited, visit: https://www.linkedin.com/company/confiz-pakistan/

Apply Now