Remote Python Scraping Architect for Scalable Pipelines …, General Pacheco

Our client is a Berlin-based, remote-first scale-up providing cutting‑edge market intelligence and software solutions to the automotive industry. As the company enters an exciting new phase of growth, they are looking for an experienced Python Scraping Developer to strengthen their international, high‑impact team. If you thrive on tackling complex data extraction challenges, building highly scalable web crawlers, and ensuring large-scale scraping systems run flawlessly in production, this role is for you. You will be responsible for the entire lifecycle of our high-volume scraping pipelines, guaranteeing the data we collect is accurate, consistent, and delivered with speed. Responsibilities
- Design & Development: Develop, test, and deploy robust web scraping scripts and crawlers using advanced Python tools (Playwright, Selenium, Requests, BeautifulSoup, etc.).
- Scalability: Architect and maintain asynchronous scraping systems capable of massive, large-scale data extraction.
- Resilience: Implement, monitor, and optimize sophisticated anti-blocking strategies and proxy rotation to ensure high reliability and uptime.
- Integration: Manage and automate data ingestion pipelines and seamless integrations with external REST APIs.
- Operational Excellence: Debug, monitor, and continuously improve scraper performance, reliability, and data quality.
- Collaboration: Partner with other engineers to enhance our core scraping infrastructure, tooling, logging, and monitoring systems.
- DevOps Support: Assist with DevOps tasks, including Docker, CI/CD, and managing Linux environments.

Requirements
- Core Experience: Proven, hands-on professional experience in high-volume web scraping and data extraction using Python.
- Technical Depth: Solid understanding of HTML parsing, browser automation techniques, and asynchronous programming.
- Frameworks: Proficiency with leading web scraping frameworks (e.g., Playwright, Scrapy, or Selenium).
- Web Knowledge: Strong knowledge of REST A Postúlate en Kit Empleo: kitempleo.com.ar/empleo/q8u1t