Senior Anti-Bot / Scraping Engineer

Responsibilities

• Design and maintain large-scale Python scraping systems that operate reliably against Google and other highly defended websites
• Build scrapers for dynamic, JavaScript-heavy pages using browser automation and hybrid approaches
• Continuously adapt to changes in page structure, request flows, and anti-automation mechanisms
• Engineer robust extraction pipelines that prioritise data accuracy, consistency, and observability
• Implement proxy, fingerprinting, and request-routing strategies to maximise stability and throughput
• Monitor scrape health, detect failures early, and rapidly debug production issues

Optimise performance, cost, and latency across scraping infrastructure

• Work closely with data engineers, data scientists, and product teams to ensure scraped data is usable and trusted
• Document scraping logic and operational runbooks for long-term maintainability

Requirements

• Strong professional experience with Python (or another main language, i.e. GoLang, Rust, JavaScript) including production-grade scraping systems
• Deep hands-on experience scraping Google or similarly protected platforms
• Solid understanding of HTTP, TLS, cookies, headers, redirects, and browser networking behaviour
• Experience with tools such as Playwright, Selenium, Puppeteer, or equivalent browser automation frameworks
• Strong knowledge of HTML parsing, DOM traversal, and data extraction techniques
• Experience handling rate limiting, CAPTCHA, IP rotation, and bot detection systems
• Comfortable working with asynchronous and concurrent scraping architectures

Experience running scrapers at scale in cloud environments

• Strong debugging skills and ability to reason about complex failure modes
• Experience with headless browser fingerprinting and anti-bot evasion techniques

Preferred

• Familiarity with containerisation and orchestration, such as Docker and Kubernetes
• Experience with distributed task systems and job queues
• Background in data quality monitoring and anomaly detection
• Experience working with search, advertising, or competitive intelligence data

Benefits

• Here’s what we offer:

Startup Engineering culture

• Our quarterly surveys show a 93% average approval rating for company culture, with an overall eNPS of 27.
• US 2025 Search Awards for Best AI Search Software Innovation
• Our employees do incredible work, so as we grow, everyone shares the rewards.
• Take as much time off as you need, when you need it.
• 52% of Adthenian’s work fully remote, with others choosing Hybrid Work at our 3 Geohubs (London, Austin, Sydney).
• Work how and where you do your best, with full autonomy over your day.
• Bespoke training and career development via "Sherpa plans” to guide your growth.

Monthly Hackdays & Training Days

• Up to 6 months fully paid maternity leave, and 2 months paternity leave.
• $200 for your ideal remote setup.
• $70 credit to grab some merch.
• Celebrate your special day.
• Summer & Christmas parties, annual and quarterly offsites, monthly meet-ups. See here for more info.
• Make a difference with paid volunteer time each quarter. See here for more info.

About the Role

• Reporting to: Michal Gondar, Head of Engineering
• Location: UK Remote
• Interviews: 2 Stages

Start Date: ASAP

More info: See FAQ below, our candidate hub, or reach out to [email protected]

What We Value

• Pragmatic problem-solving in hostile and fast-changing technical environments
• High ownership of systems that run continuously and at scale

A strong bias toward reliability, correctness, and observability

• Ability to explain complex technical behaviour clearly to non-specialists
• Curiosity about how large platforms evolve their defences and infrastructure

Our Core Values

• All Adthenians are expected to align closely with our ‘Core Values’.
• What it means...
• We're big on taking action, owning our challenges, and finding solutions.
• We take charge of results to recognition. We know that our hustle not only moves the needle for the company but also sets us up for personal success.
• We care about exceeding expectations in the work we do and aim to always do our best work as individuals and as a team.
• We strive daily to expand our knowledge and become better at what we do.

Meet your teammates

You’ll work closely with: Michal Gondar Head of Engineering LinkedIn: https://www.linkedin.com/in/michalgondar/ Albert Albentosa Title: Senior Anti-Bot Engineer LinkedIn: https://www.linkedin.com/in/albert-albentosa-b30ab9231/