Oxylabs.io

Experienced Web Scraping Engineer - Python

Oxylabs.io  •  Republic of Poland (Onsite)  •  2 days ago
Apply
Save Job
Mark Applied Mark Interviewed Mark Offered
Hide Job Report Job
AI can make mistakes so check important info. Chat history is never stored.
48
AI Success™

Job Description

We’re a team of 500+ professionals who develop cutting-edge proxy and web data scraping solutions for thousands of the world’s best known businesses, including Fortune 500 companies. 
What’s in store for you:You’ll be solving complex challenges and maintaining our own infrastructure with 60PB+ monthly data traffic. Here are its scale and maturity in numbers:
- 6PB+ Ceph storage - 60PB+ monthly data traffic through our systems - 300k+ service requests/sec processed - 500k+ Kafka messages/sec streamed
A word from the team:
We run one of the most advanced and largest scraping and parsing products in the world. We serve thousands of requests per second with a very high success rate. Our scrapers and parsers are used by leading e-commerce, market intelligence, and AI industry players making the work challenging and truly global. The team is a blend of different interesting personalities from different walks of life and nationalities. Here you can find people who are experts in gaming, playing guitar, riding bicycles, and other areas. We, as a team, will support you in learning how to build your own scrapers and will share all the tips, tricks and hacks we know to ensure that you are onboard in no time.

Your day-to-day:

  • Develop scalable scrapers.
  • Define resilient scraping strategies, unblock websites for scraping.
  • Improve observability in the system.
  • Develop back-end solutions for scraping & parsing problems of various magnitudes.
  • Maintain the current system and develop new features related to scraping & parsing.

Your skills & experience:

  • Experience working with Python.
  • Understanding of computer science, including data structures, algorithms, computability and complexity.
  • Version Control skills using Git.
  • Knowledge on how to unblock websites for scraping.
  • Is able to use different scraping techniques & open-source tools to build scrapers.
  • Is comfortable with using Dev Tools.
  • Network (TLS/SSL) knowledge.
  • Worked with browser automations.
  • Knows their way around asynchronous programming.

    • Nice to have
  • Web development knowledge.
  • Knows how to use CSS Selectors / XPaths for parsing.
  • Experience working with Go & C++.
  • Worked on browser source code.
  • Knowledge of any front-end framework.
  • Experience working with Pydantic, FastAPI, SQLAlchemy.
  • Has experience working with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana and monitoring tools like Grafana, Prometheus.
  • Experience with machine learning that is scraping domain-specific.
  • Has experience in building scalable systems.

Salary:

  • Gross salary: from 20 000 PLN/month. Keep in mind that we are open to discussing a different salary based on your skills and experience.
Up for the challenge? Let’s talk!
Oxylabs.io

About Oxylabs.io

🌐 Unlocking the Power of Web Intelligence with Oxylabs!

We're on a mission to empower businesses of all sizes with the priceless resource of publicly available data. In an era where data drives success, we're dedicated to ensuring that every company, big or small, can harness the potential of web scraping solutions and infrastructure.

💡 Why Choose Us?

Industry Leaders: As one of the market-leading companies, we offer cutting-edge web scraping solutions backed by the world's largest ethical proxy network.

Partnering for Success: we view our clients as partners, working hand in hand to maximize the benefits of our collaboration. Your success is our success.

🚀 Elevate Your Business with Our Services:

- Market Research: Gain insights that drive informed decisions.

- Ad Verification: Ensure real audiences see your ads.

- Brand Protection: Safeguard your online reputation.

- Travel Fare Aggregation: Optimize travel-related pricing.

- SEO Monitoring: Stay ahead in search engine rankings.

- Pricing Intelligence: Make data-driven pricing decisions and more.

💌 Get in Touch!

Curious about how Oxylabs can supercharge your business? We're here to help! Drop us a line at hello@oxylabs.io.

Industry
IT & Software
Company Size
201-500 employees
Headquarters
Vilnius, LT
Year Founded
2015
Website
oxylabs.io
Social Media