NIR-YU

Data Engineer – Web Scraping, LLM Pipelines and Scalable Data Infrastructure

NIR-YU  •  Mexico (Remote)  •  14 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

The Role:

You’ll help build the data foundation of our product: high‑volume web scraping systems, structured datasets and LLM‑driven processing pipelines. The role combines hands‑on engineering with architectural thinking and suits someone who enjoys turning messy web data into reliable, scalable outputs.

Key Responsibilities:

  • Build new structured datasets, including scraping accelerators, Form D filings and dynamic web sources.

  • Develop automated ETL pipelines that parse, clean and transform content using LLMs.

  • Define and maintain database schemas in Supabase or PostgreSQL.

  • Create evaluation frameworks to measure and compare LLM performance across pipeline components.

  • Contribute to the design of scalable data architectures using GCP services.

  • Improve reliability, observability and deployment workflows for scraping and data processing systems.

Requirements:

  • 4+ years of experience building data pipelines, backend services and automated data processing systems.

  • Strong background in web scraping with tools like Scrapy, Playwright or similar.

  • Experience deploying pipelines on cloud platforms such as GCP or AWS.

  • Solid knowledge of ETL frameworks, workflow orchestration (Airflow) and modern data stores (BigQuery, PostgreSQL).

  • Comfortable working with Docker and API frameworks like FastAPI.

  • Clear, fluent communication in English.

NIR-YU

About NIR-YU

🚨 73% of offshore teams fail within 12 months. We prevent EVERY failure pattern.

Even brilliant executives lose hundreds of thousands due to offshore disasters. It's not about experience—it's about the "Offshore Team Death Trap" 💀

📊 The Numbers Don't Lie:

- Industry Success Rate: 27%

- Our Success Rate: 95%

- Your Potential Savings: 60-70% cost reduction

🎯 Why We're Different:

- Failure Prevention First

- We focus on the 7 critical issues others miss

- Systematic prevention of common pitfalls

- Zero tolerance for predictable disasters

💎Complete Transparency

- Fixed fees, no hidden markups

- Full visibility into every process and cost

- No surprises, ever

🚑 Proven Rescue & Recovery

- We've saved countless failed offshore projects

- Full accountability from hiring to delivery

- Handle everything so you don't have to

🌟 What You Get:

- Dedicated LatAm professionals in YOUR time zone

- 60-70% cost savings without quality compromises

- Zero offshore disasters through proven prevention

- Fast hiring with quality talent

👥 Our Clients:

Smart startup founders and ambitious mid-market executives who refuse to become another offshore casualty.

🔥 The Bottom Line:

We deliver the savings other firms promise—without the disasters they create. Get the competitive edge of offshore teams without risking your company's future.

💬Ready to scale without the risk? Book a call with our CEO who has first-hand experience establishing remote and onsite teams across Mexico, India, US, and UK.

Book a Strategy Session: https://calendly.com/ld-nir-yu

📖 Featured: CEO Luis Derechin's book "The Offshore Team Deathtrap - Stop the Cycle of Failed Projects and Wasted Resources"

Industry
HR & Recruiting
Company Size
11-50 employees
Headquarters
Florida
Year Founded
2020
Social Media