Lifted, an Upwork Company

#130529 - Software/Data Engineer - Spark, AWS EMR & AI

Lifted, an Upwork Company  •  Colombia, CO / Bogotá, CO (Remote)  •  6 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

We are seeking an experienced Software/Data Engineer to design and deliver scalable data processing systems and AI-enabled workflows. This contract role sits at the intersection of software engineering and data engineering, with a strong focus on Spark, cloud-based distributed processing, production reliability, and data preparation for analytics and machine learning use cases

Key Responsibilities

  • Design and develop scalable data processing solutions using Spark and Amazon EMR or comparable cloud-based data processing platforms.
  • Build and maintain batch and distributed data pipelines.
  • Develop software components for data transformation, feature preparation, and AI or machine learning workflow integration.
  • Collaborate with engineering, AI, and product teams to operationalize data-driven and model-enabled use cases.
  • Optimize data pipeline performance, cost efficiency, scalability, and production reliability.
  • Troubleshoot data and application issues across development and production environments.
  • Contribute to architecture discussions, technical documentation, and engineering standards.
  • Ensure solutions align with data quality, governance, and security expectations.

Qualifications

Must-Have Skills

  • 4+ years of software engineering or data engineering experience.
  • Strong experience with Spark and distributed data processing.
  • Experience with Amazon EMR or similar cloud-based data processing platforms.
  • Proficiency in Java, Python, or a related programming language.
  • Exposure to AI or machine learning workflows, model integration, or data preparation for intelligent systems.
  • Strong understanding of scalable data architecture and performance optimization.
  • Strong debugging and collaboration skills.
  • Comfortable delivering in evolving, data-intensive environments.
  • Ability to bridge software engineering and data engineering responsibilities.
  • Strong execution focus with practical architecture judgment.

Nice-to-Have Skills

  • Experience with Kafka, Airflow, data lakes, or data warehouse ecosystems.
  • Familiarity with MLOps, feature stores, or AI platform integration.
  • Experience with AWS-native services and observability tooling.
  • Enterprise experience strongly preferred.

Additional Information

Required Tools & Platforms

  • Apache Spark.
  • Amazon EMR or a comparable cloud-based distributed data processing platform.
  • Java, Python, or a related programming language.

Location, Time & Engagement

  • Remote contract role.
  • Candidates must be located in LATAM, excluding Mexico.
  • U.S. Central Time coverage is required.
  • Full-time allocation of approximately 40 hours per week.
  • Current contract end date is March 31, 2027.
Lifted, an Upwork Company

About Lifted, an Upwork Company

Lifted is the first talent, country and contract agnostic contingent workforce management solution, unifying the ability to source, contract, manage, and pay any type of contingent talent, anywhere in the world. Designed to embed into existing contingent workforce ecosystems, Lifted provides enterprises with global reach, embedded compliance, and a seamless experience across the entire contingent workforce.

Industry
IT & Software
Company Size
201-500 employees
Headquarters
Unknown
Year Founded
2025
Social Media