Oracle

PIPELINE - Senior Principal Consultant (Dados + PySpark + Airflow)

Oracle  •  São Paulo, BR (Onsite)  •  3 months ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Engenheiro(a) de Dados (PySpark & Airflow)

Estamos em busca de um(a) Engenheiro(a) de Dados experiente, com sólida expertise em PySpark e Apache Airflow, para atuar em um projeto estratégico baseado em Oracle Cloud Infrastructure (OCI).

Principais Responsabilidades:

  • Projetar, desenvolver e manter pipelines de dados escaláveis utilizando PySpark em ambientes OCI.
  • Construir, orquestrar e monitorar workflows utilizando Apache Airflow.
  • Integrar múltiplas fontes de dados ao ecossistema OCI (Object Storage, ADW, Streaming, OKE, Compute).
  • Converter e migrar processos existentes de ingestão, transformação e entrega de dados para OCI, visando consumo analítico.
  • Otimizar jobs em Spark e processos de ETL/ELT para garantir performance e confiabilidade, conforme necessário.
  • Monitorar execuções de pipelines, identificar e resolver falhas, garantindo estabilidade operacional.
  • Aplicar boas práticas de DataOps, incluindo automação, observabilidade e controle de versão.
  • Colaborar de forma eficaz em um ambiente diverso com especialistas onshore, arquitetos, analistas e gerentes de projeto (em inglês).

Requisitos Técnicos:

  • Experiência prática com PySpark para processamento de dados em larga escala.
  • Experiência comprovada com Apache Airflow (desenvolvimento de DAGs, uso de operadores, agendamento, monitoramento e troubleshooting).
  • Sólidos conhecimentos em SQL
  • Forte orientação a boas práticas de código e uso de Git
  • Experiência com Databricks, Cloudera, AWS Athena e Google BigQuery
  • Experiência com serviços da Oracle Cloud Infrastructure (OCI), tais como:
    • Object Storage e familiaridade com o uso do ocicli para recursos de armazenamento na OCI
    • Data Flow / Oracle Big Data Service
    • Oracle Database 19c ou Autonomous Database (ADW, ATP ou similares)
    • Familiaridade com OCI Streaming
  • Experiência com formatos de dados como Parquet, ORC, Avro e JSON

Career Level - IC3

Only Oracle brings together the data, infrastructure, applications, and expertise to power everything from industry innovations to life-saving care. And with AI embedded across our products and services, we help customers turn that promise into a better future for all. Discover your potential at a company leading the way in AI and cloud solutions that impact billions of lives.

True innovation starts when everyone is empowered to contribute. That’s why we’re committed to growing a workforce that promotes opportunities for all with competitive benefits that support our people with flexible medical, life insurance, and retirement options. We also encourage employees to give back to their communities through our volunteer programs.

We’re committed to including people with disabilities at all stages of the employment process. If you require accessibility assistance or accommodation for a disability at any point, let us know by emailing accommodation-request_mb@oracle.com or by calling 1-888-404-2494 in the United States.

Oracle is an Equal Employment Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability and protected veterans’ status, or any other characteristic protected by law. Oracle will consider for employment qualified applicants with arrest and conviction records pursuant to applicable law.

Oracle

About Oracle

We’re a cloud technology company that provides organizations around the world with computing infrastructure and software to help them innovate, unlock efficiencies and become more effective. We also created the world’s first – and only – autonomous database to help organize and secure our customers’ data.

Oracle Cloud Infrastructure offers higher performance, security, and cost savings. It is designed so businesses can move workloads easily from on-premises systems to the cloud, and between cloud and on-premises and other clouds. Oracle Cloud applications provide business leaders with modern applications that help them innovate, attain sustainable growth, and become more resilient.

The work we do is not only transforming the world of business--it's helping defend governments, and advance scientific and medical research. From nonprofits to companies of all sizes, millions of people use our tools to streamline supply chains, make HR more human, quickly pivot to a new financial plan, and connect data and people around the world.

At work, we embrace diversity, encourage personal and professional growth, and celebrate a global team of passionate people developing innovative technologies that help people and companies tackle real-world problems head-on.

If you’d like to join us, please visit our Careers page: https://www.oracle.com/corporate/careers/

For investor news, SEC filings, and financial information about Oracle (NYSE:ORCL), please visit https://investor.oracle.com/home/.

Follow us on X: x.com/oracle

Like our page on Facebook: facebook.com/Oracle/

Follow us on Instagram: instagram.com/oracle/

Industry
IT & Software
Company Size
10,000+ employees
Headquarters
Austin, Texas
Year Founded
Unknown
Social Media