Photon

Lead Data Engineer - Data Archival - Bangalore

Photon  •  Republic of India (Onsite)  •  2 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Missions
  • Our team Data-as-a-service is expanding, and we need 3 big data experts to join us!

    Today we manage SG Data platform service offers and data tools:

    · Data ingestion: to ingest the data from a data source

    · Data processing: to process, transform and distribute the data to the target location

    · Data exposition : to distribute and expose the data hosted in the data platform

    · Data cleaning: to purge the data on the Lake in a secure way

    · Data tools: data formatter, data anonymizer

    As a big data engineer, you’ll develop, maintain and create new cloud-oriented features hand-by-hand with DDS/Data Foundation teams to bring forward the data approach across all SG entities and subsidiaries.

Profile
  • Experience: 3-5 Years
  • Skills:

    - Computer programming: Spark, Scala, Java, Python

    - Operating system knowledge for Unix, Linux

    - Databases and SQL

    - ETL and data warehousing

    - Hadoop

    - Apach Spark

    Tasks:

    · Maintain an excellent service level of the platform and avoid issues.

    · Researching new methods of obtaining valuable data and improving its quality

    · Creating and enhancing data solutions using various programming languages and tools

    · Creating and enhancing data architectures that meet the requirements of the business

    · Communicate inside if the tech league group to find new approaches

Photon

About Photon

Photon, a global leader in AI and digital solutions, helps clients accelerate AI adoption and embrace DigitalHyper-expansion® to ‘make tomorrow happen today’. We work with 40% of the Fortune 100, enabling them to stay agile and future-ready in an era of converging digital and AI boundaries. Powering billions of touchpoints a day, Photon combines AI management, digital innovation, product design thinking, and engineering excellence to drive lasting transformation for F500 clients. We employ several thousand people across dozens of countries. Learn more at www.photon.com

Industry
IT & Software
Company Size
5,001-10,000 employees
Headquarters
London, GB
Year Founded
2007
Social Media