Birlasoft

Data Engineer-PySpark

Birlasoft  •  Bengaluru, IN (Onsite)  •  2 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.
61
AI Success™

Job Description

Area(s) of responsibility

About Birlasoft:
Birlasoft, a global leader at the forefront of Cloud, AI, and Digital technologies, seamlessly blends domain expertise with enterprise solutions. The company’s consultative and design-thinking approach empowers societies worldwide, enhancing the efficiency and productivity of businesses. As part of the multibillion-dollar diversified CKA Birla Group, Birlasoft with its 12,000+ professionals, is committed to continuing the Group’s 170-year heritage of building sustainable communities.

• About the Job – We are seeking a highly skilled and motivated PySpark professional to join our team. The successful candidate will be responsible for developing, maintaining, and testing big data solutions. They will be involved in the design of data processing using PySpark and other big data technologies. The role requires a deep understanding of data processing, data structure optimization, and machine learning algorithms. The PySpark professional will work closely with our data science team to enable quick and reliable data analysis and ensure the highest level of data quality..
1. Job Title – Data Engineer-Pyspark
2. Location: Bangalore/Hyderabad
3. Educational Background – Bachelor's degree in Computer Science, Information Technology, or related field.
Key Responsibilities –Develop, test, and maintain data pipelines using PySpark.
• Analyze large, complex data sets to meet functional and non-functional business requirements.
• Collaborate with data scientists and architects on several projects.
• Optimize data delivery and develop monitoring for performance and troubleshooting.
Required Skills
• Proficiency in PySpark and Python programming language.
• Strong understanding of Big Data Analytics and Hadoop.
• Experience with SQL databases and knowledge of query languages.
• A Bachelor's degree in Computer Science, Information Systems, or a related field, with a strong background in data processing and machine learning algorithms.
Preferred SkillsFamiliarity with machine learning algorithms. Experience with data visualization tools like Tableau or PowerBI.
• Knowledge of cloud platforms like AWS, Google Cloud, or Azure.
• Understanding of data warehousing and ETL techniques.
• Experience with other programming languages like Java or Scala.
• Familiarity with NoSQL databases like MongoDB or Cassandra.
• Knowledge of data structures and algorithms.
• Experience with other big data technologies like Hive, Pig, or HBase.
• Understanding of distributed systems.
• Familiarity with Agile/Scrum methodologies.

Required Experience: 3-5yrs
Skills Required – Pyspark

Birlasoft

About Birlasoft

Navigating Change. Powering Progress. | Reimagining the Future with Birlasoft

Birlasoft, a powerhouse where domain expertise, enterprise solutions, and digital technologies converge to redefine business processes. We take pride in our consultative and design thinking approach, driving societal progress by enabling our customers to run businesses with unmatched efficiency and innovation. As part of the CKA Birla Group, a multibillion-dollar enterprise, we boast a 12,000+ professional team committed to upholding the Group's 170-year legacy. Our core values prioritize Diversity, Equity, and Inclusion (DEI) initiatives, along with Corporate Social Responsibility (CSR) activities, demonstrating our dedication to building inclusive and sustainable communities. Join us in shaping a future where technology seamlessly aligns with purpose.

For further information, visit www.birlasoft.com

Industry
IT & Software
Company Size
10,000+ employees
Headquarters
Pune, IN
Year Founded
Unknown
Social Media