Central Business Solutions Inc.

Principal Data Engineer – (Hadoop/Big Data, AWS, Python, Kinesis) - Irvine, CA - Onsite - Contract to Hire - AS

Central Business Solutions Inc.  •  Irvine, CA (Onsite)  •  4 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.

Job Description

Position: Senior Data Engineer – (Hadoop/Big Data, AWS, Python, Kinesis)

Location: Irvine, CA - Onsite role

Position Type: Contract to Hire

Responsibilities


You will be responsible for all aspects of data acquisition, data transformation, analytics scheduling and operationalization to drive high-visibility, cross-division outcomes. Investigate, evaluate, test and recommend technical solutions for future systems.

They will support software developers, database architects, data scientists on data initiatives and will contribute optimal data delivery architecture.

What you will be doing:

Data Operations


Lead the creation of data environments and/or data sets to serve a wide range of data users, including but not limited to Data Scientists, Data Analysts, Business Analysts etc.

Perform offline analysis of large data sets using components of a big data software ecosystem.

Validate the solution of root cause analysis escalated by various technical staff in multiple organizations and with differing levels of expertise.

Investigate, evaluate, test and recommend technical solutions for future systems.

Data Management

Own product data sets from the definition phase through to production deployment (end-to-end).

Provide solutions for the design and implementation of Hadoop EMR Cluster/ Big Data Infrastructure.

Deploy Hadoop/Big Data/Spark and database storage Infrastructures in AWS cloud.

Monitor HDFS/Hadoop/Spark and related software releases, third-party utilities with emphasis on overall system performance.

Lead and develop tools and procedures to monitor and automate system tasks on servers and clusters

Lead and collaborate with other teams to design, develop, and deploy data tools that support both operations and product use cases.

Data Design

Lead and design distributed, scalable, and reliable data pipelines that ingest and process data at scale and in real-time.

Lead and design big data technologies and prototype solutions to improve data processing architecture.

Qualifications

What we are looking for:

Bachelor’s degree in computer science, computer engineering, or a related technical field.

12+ years of professional experience as a data software engineer; or 16+ years of related experience as a data software engineer in lieu of 4-year degree.

2+ years of experience with AWS cloud or other cloud Big Data computing design, provisioning, and tuning.

Related AWS certification, preferred.

Previous experience as a Data Engineer / Database Administrator and/or Business Intelligence Analyst.

Expertise in database concepts, object and data modeling techniques and design principles.

Expertise in database architectures, software, and facilities

Expertise with programming languages - Python (required), Scala, Ruby, R Database technologies - SQL, performance tuning concepts, AWS RDS, RedShift, MySQL

Expertise with big data batch processing tools: Hadoop MapReduce, ElasticSearch, PIG, Hive, Cascading/Scalding, Apache Spark, AWS EMR

Expertise with stream-processing systems: Kinesis, Kafka, MQTT

Expertise with relational NoSQL databases including DyanamoDB

Expertise in writing JSON, XML, YAML and other data definition schemas

Excellent verbal and written communication skills necessary to effectively collaborate in a team environment and present and explain technical information and provide advice to management.

Ability to work on advanced complex technical projects or business issues requiring state of the art technical knowledge or industry.

Ability to work on significant and unique issues where analysis of situations or data requires an evaluation of intangibles.

Exercises independent judgment in methods, techniques and evaluation criteria for obtaining results.

Ability to lead and mentor junior engineers and colleagues.
Central Business Solutions Inc.

About Central Business Solutions Inc.

Central Business Solutions Inc (CBS), founded in 2000 and headquartered in Newark, California, has carved a niche for itself in the global business solutions market. Our experience spans across various industries, serving both small businesses and Fortune 500 companies. Here's a breakdown of our core offerings:

Technology Solutions: CBS acts as your IT department's backbone, offering a comprehensive suite of services. We provide expert guidance on crafting a technology strategy that aligns with your business goals. This includes consulting on system architecture and implementation, ensuring your infrastructure is built for efficiency and scalability. Our expertise extends to software development, crafting custom solutions or integrating existing ones to streamline operations. But CBS doesn't stop at setup; we also provide ongoing maintenance and support to keep your technology running smoothly.

Outsourcing: Whether you need to supplement your existing IT staff or completely outsource your IT department, CBS offers flexible solutions. We can provide qualified personnel to handle specific tasks like software development, UI/graphic design, or recruitment. Alternatively, we can take over the entire IT management responsibility, freeing your internal team to focus on core business functions.

Consulting: Our expertise extends beyond technology. CBS offers consulting services to help you achieve your overall business goals. Our team of experienced professionals can analyze your operations and identify areas for improvement. We'll develop data-driven strategies to streamline processes, enhance efficiency, and ultimately deliver bottom-line results.

In essence, Central Business Solutions Inc goes beyond just being a vendor. We position ourselves as a strategic partner for businesses. By combining our IT prowess with business acumen, we help clients optimize technology infrastructure, streamline operations, and achieve sustainable success.

Industry
IT & Software
Company Size
51-200 employees
Headquarters
Newark, CA
Year Founded
2000
Social Media