The Senior Data Engineer designs, builds and optimizes data pipelines for key data and analytics capabilities in the enterprise. This position works in collaboration with analytics and data warehousing staff, DBAs and subject matter experts to create reliable processes that load targeted data with integrity and quality, enabling it for strategic use by the business.
Collaborate within an agile, multi-disciplinary team to deliver optimal data integration and transformation solutions
Analyze data requirements (functional and non-functional) to develop and design robust, scalable automated, fault-tolerant data pipeline solutions for business and technology initiatives
Profile data to assess the accuracy and completeness of data sources and provide feedback in data gathering sessions
Design, build, maintain, and operationalize data pipelines for high volume and complex data using appropriate tools and practices in development, test, and production environments. Design with modularity to leverage reuse of code wherever possible
Develop and design data mappings, programs, routines, and SQL to acquire data from legacy, web, cloud, and purchased package environments into the analytics environment
Understand and apply the appropriate use of ELT, ETL, data virtualization, and other methods to optimize the balance of minimal data movement against performance, and mentor others on their appropriate use
Drive automation of data pipeline preparation and integration tasks to minimize manual and error-prone processes and improve productivity using modern data preparation, integration, and AI-enabled metadata management tools and techniques
Leverage auditing facilities that will enable monitoring of data quality to detect emerging issues. Deploy transformation rules to cleanse against defined rules and standards
Participate in architecture, governance, and design reviews, identifying opportunities and making recommendations
Participate in health check assessments of the existing environment and evaluations of emerging technologies
Collaborate with architects to design and model application data structures, storage, and integration in accordance with enterprise-wide architecture standards across legacy, web, cloud, and purchased package environments
Job Specifications
Typically has the following skills or abilities:
Bachelor’s degree in computer science, data science, statistics, economics, or related functional area; or equivalent experience
Excellent written and verbal communication skills with the ability to gather requirements and effectively communicate technical concepts and ideas to all levels of employees and management
6+ years’ experience working in development team providing analytical capabilities
6+ years of hands-on experience in the data space spanning data preparation, SQL, integration tools, ETL/ELT/data pipeline design
SQL coding experience
Experience working in an agile development environment (Scrum, Kanban) with a focus on Continuous Integration and Delivery
Knowledge about various data architectures, patterns, and capabilities such as event-driven architecture, real-time data flows, non-relational repositories, data virtualization, cloud storage, etc.
Knowledge of and experience with multiple data integration platforms (IBM InfoSphere DataStage, Oracle Data Integrator, Informatica PowerCenter, MS SSIS, AWS Glue, Denodo), and data warehouse MPP platforms such Snowflake, Netezza, Teradata, Redshift, etc.
Familiarity with DataOps practices and their application within analytics environments as well as their ability to extend data and analytics capabilities to other operational systems and consumers
Familiarity with event store and stream processing (Apache Kafka and platforms like Confluent) and with API development and management platforms (MuleSoft, Axway) is beneficial
Capable of focusing on a specific set of tasks while also ensuring alignment to a broader strategic design
Preferred Skills
Snowflake Certification/Strong hands-on experience with Snowflake (data modeling, performance tuning, security, and optimization)
Experience with DataStage (ETL development and maintenance)
Good understanding and practical experience in Data Vault modeling (Raw Vault, Business Vault, Information Marts)
Experience with workflow orchestration tools such as Apache Airflow
Proficiency with GitHub (version control, branching strategies, code reviews, CI/CD integration)
Experience building and maintaining ETL/ELT pipelines
Strong SQL and data transformation skills
Familiarity with cloud platforms (AWS/Azure/GCP)
Understanding of data warehousing concepts, performance tuning, and best practices
Ability to provide technical leadership, mentor junior engineers, and support production issue resolution
Ability to participate in Agile ceremonies and contribute to continuous improvement initiatives
Ability to work in Agile/Scrum environments
#LI-VISIONCARE
Compensation range for the role is listed below. Applicable salary ranges may differ across markets.Actual pay will be determined based on experience and other job-related factors permitted by law. As a part of the compensation package, this role may include eligible bonuses and commissions. For more information regarding VSP Vision benefits, please click here
Salary Ranges: $78,750.00 - $133,875.00
VSP Vision is an equal opportunity employer and gives consideration for employment to qualified applicants without regard to age, gender, race, color, religion, sex, national origin, disability or protected veteran statusWe maintain a drug-free workplace and perform pre-employment substance abuse testing.
Unincorporated LA County Residents: Qualified Applicants with arrest or conviction records will be considered for employment in accordance with the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act, and any other similar laws.
Notice to Candidates: Fraud Alert - Fake Job Opportunity Solicitations Used to Collect Fees/Personal Information.
We have been made aware that fake job opportunities are being offered by individuals posing as VSP Vision and affiliate recruiters. Click here to learn about our application process and what to watch for regarding false job opportunities.
As a regular part of doing business, VSP Vision (“VSP”) collects many different types of personal information, including protected health information, about our audiences, including members, doctors, clients, brokers, business partners, and employees. VSP Vision employees will have access to this sensitive personal information and are subject to follow Information Security and Privacy Policies.
At VSP Vision, we activate the full power of care by consciously reinvesting in greater vision, health, and opportunities for all. Our mission is to help people see every possibility—and we do that through our strategic business pillars that work together to connect nearly 90 million patients to network doctors in a variety of settings across the globe. When you become a VSPeep, you join a group of thinkers, doers, adventurers, risk-takers, and boundary pushers who think outside the peripheral to develop products, programs, and services that help create a world where everyone can bring their best vision to life.
The VSP Values are: We care, We trust, We empower diversity, and We are one team. Join the power of our purpose and check out job opportunities with VSP and its strategic businesses, including: VSP Vision Care, Marchon Eyewear, Altair Eyewear, VSP Optics, Eyefinity EHR, VSP Retail, VSP Ventures, and Eyes of Hope (our charitable giving platform).
