US Pharmacopeia

Senior Data Engineer

US Pharmacopeia  •  $113k - $147k/yr  •  Rockville, MD (Onsite)  •  8 days ago
Apply
AI can make mistakes so check important info. Chat history is never stored.
64
AI Success™

Job Description

Who is USP?

The U.S. Pharmacopeial Convention (USP) is an independent scientific organization that collaborates with the world’s leading health and science experts to develop rigorous quality standards for medicines, dietary supplements, and food ingredients. At USP, we believe that scientific excellence is driven by a commitment to fairness, integrity, and global collaboration. This belief is embedded in our core value of Passion for Quality and is demonstrated through the contributions of more than 1,300 professionals across twenty global locations, working to strengthen the supply of safe, high-quality medicines worldwide.

At USP, we value inclusive scientific collaboration and recognize that attracting diverse expertise strengthens our ability to develop trusted public health standards. We foster an organizational culture that supports equitable access to mentorship, professional development, and leadership opportunities. Our partnerships, standards, and research reflect our belief that ensuring broad participation in scientific leadership results in stronger, more impactful outcomes for global health.

USP is proud to be an equal employment opportunity employer (EEOE) and is committed to ensuring fair, merit-based selection processes that enable the best scientific minds—regardless of background—to contribute to advancing public health solutions worldwide. We provide reasonable accommodations to individuals with disabilities and uphold policies that create an inclusive and collaborative work environment.

Brief Job Overview

We are seeking a high-energy, hands-on Data Engineer to design, build, and maintain scalable, production-grade data pipelines across our AWS-based data platform. This role will own end-to-end pipeline delivery—from enterprise system ingestion to creating analytics-ready datasets—while working closely with Data Architects, Analytics teams, and business stakeholders. You will play a key role in ensuring high-quality, trusted data is accessible across the organization to support analytics and strategic decision-making. As part of our core data platform team, you will contribute to the continued evolution of our AWS Lakehouse architecture and help shape best practices.

How will YOU create impact here at USP?

As part of our mission to advance scientific rigor and public health standards, you will play a vital role in increasing global access to high-quality medicines through public standards and related programs. USP prioritizes scientific integrity, regulatory excellence, and evidence-based decision-making to ensure health systems worldwide can rely on strong, tested, and globally relevant quality standards.

Additionally, USP’s People and Culture division, in partnership with the Equity Office, invests in leadership and workforce development to equip all employees with the skills to create high-performing, inclusive teams. This includes training in equitable management practices and tools to promote engaged, collaborative, and results-driven work environments.

The Senior Data Engineer has the following responsibilities:

Data Pipeline Development: Design, develop, and maintain scalable ELT pipelines with reusable ingestion frameworks supporting batch and event-driven workflows across diverse sources including ERPs, APIs, vendor files, and relational databases.

AWS Cloud Data Engineering: Build and optimize AWS-native data pipelines implementing a Medallion Lakehouse architecture with a focus on performance and cost efficiency.

Infrastructure, CI/CD & DevOps: Provision and manage AWS infrastructure via Terraform, maintaining CI/CD pipelines with GitOps practices, automated testing, logging, alerting, and recovery mechanisms for production systems.

Data Modeling & Transformation: Design and implement dimensional models, Gold-layer datasets, and scalable vendor file ingestion patterns using SQL, Python, and PySpark, with robust handling of schema drift, audit tracking, and query optimization through partitioning, clustering, and materialization strategies.

Data Quality & Governance: Implement automated data validation, anomaly detection, and lineage tracking within pipelines while supporting metadata management.

Reporting & Power BI Support: Troubleshoot and resolve complex data issues while ensuring pipelines deliver data in formats optimized for Power BI, collaborating with Power BI developers to align data structures with reporting requirements and resolve dashboard-related data issues.

Collaboration & Continuous Improvement: Partner with Architects and Analytics teams to translate business needs into technical solutions, actively contributing to code reviews, architecture discussions, sprint planning, etc.

Who is USP Looking For?

The successful candidate will have a demonstrated understanding of our mission, commitment to excellence through inclusive and equitable behaviors and practices, ability to quickly build credibility with stakeholders, along with the following competencies and experience:

  • Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent combination of education and experience.
  • Minimum 7+ years of data engineering experience, with strong expertise in AWS services and hands-on work with big data and distributed data technologies in the AWS cloud environment.
  • Strong proficiency in Python and SQL with experience in PySpark/Spark.
  • Hands-on experience building and operating data pipelines on AWS (Glue, Step Functions, Lambda, S3, Athena, SNS, SQS, Redshift etc.).
  • Demonstrated experience with event-driven pipeline architectures.
  • Experience ingesting and processing vendor-supplied data files on a scale.
  • Practical experience implementing Medallion (Bronze/Silver/Gold) architecture in a data lake or Lakehouse environment.
  • Experience with Terraform for cloud infrastructure provisioning.
  • Experience with CI/CD tooling (e.g., Bitbucket, GitHub, AWS CodePipeline) for data pipeline deployments.
  • Strong grasp of data warehousing concepts (star schema, dimensional modeling, SCD).
  • Experience in integrating data with Microsoft Power BI or similar BI tools.
  • Experience with UNIX/Linux including basic commands and shell scripting.
  • Production experience with monitoring, troubleshooting, and on-call support for data pipelines.
  • Experience with Agile engineering practices.

Additional Desired Preferences

  • Hands-on integration experience with Oracle EBS as a data source.
  • Experience with data quality frameworks (e.g., Great Expectations, dbt tests).
  • Experience with AWS CDK or CloudFormation in addition to Terraform.
  • Knowledge of data catalog and data lineage tools (ex. Alation, Collibra).
  • AWS certifications (e.g., AWS Certified Data Engineer, AWS Certified Solutions Architect).

Supervisory Responsibilities

None, this is an individual contributor role.

Benefits

USP provides the benefits to protect yourself and your family today and tomorrow. From company-paid time off and comprehensive healthcare options to retirement savings, you can have peace of mind that your personal and financial well-being is protected.

Compensation

Base Salary Range: USD $112,700.00 – $146,900.00 annually.

Target Annual Bonus: % Varies based on level of role.Individual compensation packages are based on various factors unique to each candidate’s skill set, experience, qualifications, equity, and other job-related reasons.

Note: USP does not accept unsolicited resumes from 3rd party recruitment agencies and is not responsible for fees from recruiters or other agencies except under specific written agreement with USP.

US Pharmacopeia

About US Pharmacopeia

US Pharmacopeia (USP) is an independent, scientific nonprofit organization that has focused on building trust in the supply of safe, quality medicines since 1820. We are a public health organization that uses rigorous science and public quality standards setting to protect patient safety and improve global health.

We are committed to building public trust and confidence in drug therapies to enable people to live longer and healthier, and also work to building trust in dietary supplements and food ingredients. Currently, we are working to strengthen the global supply chain so that the medicines people rely on are available when needed and work as expected.

Our Volunteers

USP standards are in a continuous process of review and revision based upon new evidence, emerging public health concerns, and public requests for revision. Input from our volunteers, through our Council of Experts and Expert Committees and Panels, is crucial for maintaining our standards and preserving public trust.

Our Governing Bodies

The USP Convention helps guide our areas of impact – nearly 500 Member Organizations from around the world contribute valuable perspectives, experiences, and expertise from across healthcare and science. In addition to collaborating on critical healthcare and science matters, every five years, Convention Members adopt USP Resolutions and elect USP’s Board of Trustees and the Council of Experts who lead USP’s standards-setting Expert Committees.

Visit www.usp.org to learn more.

Industry
Chemicals & Materials
Company Size
1,001-5,000 employees
Headquarters
Rockville, Maryland
Year Founded
1820
Website
usp.org
Social Media