City of New York

Data Engineer

City of New York  •  New York City, NY (Onsite)  •  22 hours ago
Apply
AI can make mistakes so check important info. Chat history is never stored.
54
AI Success™

Job Description

** Please note that due to city requirements only applicants with a master’s degree and at least 3 years of related work experience will be considered. In addition, this position requires a US work authorization as no visa sponsorship is available. The position is eligible for 2 days per week remote work.

About TLC:
The New York City Taxi and Limousine Commission regulates for-hire transportation across NYC taxis, high volume platforms like Uber and Lyft, black cars, commuter vans, and more. We license roughly 180,000 drivers and 116,000 vehicles that conduct nearly a million trips a day. Our work on driver pay standards, accessibility, and traffic safety has become a model for regulators in cities around the world.

About the Role:
Our Data Analytics Unit, embedded in the Policy & Community Affairs Division, works at the intersection of data infrastructure and public policy. A lot of initial work starts with a policy question rather than a specification. The data (and analytics) engineering focus is on building and maintaining the infrastructure that makes good policy analysis possible everything from inspecting raw file submissions and initial ETL to designing pipelines and creating silver and gold tables to make analysis as streamlined as possible. Our goal is to make sure what we're producing is trustworthy: well-documented, reproducible, and reliable over time. We're a small team of analysts and engineers, so there is room for close collaboration.
The data itself is rich: billions of trip records, GPS breadcrumb traces for every for-hire vehicle in the city, detailed session data across all major platforms. The infrastructure we've built Databricks, Delta Lake, Azure allows us to process this quickly and consistently at scale so we can focus on policy impact and not be bottlenecked by compute.

What We're Looking For:
We're looking for someone with an infrastructure focus: someone who thinks about how data gets built and maintained, not just consumed. That means caring about schemas, naming conventions, reliability, and what makes data trustworthy for the people downstream, with familiarity processing large data streams.

Also important is analytical curiosity. You notice when numbers don't add up and you follow the thread. Data quality is interesting to you, and you understand what analysts and scientists are trying to do with the data you build well enough to push back or ask good questions when something doesn't make sense. You recognize that sometimes the best way to resolve data quality issues before writing a line of code may be to reach out to data providers and explain upstream issues.

Beyond that: you're comfortable with ambiguity and can take a vague request and make progress without waiting for a perfect spec. Your Python and SQL are clean and readable, and version control, modular code, and documentation are habits rather than afterthoughts. You understand that LLM’s are a powerful tool but avoid copy-pasting without understanding. We're a small team that works closely together, so you'll have real ownership of your work while also being able to think out loud with others. You should also be comfortable presenting to senior staff and external stakeholders.

To Apply:
Please go to cityjobs.nyc.gov and search for Job ID# 776089 or click the "Apply" button below.

Please include bother resume and cover letter.

SUBMISSION OF A RESUME IS NOT A GUARANTEE THAT YOU WILL RECEIVE AN INTERVIEW.

APPOINTMENTS ARE SUBJECT TO OVERSIGHT APPROVAL.

*Proposed salary will be determined based on experience and preferred skills of the selected candidate.”

Work Location:
New York, NY

CITY RESEARCH SCIENTIST - 21744

Qualifications

1. For Assignment Level I (only physical, biological and environmental sciences and public health) A master's degree from an accredited college or university with a specialization in an appropriate field of physical, biological or environmental science or in public health.
To be appointed to Assignment Level II and above, candidates must have:
1. A doctorate degree from an accredited college or university with specialization in an appropriate field of physical, biological, environmental or social science and one year of full-time experience in a responsible supervisory, administrative or research capacity in the appropriate field of specialization; or
2. A master's degree from an accredited college or university with specialization in an appropriate field of physical, biological, environmental or social science and three years of responsible full-time research experience in the appropriate field of specialization; or
3. Education and/or experience which is equivalent to "1" or "2" above. However, all candidates must have at least a master's degree in an appropriate field of specialization and at least two years of experience described in "2" above. Two years as a City Research Scientist Level I can be substituted for the experience required in "1" and "2" above.

NOTE:
Probationary Period
Appointments to this position are subject to a minimum probationary period of one year.

Additional Information

The City of New York is an inclusive equal opportunity employer committed to recruiting and retaining a diverse workforce and providing a work environment that is free from discrimination and harassment based upon any legally protected status or protected characteristic, including but not limited to an individual's sex, race, color, ethnicity, national origin, age, religion, disability, sexual orientation, veteran status, gender identity, or pregnancy.

City of New York

About City of New York

The City of New York is the most iconic and dynamic city on the planet. With a population of more than 8.4 million people, New York is not only the largest city in the United States — it is the academic, cultural, commercial, and financial capital of the world.

City government is filled with opportunities for talented individuals seeking to improve their communities and make a meaningful difference in the lives of their fellow New Yorkers. Every day, the City’s more than 300,000 employees improve infrastructure, provide vital social services, build technology, protect health and safety, and so much more. Join us today at: http://www1.nyc.gov/jobs

The City of New York offers its employees:

• A chance to build the future of this city. New York City government is at the crossroads of where policy, great ideas, city services, and smart urban planning meet the lives and needs of every day New Yorkers.

• Competitive salary and benefits. Hiring packages include a competitive salary, health benefits, various pension plans, employee assistance programs, and individual retirement accounts.

• Diverse career opportunities. As the largest local government in the United States with more than 40 agencies, the City of New York offers a broad spectrum of opportunities — from education, housing development, and public health to sustainability, economic growth, technology, and emergency management.

• Career Satisfaction. As a City employee, you will have the chance to shape the future of New York City and improve the quality of life for your family, neighbors, and fellow New Yorkers.

• Equal Opportunity and Inclusion. The City of New York is an equal opportunity employer that prohibits discriminatory action against City employees and applicants for employment based on their actual or perceived race, color, national origin, ethnicity alienage, citizenship status, gender, religion, creed and all other protected categories.

Industry
Government & Public Safety
Company Size
5,001-10,000 employees
Headquarters
New York, New York
Year Founded
1898
Website
nyc.gov
Social Media