Job Description
About the Team
The Security Engineering team is a research and development (R&D) team that operates within the broader Security Organization. Their core responsibility is to construct, implement, and sustain secure infrastructures, platforms, and technologies. In addition, they provide support to cross-functional teams within ByteDance. The team's ultimate objective is to serve and safeguard ByteDance products and infrastructures on a global scale.
Responsibilities:
- Build and refine AI security datasets: Design and develop comprehensive, in-depth, and challenging datasets for AI-for-Security across different security scenarios.
- Explore model consistency and performance prediction in security contexts: Conduct deep research on LLM performance during training on security tasks and assess the performance limits of models in security applications.
- Develop security data and evaluation standards from an interpretability perspective: Propose interpretability-based standards grounded in model mechanisms to assess transparency and reliability of LLMs in security decision-making and remediation.
- Red Teaming and model optimization: Perform Red Teaming from an evaluation perspective to systematically identify weaknesses of LLMs in security contexts and propose targeted optimization strategies.
- Build RAG evaluation systems: Design end-to-end evaluation metrics and benchmarks for security-specific RAG systems, create automated evaluation workflows, and develop interpretability and traceability tools for RAG systems.
The base salary range for this position in the selected city is $156000 - $387600 annually.