LLM Training Operation Math & Reasoning Analyst Seed Global Data Global Operations User ops[...]

Job description

Responsibilities
Project Management:
Lead and manage multiple math-focused LLM training projects, ensuring timelines, quality standards, and objectives are met.

Track project progress, identify risks, and implement corrective actions as necessary to keep projects on course.

Build and maintain strong relationships with product managers, researchers, data annotators, and other cross-functional team members.

Communicate project updates, address concerns, and align expectations to ensure successful project outcomes.

Coordinate meetings and discussions with global teams to ensure seamless project execution and work with external vendors and trainers per project demands.


Workflow Design and Management:
Design, manage, and optimize workflows for math-focused LLM training projects, including training design, QA processes, and performance tracking to meet project needs.

Collaborate closely with product managers, project leaders and cross-functional teams to ensure alignment on quality metrics and project expectations.


Operational Improvement:
Conduct quality and productivity improvement experiments to enhance operational processes for math-related training data.

Lead and support general annotation operation improvement initiatives across various data domains.

Develop and maintain technical guidelines and casebooks to support consistent, high-quality data production.


Data Checking and Analysis:
Design and implement robust data analysis strategies to evaluate training and evaluation datasets for LLM projects in the math domain.

Ensure the mathematical accuracy and statistical validity of all project data.

Design and implement robust data checking protocols, perform deep-dive analysis to identify trends and anomalies, and translate quantitative findings into actionable insights for model improvement.

Collaborate with data annotators, researchers, and product managers to define quality benchmarks and ensure data-driven decision-making throughout the project lifecycle.


Team Leadership and Collaboration:
Provide mentorship and guidance to team members, helping to develop their skills and ensuring the delivery of high-quality outputs.

Foster a collaborative environment where team members can share knowledge and best practices to improve overall performance.


Qualifications
Minimum Qualifications:
Hold a Bachelor’s degree or higher, ideally in Mathematics, Statistics, or a related quantitative discipline.

Strong professional communication skills in Chinese mandarin, to engage effectively with internal and external stakeholders based in Mandarin-speaking markets.

Strong project management skills, with the ability to design, manage and optimize complex workflows.

Possess robust communication and problem-solving skills, capable of clearly explaining and interpreting mathematical concepts.

Exhibit sound independent judgment while thriving in collaborative, deadline-driven project settings.

Show genuine enthusiasm for large language models (LLMs) and computational thinking, with the adaptability to excel in a dynamic, fast-paced work environment.

Demonstrate exceptional English proficiency, with advanced writing and analytical evaluation abilities.


Preferred Qualifications:
Experience in competitive mathematics such as Mathematical Olympiad at regional or international level.

Professional working proficiency in Mandarin Chinese (both written and spoken) for seamless collaboration with Chinese-speaking teams.

Experience in RLHF annotation and working with leading AI/LLM companies on technical projects.

Passionate about LLM technologies, human behavior and user experience with a keen interest in analyzing diverse case studies.

Self-motivated, intellectually curious professionals who thrive in mentoring junior team members while maintaining rigorous analytical standards.


Job Information
About Us : Founded in 2012, ByteDance's mission is to inspire creativity and enrich life.

With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.


Why Join ByteDance : Inspiring creativity is at the core of ByteDance's mission.

Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible.

Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.


As ByteDancers, we strive to do great things with great people.

We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company.

By constantly iterating and fostering an Always Day 1 mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users.

When we create and grow together, the possibilities are limitless.

Join us.


Diversity & Inclusion : ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives.

Our platform connects people from across the globe and so does our workplace.

At ByteDance, our mission is to inspire creativity and enrich life.

To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach.

We are passionate about this and hope you are too.


#J-18808-Ljbffr

Required Skill Profession

Other General