AI Program and Operation Management (Evaluation) - Flow
Singapore Regular Operations Job ID: A158725
Responsibilities
About the Team Flow is ByteDance's AI-native innovation business team, focusing on developing products in emerging fields such as LLM. Our product portfolio includes Doubao (China) and Cici (Global). The Model Evaluation Team plays a key role within Flow, providing accurate and timely assessment signals for product iterations. We are responsible for the entire evaluation process, from designing methodology to executing evaluations, identifying issues, and proposing feasible improvement suggestions. Join us to explore innovative opportunities in AI, grow in a dynamic team environment, and create real value for users! Responsibilities - Evaluation Portfolio Management: Strategically oversee prioritization and scheduling of diverse AI/LLM evaluation projects. Ensure quality standards and timely delivery while optimizing resources across multiple concurrent evaluation projects - Pipeline Optimization: Monitor and enhance human expert evaluation pipelines. Identify bottlenecks, implement operational improvements, and establish robust metrics to track operational effectiveness while maintaining rigorous evaluation standards - High-complexity Project Execution: Lead execution of critical and complex evaluation projects with a hands-on approach. Apply deep evaluation know-hows and domain expertise to solve sophisticated challenges in LLM capability assessment - Team Leadership & Development: Guide and mentor evaluation specialists to enhance their capabilities and professional growth. Initiate team building initiatives that strengthen collaboration, evaluation quality and efficiency - Operational Excellence: Foster cross-functional partnerships while promoting advanced evaluation methodologies. Support team adoption of state-of-the-art approaches across specific domains to capture authentic user perspectives
Qualifications
Minimum Qualifications - Bachelor's degree or above in Business Administration, Project Management, Engineering, or related fields - 5+ years of experience in program/project management, operations, or strategy roles in technology companies - Strong program management capabilities with the ability to drive multiple projects simultaneously - Excellent stakeholder management and communication skills - Quick adaptation to new tools, methodologies and operational concepts Preferred Qualifications - Experience managing teams or leading critical cross-functional projects in fast-paced, dynamic environments - Proven track record in internal process optimization and efficiency improvement - Hands-on experience with AI/ML operation workflows - Genuine passion for AI/LLM technologies
Job Information
About UsFounded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.
Why Join ByteDance Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.
As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.
