AI Evaluation Project Intern（Corporate Service System）- 2027 Start
Software Engineering, Data Science
International Falls, MN, USA
Responsibilities
We are the AI Vertical Scenarios Team within ByteDance's Corporate Service System, based in Dubai. Our mission is to set the standard for AI native applications across ByteDance's internal workplace and procurement scenarios, and to drive consistent AI experiences for employees globally. We build flagship AI applications in-house and use a full scope evaluation suite as our measurement foundation to track how well leading models perform on the real, day to day tasks ByteDance employees carry out. Why join us - Real scenarios, real users: the evaluations you design and the AI applications you contribute to are grounded in the actual workflows of ByteDance employees worldwide. - Hands on with frontier AI: work directly with Claude, Doubao Seed 2.1, and internal agent infrastructure and agent-building tools. - Broad scope: opportunities to prototype AI solutions to manual workflows, and to contribute to strategic AI projects that shape how ByteDance employees experience corporate services globally. As a Project Intern, you will contribute to impactful short-term projects and gain hands-on experience in a fast-paced, professional environment. This internship offers the opportunity to develop practical skills, apply your knowledge to real-world challenges, and explore your career interests. Applications are reviewed on a rolling basis, so we encourage you to apply early. Online Assessment Candidates who pass resume screening will be invited to participate in Our Company's technical online assessment. Responsibilities: Core evaluation work Own a defined scope of ByteDance's AI evaluation benchmark end to end, with ownership to identify problems and propose solutions. You'll run the full research and evaluation loop on some of the world's most widely used AI Agents, surfacing capability gaps and failure modes, and turning those findings into actionable insights that directly drive the Agent's iteration at global scale. This includes: 1. Ground the work in real user needs through user interviews, literature review, and usage data analysis. 2. Propose research methodology: how queries are generated, how rubrics are structured, and how models are scored. 3. Write curated queries with prerequisites, across three difficulty levels: Simple, Medium, and Complex. 4. Write rubrics: checklist items defining a correct answer (e.g., for a leave request: leave type, date parsing, balance check, approver routing, form completeness, submission state). 5. Run models against the queries and score outputs on an ongoing cadence, reviewing multiple agents and models against the benchmark each month. 6. Automate the evaluation so the loop can be re-run as models and internal systems evolve. 7. Write the evaluation report covering findings, failure patterns, and recommendations. Additional project work Beyond the core evaluation work, interns will have full agency to support and lead ad hoc projects that shape how AI gets implemented and adopted across ByteDance globally, including: - Identifying manual workflows across the business and prototyping AI solutions to automate them. - Contributing to AI product work by shaping agent capabilities, and helping ship new AI features into internal workplace and knowledge tools.
Qualifications
Minimum Qualifications - Currently pursuing a Undergraduate in Computer Science, AI, Information Management or a related technical discipline. Strong hands on AI experience from non CS backgrounds is equally welcome. - Available to start the internship immediately, ideally within one week. - Clear logical thinking, self driven, and user value oriented, with strong communication and cross team collaboration skills. - Genuine interest in AI products and a habit of following the latest developments in the LLM and agent space. - Able to work on site in Dubai full time, or a minimum of 3 days per week. Preferred Qualifications - Relevant internship or project experience in AI products or AI evaluations. - Prior experience designing or running LLM evaluations. - Prior work translating user problems into AI applications, particularly in office automation, knowledge management, or adjacent productivity domains. By submitting an application for this role, you accept and agree to our global applicant privacy policy, which may be accessed here: https://jobs.bytedance.com/en/legal/privacy
Job Information
About Us
Founded in 2012, ByteDance's mission is to inspire creativity and enrich life. With a suite of more than a dozen products, including TikTok, Lemon8, CapCut and Pico as well as platforms specific to the China market, including Toutiao, Douyin, and Xigua, ByteDance has made it easier and more fun for people to connect with, consume, and create content.
Why Join ByteDance
Inspiring creativity is at the core of ByteDance's mission. Our innovative products are built to help people authentically express themselves, discover and connect – and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and enrich life - a mission we work towards every day.
As ByteDancers, we strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our Company, and our users. When we create and grow together, the possibilities are limitless. Join us.
Diversity & Inclusion
ByteDance is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At ByteDance, our mission is to inspire creativity and enrich life. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.