Agent 评测工程师 北京 社招 全职 职位 ID:A188605 职位描述 1. 搭建Agent端到端评测体系,覆盖单轮问答质量、多轮对话一致性、工具调用准确率、任务完成率等维度。2. 构建和维护评测数据集(Golden Dataset),包括标准问答对、多步推理用例、边界Case、对抗样本等。3. 开发自动化评测Pipeline,集成到CI/CD流程,实现Agent版本发布前的自动回归测试。4. 设计Agent安全性评测方案,包括Prompt注入防御、信息泄露检测、权限越界测试。5. 对标Manus、Genspark等产品的Agent能力,定期进行竞品Benchmark对比评测。6. 输出评测报告,驱动算法和工程团队持续优化。 职位要求 1.本科及以上学历,2年以上AI/NLP评测或QA工程经验。2.熟悉Agent评测框架:RAGAS、DeepEval、TruLens、AgentBench、PromptFoo中至少两种。3.有评测数据集构建经验,熟悉数据标注流程与质量控制方法。4.熟悉LangSmith、LangFuse等LLM可观测性工具,能追踪Agent全链路执行日志。5.了解主流Agent Benchmark(SWE-Bench、WebArena、GAIA、ToolBench等)。6.精通Python,有自动化测试框架开发经验。7.了解红队测试(Red Teaming)、对抗性评测方法者加分。8.有Manus、Genspark、Perplexity等AI Agent产品深度使用与评测经验者优先。 投递...
小爱同学安全策略产品专家 北京 社招 全职 职位 ID:A46126 职位描述 1. 安全策略体系搭建:负责小米内部AIGC生成业务特别是小爱同学业务的安全策略产品规划,建立覆盖输入-生成-输出全链路的安全防控体系,持续迭代审核标准与策略规则。2. 基座模型安全治理:参与基座大模型安全评估与对齐工作,包括安全评测体系设计、Red Teaming、安全边界定义,推动模型安全能力提升。3. 安全价值观对齐:主导安全价值观对齐工作,制定安全偏好标准,协同算法团队完成RLHF/DPO对齐训练的数据标注规范与效果评估。4. 安全模型自研落地:主导安全侧自研模型的策略规划与产品化落地,包括内容安全分类、Prompt注入防御、幻觉检测等模型,推动从0到1建设。5. 多模态与Agent安全:覆盖文本/图像/视频/音频全模态安全策略,制定AI Agent行为边界策略与Tool调用安全规范,防范新型安全风险。6. 安全风险运营闭环:搭建风险发现→研判→刻画→标准执行完整运营机制,基于数据驱动与badcase分析持续迭代策略。7. 跨团队协同与合规:与算法、工程、法务、合规等团队协作推动策略落地,跟踪国内外AIGC安全法规与前沿动态,确保业务合规。 职位要求 1. 学历:本科及以上,计算机科学、信息安全、人工智能等相关专业优先。2. 经验:5年以上内容安全/AI安全/策略产品相关经验,有大模型或AIGC安全领域经验者,特别是车载/IoT端侧大模型、跨境多语言内容安全合规经验、安全大模型(Llama Guard、ShieldGemma等)评测或适配经验优先。3. 基模安全能力:熟悉LLM安全风险体系(有害内容、Prompt注入、越狱、数据泄露、幻觉等),有基座模型安全评测与Safety Alignment实际经验。4. 安全策略能力:具备内容审核策略制定与迭代经验,能基于数据分析驱动优化;熟悉安全分类/标签体系设计,有多语言/多模态场景经验者优先。5. 安全模型与对齐能力:有自研安全模型的策略设计经验,理解ML/DL基本原理;了解RLHF/DPO等对齐方法论,有安全数据飞轮建设经验者优先。6. 新兴安全能力:了解AI Agent安全风险(Tool调用、多Agent协作、行为边界等);熟悉多模态生成安全(文生图/视频安全边界、多模态幻觉检测等)。7. 综合素质:逻辑分析与数据驱动思维强,善于从复杂问题中抽象可落地方案;跨团队沟通协调能力好,英语读写良好。 投递...
As the Associate Principal Scientist - Sensory, you are part of the Global Science & Innovation Team and play a key role in partnering with Technical Service team in APAC, Global applications & Ingredient Science with
Objetivo del puesto En Navalmoral, Cáceres, estamos buscando incorporar a un/a Mecánico/a Montador para First Stop quien realizará trabajos de montaje de neumáticos, mantenimiento, control de desgaste, diagnósis, mecánica rápida y avanzada. First Stop y Elma
Objetivo del puesto En Navalmoral, Cáceres, estamos buscando incorporar a un/a Mecánico/a / Montador para First Stop quien realizará trabajos de montaje de neumáticos, mantenimiento, control de desgaste, diagnósis, mecánica rápida y avanzada. First Stop y
Values & Innovation At Under Armour, we are committed to empowering those who strive for more, and the companys values - Act Sustainably, Celebrate the Wins, Fight on Together, Love Athletes and Stand for Equality -
Job Req Number: 120283 Time Type: Full Time General Responsibilities 主要工作职责 Identify and develop new business opportunities to achieve sales growth. 识别和开发新的商业机会以实现销售业绩增长。 Maintain and strengthen relationships with assigned existing accounts to ensure customer retention and business
Job Req Number: 120292 Time Type: Full Time General Responsibilities 主要工作职责 1. Identify and develop new business opportunities to achieve sales growth. 识别和开发新的商业机会以实现销售业绩增长。 2. Maintain and strengthen relationships with assigned existing accounts to ensure customer retention
Career Area:Engineering Job Description: Your Work Shapes the World at Caterpillar Inc. When you join Caterpillar, youre joining a global team who cares not just about the work we do – but also about each other.
API PSD Operations Support This role has been designed as ‘Hybrid’ with an expectation that you will work on average 2 days per week from an HPE office. Who We Are: Hewlett Packard Enterprise is the
Job Description Job Description Must have Skills : Microservices architecture (MSA) (Strong), Java (Expert), Project Management methodologies (Capable),Chinese Speaking Job Description: Technical Project Manager (Dual Role: PM & Pre-Sales, Hotel Industry Focus) Location Shanghai (preferred) Job
At Johnson & Johnson,we believe health is everything. Our strength in healthcare innovation empowers us to build aworld where complex diseases are prevented, treated, and cured,where treatments are smarter and less invasive, andsolutions are personal.Through our
Job Description Summary: Manager: Senior Director, Franchise Operations, SD/SX/SaX/West Location: Xi’an, Shaanxi, China Role Type: Individual Contributor Language: Fluent English & Mandarin Please note: This role is not a fully remote position. The selected candidate will
Location:CN-Shenzhen-HyQ Shift:Standard - 40 Hours (China) Scheduled Weekly Hours:40 Worker Type:Permanent Job Summary:The Officer – Application Security supports secure software development practices for HKEX systems serving London Metal Exchange (LME). This role is ideal for a
Location:CN-Shenzhen-HyQ Shift:Standard - 40 Hours (China) Scheduled Weekly Hours:40 Worker Type:Permanent Job Summary:The purpose of this role is to help build and run the LME’s new application hosting platform driving the adoption of Kubernetes based technologies
At YETI, we believe that time spent outdoors matters more than ever and our gear can make that time extraordinary. When you work here, you’ll have the opportunity to create exceptional, meaningful work and problem solve
Job Description Summary: Manager: Director, Franchise Operations, BJ/TJ/HB Location: Tianjin, China Role Type: Individual Contributor Language: Fluent English & Mandarin Relocation Provided: Limited relocation available (domestic location), we encourage all GCM employees to apply to internal
•Content Strategy & Planning: Develop the brand’s overall content strategy in China, planning cross-platform content matrices (off-platform: Xiaohongshu, Douyin; in-platform: Taobo) and communication calendars. •Core Content Creation & Empowerment: Lead core creative concepts and content ideation
Location:CN-Shenzhen-HyQ Shift:Standard - 40 Hours (China) Scheduled Weekly Hours:40 Worker Type:Permanent Job Summary:Role Purpose The Security Development Engineer (Associate)– plays a hands on role in developing security solutions securing infrastructure and platforms supporting London Metal Exchange
“The world is yours with Meliá” Continuing you journey at Meliá is an opportunity to learn, grow and keep building your career within a global team. Here you can take on new challenges and access experiences