ai evaluation engineer

About This Opportunity We are currently building a talent pool of experienced AI Evaluation Engineers for an upcoming client project focused on AI model assessment, benchmarking, and quality assurance. This is a freelance, project-based engagement, with project scope, duration, workload, and onboarding timelines currently being finalized. We welcome...

Mercor is seeking experienced music producers and audio engineers to evaluate generative music AI models in Jakarta. You will assess AI-generated tracks across genres, rate them against quality standards, and work in Indonesian and English.Requirements include native or near-native Indonesian, ability to follow English instructions, and 2+ years as a music...

Crossing Hurdles is seeking an evaluator to design and implement self-contained AI evaluation tasks, including prompts, supporting files, and detailed rubrics. You will define unambiguous success criteria and meticulously observe AI behavior, producing precise English reports.The role requires fluency in English writing, strong attention to detail, and...

Indonesian - AI Product EvaluatorThe ProjectProductive Playhouse is building a talent pool of Indonesian speakers for an upcoming project testing and evaluating leading AI chatbots. The objective is to enhance response quality through direct user interaction with the various AI models. Open to freelancers based outside the U.S.   This is more than one...

Crossing Hurdles is seeking a professional with a Master's or PhD in Material Science for a role focused on evaluating AI-generated material science tasks. Responsibilities include assessing scientific accuracy and providing feedback. Candidates must possess strong analytical and communication skills and be able to work independently.This position requires...

Crossing Hurdles membuka lowongan kontraktor untuk AI yang menargetkan pemilik usaha kecil di Indonesia. Posisi ini sepenuhnya jarak jauh dengan komitmen 30–40 jam per minggu dan kompensasi 7 USD per jam.Anda akan bekerja sebagai penilai dan penyusun prompt bisnis berdasarkan kebutuhan pengguna dalam bahasa Indonesia. Tugas utama mencakup membuat prompt...

Design and implement self-contained evaluation tasks, including prompts, supporting files, and detailed grading rubrics to assess AI performance on practical computer-based workflows.Define clear, unambiguous written criteria for successful and unsuccessful task completion across diverse administrative and workflow scenarios.Meticulously observe and document...

Avanade's Trust Architects role focuses on building trust in AI systems by establishing evaluation frameworks, accuracy targets and governance controls. You will work with responsible AI standards, security guardrails and human-in-the-loop safeguards to ensure safe, reliable production deployments and client confidence.You will collaborate with engineers and...

Crossing Hurdles seeks a dedicated professional to design domain-specific prompts and evaluate AI responses for accuracy and reasoning. The role focuses on identifying weaknesses and developing robust test cases to push model limits, followed by providing evidence-based feedback to drive improvements.Candidate must hold a Master’s degree or higher, with...

Position: Speech AI Evaluation Specialist - Indonesian (Indonesia)Type: Hourly contractCompensation: $5 USD/hourCommitment: 10 40 hours/weekRole ResponsibilitiesParticipate in short voice conversations with AI models using a designated platform.Follow provided scenarios and prompts during AI voice interactions.Evaluate AI-generated responses based on...

DescriptionGramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.Role OverviewWe are looking for an experienced...

Crossing Hurdles is seeking a contractor to evaluate and prompt AI systems for small business contexts. The role focuses on Indonesian-language business scenarios and requires SME understanding, analytical and critical thinking, and the ability to adhere to structured evaluation guidelines.Work is remote with a commitment of 30-40 hours per week, and...

TikTok is hiring an AI Model Evaluation & Quality Strategy Specialist Graduate (AI Data Service Operations) to shape how high-quality data supports large model training. You will work on quality standards, judgment rules, and feedback loops across markets, with opportunities to learn and grow in a global AI data operations team.As a graduate, you will tackle...

We are looking for an AI Engineer to turn 8+ years of logistics and IoT data into real, customer-facing intelligence. This role is not about building complex AI models. It is about solving real business problems using data, simple logic, and AI tools — and shipping fast. You will work closely with leadership to: translate ideas into working features build...

We're looking for an AI Automation Engineer to build multi-agent AI systems that automate compliance workflows at scale. You'll design RAG pipelines, develop LLM-powered agents, and create integrations with enterprise platforms - all while ensuring accuracy and audit-readiness. This is a high-impact role where your work directly powers our compliance...

Role Purposes Reporting to the Business Performance Manager, you will be responsible for engineering and operationalizing ATI Business Group's Agentic AI capabilities to accelerate intelligent automation, improve decision support, and enable AI systems to take structured actions across enterprise workflows. Your primary objective is to design, build, and...

Talent Insider is an upcoming HR Consultancy Service, founded in 2021. Our clients have been some of the leading brands in Indonesia, and this service continues to expand. Registered in Singapore & Indonesia, we can assist with your growth plans and strategies, and continue to expand our regional presence with strong regional partners to assist our client in...

Min experience 3 years as EngineerTechnical Skills1. Strong proficiency in Python + ML ecosystem (Py\u002b TensorFlow, scikit learn, Hugging Face, LangChain).2. Proven experience deploying production-grade AI/ML systems, as reflected in organizational resumes (e.g., computer vision pipelines, real-time inference services).3. Hands-on experience with LLMs,...

Bachelor's degree in Computer Science, Software Engineering, Information Technology, Artificial Intelligence, or a related field, or equivalent practical experience*. Strong programming skills in Python*. Experience building applications using LLM APIs* such as OpenAI, Gemini, Claude, or equivalent. Understanding and hands-on experience with RAG...

Analyze business requirements and identify opportunities to implement AI-driven solutions. Design, develop, and maintain Generative AI applications, AI assistants, chatbots, and LLM-based solutions. Build, deploy, and maintain AI/ML models and RAG pipelines in production environments. Integrate AI solutions with ERP systems, web and mobile applications, and...