AI Evaluation Analyst job opportunity at Ema Unlimited.



bot
Ema Unlimited AI Evaluation Analyst
Experience: 3-years
Pattern: full-time
apply Apply Now
Salary:
Status:

Job

Copy Link Report
degreeGeneral
loacation Bengaluru, Karnataka, India - Bengaluru, India
loacation Bengaluru, Kar..........India

About Ema: Ema is at the forefront of artificial intelligence research and application, dedicated to creating cutting-edge AI solutions that empower users globally. Join our dynamic team to help shape the future of AI technology.Responsibilities:Create Enterprise AI Model Evaluation Test Sets: Develop and maintain comprehensive test sets tailored for various enterprise use cases.Evaluate AI Models: Assess different versions, personas, and prompts of Ema on multiple quality parameters. Ensure new features and updates meet established standards before launch.Generate AI Evaluation Reports: Compile detailed evaluation reports that provide insights for improving persona setups and Ema's AI models.Test UX Flows: Evaluate the efficacy and usability of auxiliary user experience flows to ensure seamless end-to-end GenAI usage for Ema’s users.Automate Testing Flows: Develop and implement scripts and browser automation tools to streamline testing processes. Enhance testing velocity and early issue detection to improve overall product quality.Requirements:Educational Background: Bachelor’s degree in Engineering. Bachelor’s degree in Computer Science, Data Science, or a related field is preferred.Analytical Skills: Exceptional attention to detail with the ability to identify rare and complex edge cases.Communication Skills: Strong verbal and written English communication abilities..Professional Experience: 1-3 years of prior professional experience. Background in analytics, prompt engineering, or QA testing is a plus.Benefits:Stay at the cutting edge of GenAI research, guided and coached by top researchers in the field.Learn best practices for solving user problems with GenAI products.Collaborate across cross-functional teams to effectively achieve customer impact.Ema Unlimited is an equal opportunity employer and is committed to providing equal employment opportunities to all employees and applicants for employment without regard to race, color, religion, sex, national origin, age, disability, sexual orientation, gender identity, or genetics.

Other Ai Matches

remote-jobserver Remote
Partner Success Architect Applicants are expected to have a solid experience in handling Job related tasks
Engineering Leader Applicants are expected to have a solid experience in handling Job related tasks
Product Manager Applicants are expected to have a solid experience in handling Job related tasks
Test Infrastructure Engineer Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
Software Enginner - Product Security Applicants are expected to have a solid experience in handling Job related tasks
Software Engineer, Machine Learning Applicants are expected to have a solid experience in handling Machine Learning related tasks
remote-jobserver Remote
Senior Customer Success Manager Applicants are expected to have a solid experience in handling Job related tasks
Deployment engineer Applicants are expected to have a solid experience in handling Job related tasks
Software Engineering Lead, Backend Applicants are expected to have a solid experience in handling Backend related tasks
remote-jobserver Remote
AI/Data Resident Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
AI Outcome Manager Applicants are expected to have a solid experience in handling Job related tasks
Software Engineer, Backend Applicants are expected to have a solid experience in handling Backend related tasks
Devops Engineer Applicants are expected to have a solid experience in handling Job related tasks
Web Developer Applicants are expected to have a solid experience in handling Job related tasks
Product Marketing Manager Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
Recruiter - USA Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
Sales Strategy & Operations Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
Solutions Architect Applicants are expected to have a solid experience in handling Job related tasks
Software Engineer, Front-End Applicants are expected to have a solid experience in handling Front-End related tasks
Software Engineer, Backend Applicants are expected to have a solid experience in handling Backend related tasks
CTO's Office - AI Applications Engineer Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
Social Media & Community Manager Applicants are expected to have a solid experience in handling Job related tasks
remote-jobserver Remote
Enterprise Business Development Representative Applicants are expected to have a solid experience in handling Job related tasks