Artificial General Intelligence (AGI) Data Services is pioneering AI innovation, specializing in developing and refining large language models (LLMs).
Our mission is to create sophisticated AI systems that excel in understanding and generating high-quality STEM content.
If you're passionate about data quality, have a keen eye for detail, and are excited about the potential of AI in STEM domain, we encourage you to apply for this pivotal role at AGI Data Services.
Title: Generative AI Data Quality Scientist l
Term: 9 months+ with extension and/or Fulltime Conversion
Location: Bellevue, Washington 98004 – 5 days onsite
Job Description:
As a Data Quality Scientist in domain STEM, you will play a crucial role in evaluation and enhancement of our AI models' STEM reasoning, ensuring precision and reliability in AI-generated STEM content.
This role requires a unique blend of technical expertise, critical thinking, and communication skills. You will be the bridge between advanced AI technology and practical, real-world applications. Your work will directly influence the development of next-generation AI STEM assistants.
Key Responsibilities:
• Evaluate and analyze quality of STEM content across various sub-domains (mathematics, biology, physics, chemistry, etc.)
• Benchmark model performance based on human ground truth
• Partner with AI researchers to identify optimization opportunities and enhance model accuracy
• Conduct in-depth analysis of human audit data to identify patterns and areas for improvement
Required Qualifications:
• Bachelor's or Master's degree in Data Science, Computer Science, STEM, Mathematics, or related field
• 2+ years of data querying languages (e.g. SQL), scripting languages (e.g. Python) experience
• 2+ years of machine learning/statistical modeling data analysis tools and techniques, and parameters that affect their performance experience
• Strong programming skills in Python, with experience in data analysis libraries (NumPy, Pandas, SciPy)
• Proven experience in statistical analysis
• Strong analytical and problem-solving skills
Preferred Qualifications:
• Experience with AI/ML systems evaluation, particularly in STEM applications
• 2+ years of data scientist experience
• 2+ years of experience in machine learning model development and implementation
• Understanding of machine learning concepts, particularly as they apply to natural language processing and image processing
• Deep understanding one of STEM domains and has background in STEM domain
• Experience with deep learning framework (PyTorch)
• Experience with version control systems (e.g., Git) and data visualization tools