At IT Labs, we're searching for a unique kind of talent, an SDET who lives and breathes AI. Someone who understands that quality assurance in the age of intelligent systems means going beyond the surface — testing not just code, but cognition.

As an AI SDET, you'll be instrumental in defining how we test products powered by language models and context-aware intelligence. You'll work closely with engineers building conversational systems designed to understand business-specific language, structures, and knowledge. The role requires someone who's not afraid to build a testing framework from the ground up, someone who can navigate APIs, performance bottlenecks, and model output evaluation with confidence.

You'll also help establish best practices and bring structure to a space where traditional testing tools meet emerging AI behavior.

Primary Responsibilities include:

• Collaborate with AI/ML engineers in testing intelligent features that interface with enterprise data and dynamic knowledge sources.
• Build and maintain test automation frameworks that can validate outputs from models — both through APIs and interactive systems.
• Design performance, functional, and edge-case testing scenarios for complex AI-driven workflows.
• Help define the metrics and data pipelines needed to evaluate the quality and reliability of AI responses.
• Support test strategy definition for systems that continuously learn or adapt based on user interaction and internal content
  
  
  

Additional Responsibilities may include:

• Integrating automation scripts into continuous integration processes using tools like Jenkins and GitHub Actions, and advocating for continuous testing practices
  
  
  

Requirements

• A degree in Computer Science, Mathematics, Statistics, or similar — or 5-7 years of proven hands-on experience.
• Background in testing machine learning models or AI-powered services.
• Strong experience with at least one programming language (Python, Java, R, Scala, Julia).
• Comfort creating test data and simulating interactions for AI-driven systems.
• Prior experience building out test infrastructure, not just using existing frameworks.
• Familiarity with test tools like JMeter, Rest Assured, or similar.
• Understanding of AI/ML concepts — especially NLP, LLMs, or systems that retrieve and generate contextual answers.
• Exposure to modern DevOps and deployment environments: GitHub Actions, Jenkins, Docker, Kubernetes, Helm
  
  
  

You are:

• Experienced in building backend test automation scripts and frameworks and working in a continuous delivery/continuous testing environment
• Experienced in working within an Agile/Scrum development process
• Able to identify testing and quality challenges and create innovative solutions to solve complex problems
• A person with strong communication skills who enjoys collaborating with co-workers
• Able to combine automation skills with manual testing (exploratory)
• Capable of thinking independently with curiosity, criticism, and keen attention to detail
• Well-organized and accustomed to working in an innovative environment
  
  
  

Benefits

• Long-term 12-month contract
• Choose your contract: Contractor or B2B,
• 10 Days PTO after 4 months of working in IT Labs,
• Referral Bonuses,
• Virtual Knowledge Sharing Sessions, Events and Team Hangouts
  
  
  

Our values

We are a company that seeks the best for both our employees and clients, reaching beyond expectations in turning dreams into reality. Our way of working is rooted in our core values (Integrity, Excellence, Proactivity, Innovation, and People), with an expectation that our future colleagues will make these their second nature in their everyday work and life. We don't ask for perfection, but we do appreciate people motivated to better themselves in every conceivable aspect.

About IT Labs

Founded in 2005, IT Labs is an international software tech company, specializing in purpose and process-driven teams for high-performance, innovation, transformation, and efficiency. Our HQ is in Palm Beach Gardens, Florida, and we have teams and offices around the world - the US, the UK, the Netherlands, Argentina, Brazil, Serbia, and North Macedonia. We are constantly growing, and we would love for you to become part of our team!