Job Title: Data Engineer

Job Type: Full-time

Industry: IT (5 days working)

Exp. required: 3 to 5 years

Location: Gurgaon

Responsibilities

• Design and manage vector databases for AI agent applications.
• Develop data pipelines for processing, storing, and retrieving AI-related data.
• Optimize real-time data streaming and retrieval mechanisms.
• Collaborate with AI engineers to fine-tune data preprocessing and training datasets.
• Implement ETL processes for structured and unstructured data processing.
  
  

Skills Required

• Expertise in vector databases (Weaviate, Pinecone, FAISS).
• Proficiency in SQL, Python, Apache Spark, and Kafka.
• Strong understanding of real-time data processing and ETL frameworks.
• Experience working with AI-driven data architecture.
• Ability to handle large-scale datasets and optimize query performance.