Demand.io

Senior Data Engineer

California, US

$300kโ€“$600k/year
10 days ago
Save Job

Summary

Build the data foundation for the future of e-commerce


AI is transforming how people discover and purchase online. At Demand.io, we're creating the data infrastructure that powers this transformation, making commerce more intelligent and accessible for millions globally.


As a founder-owned, profitable company with no external investors, we're building a unicorn-scale business through organic growth rather than venture funding. This independence shapes our data architecture and approach to innovation.


We need an exceptional Senior Data Engineer to design and implement sophisticated data systems that will power our platform.


The data engineering challenge


We're addressing unprecedented data engineering challenges:


  • Building scalable pipelines processing information from 400,000+ merchants
  • Implementing modern ETL/ELT frameworks for efficient data transformation
  • Designing robust integration systems for diverse data sources
  • Creating streaming solutions for real-time analytics
  • Developing quality frameworks ensuring accuracy at scale


Our current focus:


  • Scaling infrastructure to handle 10x more volume while maintaining performance
  • Building advanced pipelines that feed our AI systems with comprehensive e-commerce data


The 10x opportunity


Unlike traditional roles implementing predefined architectures, this position emphasizes creating leverage through system design. We're building a team of "10x operators" who achieve outsized impact by designing systems with exponential results.


As our Senior Data Engineer, you'll:


  • Design self-improving pipelines that scale automatically
  • Create integration frameworks handling diverse sources with minimal custom code
  • Build quality systems that continuously enhance accuracy
  • Develop efficient workflows for complex transformations
  • Architect solutions blending stream and batch processing
  • Work directly with our founder and technical leadership


About Demand.io


We're building the world's leading source of e-commerce knowledge through:


  • ShopGraph: Our knowledge graph containing comprehensive commerce data
  • SimplyCodes: AI and community-powered platform covering 400,000+ stores
  • Product.ai: Revolutionary AI shopping assistant


Profitable since 2009, we drive over $1B in annual commerce volume with a lean team of deep generalists.


What makes data engineering at Demand.io different


Technical innovation without constraints


Our independence means we pursue the right technical decisions for long-term growth. You'll:

  • Design architectures blending batch and real-time processing
  • Pioneer new approaches to data integration
  • Build multiplication engines that improve data quality
  • Create frameworks that become competitive advantages
  • Lead innovation with direct leadership collaboration


Strategic impact with true ownership


Your work will have direct impact on our growth trajectory:

  • Shape architectural decisions transforming our capabilities
  • Drive innovations affecting our path to unicorn scale
  • Design frameworks becoming core strategic assets
  • Build systems with complete creative freedom
  • Lead our data evolution with minimal bureaucracy


The 10x difference


We're seeking 10x operators who combine deep expertise with systematic thinking to achieve exponential results through:


  • Building self-improving systems rather than implementing pipelines
  • Creating leverage through frameworks and AI amplification
  • Developing tools that multiply engineering effectiveness
  • Driving compound improvements rather than linear progress
  • Working alongside other high-impact operators


One of our engineers recently transformed our integration system, creating a framework that improved data quality by 40% and reduced development time by 60%, resulting in 3x increased data coverage.


Creating wealth through innovation


We've reimagined tech compensation for elite talent with substantial immediate wealth creation through monthly cash payments.


Foundation


  • Base: $180,000 - $250,000
  • Equity: 0.20% - 0.35%
  • Partners Program: Monthly profit-sharing bonuses


Partners Program with profit-sharing


Top performers achieve total compensation of $300,000 - $600,000+ annually with advantages:

  • Monthly cash payments (not annual bonuses)
  • Immediate wealth creation (vs locked RSUs)
  • Uncapped earning potential
  • No lockup periods required
  • Increasing percentages as you advance


Additional benefits


  • ๐Ÿš€ Advancement opportunities based on impact
  • ๐Ÿ“š Learning stipend for conferences, courses, and certifications
  • ๐Ÿ–ฅ๏ธ Access to advanced AI tools including our own GPU cluster
  • ๐Ÿฅ Comprehensive health, dental, and vision coverage for you and all dependents
  • ๐Ÿ–๏ธ Unlimited PTO
  • ๐Ÿ‘ถ Parental leave policy
  • ๐Ÿ“ˆ 401(k) program
  • ๐Ÿฝ๏ธ Catered lunches in our Santa Monica office
  • ๐Ÿ  Comprehensive relocation assistance


What we're looking for


System architect mindset


  • Track record designing scalable data architectures
  • Drive to build systems creating multiplication effects
  • Experience creating self-improving data pipelines
  • History of designing lasting infrastructure
  • Focus on systematic approaches to data challenges


Technical expertise


Data Pipeline Development

  • Experience with ETL/ELT frameworks (Spark, Beam, dbt)
  • Advanced SQL knowledge for complex transformations
  • Strong Python skills for data processing


Data Integration & Extraction

  • Implementation of robust connectors, APIs, and web scraping
  • Experience with data integration patterns


Data Classification & Enrichment

  • Experience with classification systems and enrichment services
  • Understanding of data enrichment workflows


Cloud Data Infrastructure

  • Knowledge of cloud data warehouses and optimization
  • Experience with cloud-native data services


Workflow Orchestration

  • Proficiency with orchestration tools (Airflow, Prefect, Dagster)
  • Experience designing DAGs for complex processes


Stream Processing

  • Experience with real-time processing (Kafka, Kinesis, Flink)
  • Understanding of event-driven architectures


Modern Data Lakehouse

  • Understanding of table formats (Iceberg, Delta Lake, Hudi)
  • Experience implementing lakehouse architectures


Data Governance & Quality

  • Implementation of quality checks and lineage tracking
  • Experience with data quality frameworks


Performance Optimization

  • Ability to tune pipelines for cost and efficiency
  • Experience with performance monitoring


Data Observability

  • Experience implementing monitoring and alerting
  • Knowledge of observability best practices


Deep generalist capabilities


  • Expertise across multiple relevant domains
  • Ability to synthesize insights from different fields
  • Rapid learning and adaptation to new technologies
  • Excellent communication skills
  • Comfort with ambiguity and first-principles thinking


Required experience


  • 6+ years in data engineering
  • Advanced SQL expertise and cloud data warehouse experience
  • Strong experience designing data pipelines (ETL/ELT)
  • Expertise in data modeling for analytical and operational workloads
  • Strong Python programming background
  • Experience with data orchestration tools
  • Understanding of container orchestration
  • Bachelor's degree in related field or equivalent experience


Nice to have


  • Experience with graph databases
  • Knowledge of vector databases for ML applications
  • Background in e-commerce data systems
  • Experience implementing sentiment analysis
  • Knowledge of data architectures for NLP
  • Advanced degree in relevant field


Your career growth path


As a Senior Data Engineer at Demand.io, your growth includes:


  • Advancing through our Partners Program based on impact
  • Expanding influence from specific systems to entire domains
  • Growing into architecture leadership as our team scales
  • Developing deeper expertise across multiple technologies
  • Building a portfolio of high-impact work


Ready to shape the future of commerce?


If you're energized by building revolutionary data systems while driving technical innovation, we want to talk to you. Our founder is happy to have an initial confidential conversation about how this opportunity could align with your career aspirations.


Learn more about our products, our team, and our culture.

How strong is your resume?

Upload your resume and get feedback from our expert to help land this job