What you will be doing:
* Data Platform: Creation of a Databricks Data Warehouse(s) and Lakehouse solutions for a healthcare data focused enterprise. o Data Governance: Configuring and maintaining unity catalog to enable enterprise data lineage and data quality o Data Security: Building out Data Security protocols and best practices including the management of identified and de-identified (PHI/PII) solutions o External Data Products: Building data solutions for clients while upholding the best standards for reliability, quality, and performance o ETL: Building solutions within Delta Live Tables and automation of transformations o Medallion Architecture: Building out performant enterprise-level medallion architecture(s) o Streaming and Batch Processing: Building fit-for-purpose near real-time streaming and batch solutions o Large Data Management: Building out performant and efficient enterprise solutions for internal and external users for both structured and unstructured healthcare data o Platform Engineering: Building out Infrastructure as Code using Terraform and Asset Bundles o Costs: Working with the business to build cost effective and cost transparent Data solutions
* Pipeline/ETL Management: You will help architect, build, and maintain robust and scalable data pipelines, monitoring, and optimizing performance o Experience working with Migration tools i.e., AWS DMS, AWS Glue, Fivetran, integrate.io www.selbyjennings.com | Terms and conditions apply o Identify and implement improvements to enhance data processing efficiency o Experience with building out effective pipeline monitoring solutions o Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL, Delta Live Tables, Python, Scala, and cloud-based 'big data' technologies.
* Data Modeling: Lead design, implementation, and maintenance of standards based (FHIR, OMOP, etc.) and efficient data models for both structured and unstructured data o Assemble large, complex data sets that meet functional and non-functional business requirements o Develop and maintain data models, ensuring they align with business objectives and data privacy regulations
* Collaboration: Partner internally and externally with key stakeholders to ensure we are providing meaningful, functional, and valuable data o Effectively work with Data, Development, Analysts, Data Science, and Business team members to gather requirements, propose, and build solutions. o Communicate complex technical concepts to non-technical stakeholders and provide guidance on best practices. o Ensure that technology execution aligns with business strategy and provides efficient, secure solutions and systems
* Processes and Tools: Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc. o Build analytics tools that utilize the data pipeline to provide actionable insights into operational efficiency and other key business performance metrics. o Create data tools for clinical, analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader