Data Engineer

Job Description:

• Define and champion the architectural roadmap and best practices for end-to-end data pipelines, ensuring scalability, reliability, and security
• Mentor engineers, conduct code reviews, and drive project timelines for rapid delivery of data products
• Partner with Data Scientists, Analysts, and business stakeholders to translate requirements into production-ready data solutions
• Collaborate with Data Scientists and ML Engineers on data accessibility, model development support, and data quality assurance
• Design, build, and optimize high-volume data ingestion and transformation jobs using dbt Core and AWS Glue
• Develop and maintain modular, reusable data pipelines using orchestrators such as Dagster
• Implement and manage real-time data flows using Confluent platforms or native AWS streaming services such as Kinesis
• Implement data anonymization and comply with data security and privacy regulations
• Implement and maintain the Iceberg open table format for schema evolution and data management
• Optimize query performance and cost efficiency across Snowflake, Amazon Redshift, and AWS Athena
• Integrate monitoring and observability into pipelines using Splunk to identify bottlenecks and troubleshoot production issues

Requirements:

• 10+ Years of hands-on, progressive experience in Data Engineering, Data Architecture, or a closely related Full-Stack Data role
• Deep conceptual understanding of core data engineering principles, ETL/ELT patterns, and metadata management
• Proven track record of building and managing petabyte-scale data infrastructure in a cloud-native environment
• Insurance industry experience preferred but not mandatory
• Experience with AWS, including S3, IAM, and VPC
• Experience with Talend, dbt Core, Iceberg, AWS Glue Catalog, Snowflake, Redshift, Athena, Splunk, AWS streaming services, and Git
• Strong SQL, PySpark, and Python
• Familiarity with DataOps and DevOps fundamentals

Benefits:

• Annual bonus
• Benefits information provided at https://www.exlservice.com/us-careers-and-benefits
• Remote work / work from home