Senior Data Engineer

Job Description:

• Build and maintain data pipelines and datasets supporting reporting, visualization, machine learning and data-driven decision making across finance, sales, supply chain, marketing and other business functions
• Develop and maintain scalable data pipelines and reusable datasets within a Databricks lakehouse environment
• Ingest, validate, clean and transform structured and unstructured data from multiple sources using Python, PySpark and SQL
• Build data models and reporting datasets supporting Tableau and established analytics tools such as Spotfire
• Integrate established data warehouse and reporting systems with modern cloud analytics platforms
• Improve pipeline reliability, data quality and processing performance
• Implement automated testing, monitoring, documentation and CI/CD practices
• Partner with analysts, architects, developers and business stakeholders to deliver practical data solutions
• Provide technical guidance, review code and mentor other data engineers

Requirements:

• 7+ years of experience in data engineering, including building and supporting production data pipelines
• Strong SQL skills and a solid understanding of data modeling, database design and data warehousing
• Hands-on experience with Databricks, Apache Spark and cloud data platforms
• Strong proficiency in Python and PySpark
• Experience developing ETL/ELT pipelines and integrating data from multiple source systems
• Experience preparing reliable datasets for Tableau or comparable business intelligence tools
• Familiarity with source control, automated testing and CI/CD practices
• Ability to troubleshoot complex data issues and optimize pipeline performance
• Strong communication skills and experience collaborating with technical teams and business stakeholders
• Experience with Spotfire, Oracle, Informatica, R or data virtualization preferred
• Databricks certification preferred