Director, Software Engineering

Job Description:

• Partner with the core Databricks team to plan and execute the transition of existing data pipelines to the target enterprise data platform
• Implement repeatable engineering patterns for ingestion, transformation, testing, deployment, and monitoring across onboarded datasets
• Lead adoption of AI-powered development tools such as Claude, GitHub CoPilot, and LLMs
• Develop context engineering practices and reusable context packs
• Guide offshore teams in defining and operationalizing asset-agnostic onboarding patterns for data assets, domains, and source systems
• Establish reusable ingestion and processing patterns across batch and streaming use cases
• Integrate platform pipelines and datasets with the enterprise data mastering platform
• Establish data quality controls, reconciliation processes, and metadata alignment
• Support consistent business definitions, reusable data concepts, and governed consumption patterns
• Serve as a senior technical expert for offshore data platform engineering
• Influence architectural decisions and provide technical guidance to engineers and partner teams
• Contribute to design and code reviews for complex data platform initiatives

Requirements:

• 10+ years of experience in data engineering, data platforms, cloud data architecture, software engineering, or related engineering domains
• Experience as a senior Individual Contributor, technical lead, principal engineer, staff engineer, distinguished engineer, architect, or equivalent
• Strong hands-on experience with modern data engineering and pipeline development
• Experience with batch and/or streaming data workflows
• Experience with Databricks-based data platforms and lakehouse-oriented architectures
• Practical experience using AI-assisted engineering tools such as Claude, GitHub CoPilot, LLMs, or similar
• Experience applying LLMs to engineering use cases such as code generation and optimization
• External candidates reaching the final interview stage must attend at least one in-person interview
• Familiarity with enterprise data cataloging, metadata management, business glossaries, lineage, operational metadata platforms, or semantic data layers
• Experience with NeoXam DataHub or NeoXam-style mastering workflows
• Knowledge of semantic modeling
• Strong leadership skills, including coaching, empowering others, and building consensus

Benefits:

• Annual incentive plan eligibility
• Health care coverage
• Generous time off
• Continuous learning and career development resources
• Retirement planning
• Continuing education program
• Company-matched student loan contribution
• Financial wellness programs
• Family benefits and perks
• Retail discounts
• Referral incentive awards