Senior Data Engineer

We are seeking a Senior Data Engineer with 9–13 years of experience in Azure Data Factory, Databricks, and PySpark to join our team. The ideal candidate will design, build, and optimize scalable data solutions that drive business success and societal impact. This role requires a hybrid work model (Dallas, TX preferred) and offers the opportunity to work on cutting-edge data projects in a collaborative environment.
Key Responsibilities
✔ Design & Implementation:
·       Develop data integration workflows using Azure Data Factory.
·       Build scalable data architectures in collaboration with cross-functional teams.
·       Process large datasets efficiently using PySpark, ensuring data quality.
✔ Data Optimization & Governance:
·       Monitor and optimize data pipelines for performance and reliability.
·       Ensure compliance with data security and governance policies.
·       Continuously assess and improve data solutions for efficiency.
✔ Collaboration & Leadership:
·       Provide technical guidance to team members, fostering innovation.
·       Document data processes for clarity and future reference.
·       Engage with stakeholders to translate business needs into data solutions.
✔ Innovation & Best Practices:
·       Stay updated with emerging data technologies and trends.
·       Contribute to data management best practices within the organization.
·       Support data-driven decision-making to enhance operational efficiency.
Required Skills
Technical Expertise:
·       Azure Data Factory (Data integration & ETL)
·       Databricks (Data analytics & pipeline creation)
·       PySpark (Large-scale data processing)
Soft Skills:
·       Strong problem-solving & attention to detail
·       Effective cross-functional collaboration
·       Excellent communication & documentation
Nice-to-Have Skills
·       Domain-specific knowledge (if applicable)
·       Experience with additional Azure data tools (Synapse, Data Lake)
Qualifications
✅ 9+ years of hands-on data engineering experience.
✅ Proven expertise in Azure Data Factory, Databricks, and PySpark.
✅ Strong track record in designing scalable data solutions.
✅ Knowledge of data governance & security best practices