Lead Data Engineer

Join us as we embark on a journey of collaboration and innovation, where your unique skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference.

As a Lead Data Engineer at JPMorgan Chase within the Global Technology Enterprise Software Asset Management team, you are an integral part of an agile team that works to enhance, build, and deliver data collection, storage, access, and analytics solutions in a secure, stable, and scalable way. As a core technical contributor, you are responsible for maintaining critical data pipelines and architectures across multiple technical areas within various business functions in support of the firms business objectives.

Job Responsibilities

• Lead data management strategies in collaboration with business stakeholders, transforming data into insights that drive strategic decisions and organizational actions.
• Design, develop, and optimize ETL/ELT pipelines using SQL, Python, and PySpark for large-scale, complex data environments.
• Implement scalable data processing workflows in data lake platforms such as Databricks or Spark, ensuring efficient and reliable data operations.
• Ensure data quality, consistency, security, and lineage throughout all stages of data processing and transformation.
• Support data migration and modernization initiatives, transitioning legacy systems to cloud-based data warehouses.
• Document data flows, logic, and transformation rules to maintain transparency and facilitate knowledge sharing across teams.
• Troubleshoot and resolve performance and quality issues in both batch and real-time data pipelines.
• Review existing data challenges and deliver comprehensive solutions by applying appropriate data strategies and tools.

Required Qualifications, capabilities and skills

• Proven experience in data management, ETL/ELT pipeline development, and large-scale data processing.
• Proficiency in SQL, Python, and PySpark.
• Hands-on experience with data lake platforms (Databricks, Spark, or similar).
• Strong understanding of data quality, security, and lineage best practices.
• Experience with cloud-based data warehouse migration and modernization.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and documentation abilities.
• Ability to collaborate effectively with business and technical stakeholders.