Lead Databricks Data Engineer
Philadelphia, PA
Rate : $55/hr on C2C we can pay to Candidate
Description:
We are seeking a skilled and experienced Lead Data Engineer to join our team and take a pivotal role in building, optimizing, and maintaining our data platform. As a technical leader, you will leverage your expertise in cloud technologies and data engineering to ensure high performance and scalability of our data solutions. This position requires a passion for data, a commitment to innovation, and a focus on delivering efficient and effective solutions.
Key Responsibilities:
Lead a team of data engineers in the development and maintenance of scalable data pipelines for the platform.
Optimize data capture, ingestion, and processing workflows to enable advanced analytics, data science, and operational intelligence.
Collaborate with Data Platform Architects and ML Engineers to integrate feature stores, manage model deployment, and implement data preparation workflows.
Ensure data engineering processes are designed for high performance, scalability, and resource efficiency.
Provide technical leadership and mentorship to team members, fostering an environment of continuous improvement and innovation.
Design and maintain data pipelines for streaming data, batch processing, and real-time analytics.
Implement secure and scalable data capture and ingestion workflows.
Support data preparation, exploration, and visualization to facilitate data-driven decision-making.
Work closely with other engineering teams to ensure data pipelines are secure, efficient, and aligned with business requirements.
Qualifications:
Bachelor’s degree in Computer Science, a technical field, or a related business discipline. Equivalent experience, certifications, or training will be considered. Master degree preferred
5+ years of experience in designing and delivering secure cloud solutions.
3+ years of experience with Databricks
2+ years of experience with Agile Methodology
Strong problem-solving, analytical, and communication skills.
From:
Amit Kushwaha,
KKSA
kushwaha@kksoftwareassociates.com
Reply to: kushwaha@kksoftwareassociates.com