Piper Companies is seeking a Lead Data Engineer to join one of the nations leading transportation logistics firms. The Lead Data Engineer will focus on data engineering within the logistics and parcel space, emphasizing Databricks and Azure experience, with some legacy experience in SAP data services.Responsibilities of the Lead Data Engineer include:
Utilize Databricks for data processing and analytics.
Implement and maintain a governance framework.
Support the AI team by understanding and integrating AI components.
Develop and manage ML Ops processes.
Use Azure Data Factory (ADF) for data integration and orchestration.
Collaborate with team members to architect and implement technical solutions.
Ensure data quality and integrity across various systems.
Provide technical leadership and mentorship to junior team members.
Stay updated with the latest industry trends and technologies.
Qualifications for the Lead Data Engineer include:
Extensive experience with Databricks.
Strong understanding of governance frameworks.
Experience supporting AI teams and understanding AI components.
Knowledge of ML Ops processes.
Proficiency with Azure Data Factory (ADF).
Legacy experience with SAP data services is preferred.
Excellent analytical and problem-solving skills.
Strong communication and collaboration skills.
Ability to work independently and as part of a team.
Bachelors degree in a technical field or equivalent experience.
Compensation for the Lead Data Engineer includes:
Salary: $130,000 - $150,000
Comprehensive Benefits: Medical, Dental, Vision, 401K, PTO, Sick Leave as required by law, and Holidays
This job opens for applications on 2/28/25. Applications for this job will be accepted for at least 30 days from the posting date.Keywords: Lead Data Engineer, Data Engineering, Brokerage, Databricks, Governance Framework, AI Support, ML Ops, Azure Data Factory, SAP Data Services, Technical Leadership, Data Quality, Data Integrity, Technical Solutions, Hybrid Position
Take the leap to a rewarding job that pays you well and that you enjoy.
Success Stories
Habib Karbasian
Data Scientist at Neal Analytics
“I was ready to give up [on the job search point] and I was at my lowest point...fortunately,
HiCounselor was my last resort and they walked me through every step of the interview process.
The program was the light at the end of the tunnel [for me], and I landed a job within 1 month”
Wei Yuan
Business And Data Analyst
“Before joining HiCounselor I felt like I was spinning my wheels. Applying to jobs online with no
networking and no focus.Thanks to HiCounselor's training and networking, I learned how to network
and turn leads into offers!”
EMIL JOSWIN
Software Engineer at Habu
“When it comes to HiCounselor, the biggest plus is that they will do the networking on your behalf,
which in my experience saved 95% of my time and energy. I was able to then channel my time and energy
into being prepared for interviews.”
To help us tailor your experience, please let us know
what
you're looking for :
Will you require visa sponsorship to work in US?
What Job Roles you are interested in?(Select one or
more)
How would you define yourself?
How many years of Professional Experience do you have?
(Select one)
What is your location preference for the job
Looking for job opportunities or internships
LinkedIn OR Resume
Based on your provided information, we can help you with
the following:
Join HiCounselor Career Accelerator Program, where
we will help you with interview preparation and
connecting with you the right job opportunities
Click
here to sign up for the Info Session today or you
can also fill out the application on the next step.
HiCounselor Projects Platform:
Complete Real World Projects to help you learn and get
ready for the job you want and Build professional
portfolio.
Based on your provided information, we can help you with
the following:
Actively hiring companies in
HiCounselor partners with companies hiring in ,
Select this option to get redirected to see the job
opportunities in
HiCounselor Projects Platform:
Complete Real World Projects to help you learn and get
ready for the job you want and Build professional
portfolio.
Based on your provided information, we can help you with
the following:
We recommend you to attempt real world projects on
HiCounselor Projects platform to get ready for
internships.
Once you have your portfolio built, visit this
page, where
we have listed startups whom you can reach out for
internships.
https://discord.gg/GUPad7ETad