Job OverviewWe are seeking a skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will be responsible for designing, developing, and maintaining robust data pipelines and architectures that support our data-driven decision-making processes. This role requires a strong understanding of big data technologies and cloud-based solutions, particularly within the Azure ecosystem.
Duties
- Develop and maintain scalable data pipelines using Azure Data Lake and Hadoop to support large-scale data processing.
- Collaborate with data scientists and analysts to facilitate model training and ensure data availability for analysis.
- Design and implement ETL processes using Informatica to integrate various data sources into a centralized data warehouse.
- Monitor and optimize database performance, ensuring high availability and reliability of server environments.
- Participate in Agile development practices, contributing to sprint planning, reviews, and retrospectives.
- Vaticinate potential issues in the data architecture and proactively implement solutions to mitigate risks.
- Document data processes, architectures, and workflows for clarity and compliance.
Experience
- Proven experience working with big data technologies such as Hadoop and cloud services like Azure Data Lake.
- Strong understanding of data warehousing concepts and experience with ETL tools like Informatica.
- Familiarity with Agile methodologies and practices in a collaborative team environment.
- Experience in model training processes is a plus, demonstrating the ability to work closely with machine learning teams.
- Excellent problem-solving skills with the ability to analyze complex datasets effectively.
If you are passionate about leveraging technology to drive business insights through effective data management, we encourage you to apply for this exciting opportunity as a Data Engineer.
Job Types: Full-time, Contract
Pay: $57.52 - $69.27 per hour
Expected hours: 40 per week
Benefits:
- Dental insurance
- Health insurance
- Paid time off
Work Location: In person
https://discord.gg/GUPad7ETad