AmaliTech is looking for an experienced Data Engineer to join our data team and help design, develop, and optimize data pipelines and workflows. The ideal candidate will have a strong understanding of data engineering concepts, excellent problem-solving skills, and the ability to work on complex data projects that drive impactful insights. Your work will directly contribute to improving decision-making and operational efficiency across the organization.
Responsibilities
- Develop, construct, and maintain scalable data pipelines and ETL processes.
- Assemble large, complex datasets that meet functional and non-functional business requirements.
- Collaborate with data architects, data scientists, and analysts to understand data requirements and optimize data workflows.
- Monitor and troubleshoot data systems using tools such as Grafana or AWS CloudWatch to ensure reliability, data quality, and availability.
- Implement data governance and security measures to protect sensitive data.
- Design and optimize data storage solutions, including data warehouses and data lakes.
- Automate and improve data processes and workflows for scalability and efficiency.
- Monitor data infrastructure for performance and reliability to address issues promptly.
- Keep abreast of industry trends and emerging technologies in data engineering.
- Document data pipelines, processes, and best practices for knowledge sharing.
- Optimize database performance for efficient data retrieval and storage.
Qualification
- Minimum 3 years of experience as a Data Engineer or in a similar role.
- Proficiency with ETL tools, data integration platforms, and frameworks.
- Strong SQL skills and experience with both relational and NoSQL databases.
- Experience working with big data technologies like Apache Spark, Kafka, or Hadoop.
- Hands-on experience with cloud platforms (AWS, Azure, GCP) for data engineering.
- Proficient in programming languages, particularly Python (preferred), as well as Java or Scala.
- Strong analytical and problem-solving skills, adept at understanding complex data needs and resolving quality issues to ensure data accuracy and reliability.
