Senior/Associate Data Engineer – RMJ Consulting MY
Role Summary
You will design and maintain scalable data pipelines on AWS, utilizing your Python skills and expertise in services like S3 and Redshift. Collaborating with teams, you'll optimize workflows and ensure effective data modeling while implementing robust monitoring practices.
Job Description
In this role, you will architect and develop scalable data pipelines on AWS, ensuring their reliability and performance. You will leverage AWS services like S3, Glue, and Redshift to create end-to-end solutions while optimizing resources for cost-effectiveness. Your expertise in Python will be essential for developing data engineering solutions and collaborating with teams on data processing tasks. You'll design and manage workflows using Apache Airflow and work closely with stakeholders to implement effective data models. Monitoring and optimizing existing processes will be key responsibilities, along with maintaining documentation and best practices.
Job Requirements
Proven experience in designing and implementing data pipelines on AWS
Strong proficiency in Python programming for data engineering tasks
Experience with Apache Airflow for workflow orchestration
Knowledge of AWS services such as S3, Glue, EMR, and Redshift
Ability to design and optimize database schemas
Strong analytical and problem-solving skills
Excellent communication skills for collaboration with cross-functional teams
Experience in monitoring and optimizing data processes
Quick Info
Company
RMJ Consulting MY
Location
Kuala Lumpur
Salary
Undisclosed
Skills Required
8 skills
Click to submit your application
Required Skills
AWS
Python
Apache Airflow
Data Modeling
ETL
Monitoring
Communication
Collaboration
Application Tips
- Ensure your resume highlights relevant skills and experience
- Tailor your application to match the role requirements
- Double-check all information before submitting
- Submit your application as soon as possible to increase your chances