ETL Developer

Responsibilities:

• Create, modify, and delete objects/tables in S3 buckets, including the raw, clean, curated zones, and the consumption layer (Redshift Cluster).
• Develop and execute Glue Jobs scripts for Extract, Transform, Load (ETL) processes, ensuring efficient data transformation across the entire dataset in the Data Lake.
• Determine appropriate actions, such as tokenization, to be applied in the raw zone for immediate data processing.
• Set up dataset alarms to monitor the data pipeline and define notifications for missing data ingested.
• Collaborate with stakeholders to determine data transformation requirements for selected datasets within the Data Lake.
• Apply data standardization techniques in the clean zone to ensure consistent and reliable data quality.
• Create snapshots in the clean zone to capture data at specific points in time for analysis and auditing purposes.
• Design and develop data models in the curated zone, optimizing data structures for efficient access and retrieval.
• Define tables/objects in the curated zone to support Salesforce usage, ensuring data integrity and compatibility.
• Identify and create tables/objects in the curated zone and the consumption layer (Redshift Cluster) for Tableau standard access.
• Determine tables/objects to be included in Redshift Spectrum for Tableau advanced access, enabling advanced data exploration and analysis.

Requirements:

• Bachelor’s degree in computer science, information technology, or a related field.
• Minimum of 3 years’ relevant work experience.
• Strong proficiency in working with the AWS Console, including S3, Glue, and Redshift services.
• Experience with ETL processes, scripting, and data transformation techniques.
• Familiarity with Glue Data Catalog and its usage in ETL workflows.
• Solid understanding of data lakes, data modeling, and database concepts.
• Ability to collaborate effectively with cross-functional teams and stakeholders.
• Strong problem-solving and analytical skills.
• Excellent communication and documentation skills.
• Attention to detail and a commitment to delivering high-quality results.
• Willing to travel and be deployed to client/affiliate off-shore (Hong-Kong office).

Work Arrangement: Willing to be deployed in Hong Kong, he will work in the Hong Kong office. When in the Philippines, a work-from-home setup will be implemented.

Salary: 70,000-75,000 gross pay salary; can earn up to 120,000 gross pay salary, plus an additional 50,000 allowance when working in Hong Kong