Responsibilities:
- Create, modify, and delete objects/tables in S3 buckets, including the raw, clean, curated zones, and the consumption layer (Redshift Cluster).
- Develop and execute Glue Jobs scripts for Extract, Transform, Load (ETL) processes, ensuring efficient data transformation across the entire dataset in the Data Lake.
- Determine appropriate actions, such as tokenization, to be applied in the raw zone for immediate data processing.
- Set up dataset alarms to monitor the data pipeline and define notifications for missing data ingested.
- Collaborate with stakeholders to determine data transformation requirements for selected datasets within the Data Lake.
- Apply data standardization techniques in the clean zone to ensure consistent and reliable data quality.
- Create snapshots in the clean zone to capture data at specific points in time for analysis and auditing purposes.
- Design and develop data models in the curated zone, optimizing data structures for efficient access and retrieval.
- Define tables/objects in the curated zone to support Salesforce usage, ensuring data integrity and compatibility.
- Identify and create tables/objects in the curated zone and the consumption layer (Redshift Cluster) for Tableau standard access.
- Determine tables/objects to be included in Redshift Spectrum for Tableau advanced access, enabling advanced data exploration and analysis.
Requirements:
- Bachelor’s degree in computer science, information technology, or a related field.
- Minimum of 3 years’ relevant work experience.
- Strong proficiency in working with the AWS Console, including S3, Glue, and Redshift services.
- Experience with ETL processes, scripting, and data transformation techniques.
- Familiarity with Glue Data Catalog and its usage in ETL workflows.
- Solid understanding of data lakes, data modeling, and database concepts.
- Ability to collaborate effectively with cross-functional teams and stakeholders.
- Strong problem-solving and analytical skills.
- Excellent communication and documentation skills.
- Attention to detail and a commitment to delivering high-quality results.
- Willing to travel and be deployed to client/affiliate off-shore (Hong-Kong office).
Work Arrangement: Willing to be deployed in Hong Kong, he will work in the Hong Kong office. When in the Philippines, a work-from-home setup will be implemented.
Salary: 70,000-75,000 gross pay salary; can earn up to 120,000 gross pay salary, plus an additional 50,000 allowance when working in Hong Kong