Pointwest is looking for a highly motivated data engineer well-versed in cloud technologies and data management principles to join us as a key member of our intelligent automation center of excellence and start with us in an exciting pilot project with an industry giant (Renewable Energy/Utilities).
The project revolves around using AI/ML and forecasting techniques to improve Well and Reservoir Management. It is a cloud-first initiative with one of the world's top cloud vendors (AWS) and is a first in the region.
What we will do together:
- Work closely with both external and internal clients in specification and design phases of a project or initiative
- Design and build automated cloud-native data pipelines and applications for big data and AI/ML initiatives
- Design and develop data quality strategies for big data, data science and AI/ML initiatives
- Build and/or support data lake implementations
- Perform a senior lead role for existing and future projects - validation of technical requirements, estimates and design; technical guidance for the team during delivery and mentoring of junior team members
- Work with the organization's architecture, product and data teams to optimize existing data/AI-ML platforms for cost, performance, scalability, reliability and testability
- Define the tech stack and standards for projects and initiatives
What we expect from you:
- At least 5 years' experience with distributed systems, API implementations, service-oriented architectures, serverless architectures and cloud engineering
- At least 3 years' experience with Amazon Web Services (AWS): S3, EC2, SQS, Redshift, Lambda, Glue, Athena, data lake implementations on AWS
- Experience with data pipelines and ETL/ELT
- Strong programming skills and experience with Python and Java, with at least 3 years' development experience in commercial, large-scale projects
- Comfortable with working with Linux
- Data modeling experience (relational and dimensional)
- Experience in supporting data science projects' data requirements (data imputation, data quality assessment, normalization, etc.)
- Strong SQL knowledge
- Experience with different data formats typically used in big data environments and analytics (Parquet, ORC, etc.)
- Experience in data visualization (Power BI, Tableau or AWS QuickSight, JavaScript visualization frameworks)
- Bachelor's degree
What will make you thrive in this role:
- Strong curiosity, problem-solving and problem-finding skills
- Dedication to continuous learning
- Analytical and critical thinking
- Strong sense of ownership and accountability
- Team orientation
- Strong communication skills in English and Filipino - written and spoken
What's a plus, but not mandatory
- Azure data services knowledge and experience
- Orchestration experience (i.e. Apache Airflow)
- NoSQL data modeling
- Experience with Apache Spark, the Hadoop ecosystem, and other big data technologies
- Experience with streaming data technologies
- Analytics experience or knowledge