Data Engineer - Singapore - GVT Government Technology Agency (GovTech)

GVT Government Technology Agency (GovTech)

Verified Company

Singapore

1 week ago

Posted by:

Wei Jie

beBee Recruiter

Description

Join us as we support Singapore's vision of building a Smart Nation - a nation of possibilities empowered through info-communications technology and related engineering.

The Data Science & Artificial Intelligence Division partners with public sector agencies to improve policy outcomes, service delivery and operational efficiency by harnessing data science and AI.

We extract data-driven insights and build intelligent platforms to add value to the work of our partner agencies.

We also help them transform through building data science expertise, formulating data strategies, and setting up the necessary data infrastructure.

How we work:

Outcome Driven
Our projects are not academic exercises. We are driven by the "so what", and seek to ensure that our findings and models can translate into tangible impact.
Start Small and Move Fast
We build things fast. If it works, we quickly move on to the question of how we can scale it further. If it doesn't work, what went wrong and what can we do better next time?

Ownership

You're not just here to write code. Team members help to figure out what we should be building, and how we should build.

Continuous Learning

Working on new ideas often means not fully understanding what you are working on. Taking time to learn new architectures, frameworks, technologies, and even languages are not just encouraged, but essential.

As a Data Engineer in GovTech's Data Science & Artificial Intelligence Division, you will be involved in architecting, managing and running advanced analytics and data platforms.

For this role, you will be working in CDO Team within GovTech, where you will help drive GovTech's Data Transformation efforts.

You will assist to establish and implement effective operational workflows, data pipelines, procedures and best practices in accordance with government infrastructure and security policies to ensure that the platforms are monitored, secure, available and reliable.

We are looking for an independent and motivated data engineer who has experience in both small and large-scale analytics platform projects, and in building and maintaining the infrastructure.

What you will be working on:

Design, Architect, Deploy, and maintain solutions on AWS and Databricks to provide secure and governed access to data for data scientist, data analysts and business users.
Manage the full lifecycle of a data lakehouse project from requirement gathering to data modelling, design of the data architecture and deployment.
Collaborate with data stewards, data analysts and data scientists to build data pipelines to ingest data from enterprise systems for both batch and realtime streaming data.
Establish and manage the complete machine learning lifecycle using MLFlow.

Where we are looking for:

Degree in Computer Science or Information Technology or related disciplines
Have more than 4 years of experience in a technical role
Handson experience in implementing Data Lake/Data Warehouse with technologies like
Databricks, Azure Synapse Analytics, SQL Database, AWS Lake formation.
Understanding on OLTP, Data Lake and Lakehouse technologies that may include knowledge of S3, AWS Glue, DeltaLake or DataBricks
Proficient in SQL, PySpark and Python.
Experience in Big Data management & processing using tools such as Spark
Knowledge in Machine Learning Frameworks and the use of ML Flow to manage the machine learning lifecycle
Comfortable with DevOps tools like AWS Cloud Formation/Terraform, Docker and Git for CI/CD development.
Prior experience with data engineering tools and frameworks like Airflow, Kafka, Hadoop, Spark, Kubernetes.
Familiar in building REST services is good to have.
Experience in the public sector is a bonu
We are an equal opportunity employer and value diversity at our company as we believe that diversity is meaningful to innovation. Our employee benefits are based on a total rewards approach, offering a holistic and marketcompetitive suite of perks. This includes generous leave benefits to meet your worklife needs. We trust that you will get the job done wherever you are, and whatever works best for you so work from home or take a break to exercise if you need to*. We also believe it's important for you to keep honing your craft in the constantlyevolving tech landscape, so we provide and support a plethora of inhouse and external learning and development opportunities all year round _

- *Subject to the nature of your job role that might require you to be onsite during fixed hours_