Data Engineer - Singapore - AVENSYS CONSULTING PTE. LTD.

AVENSYS CONSULTING PTE. LTD. Singapore

1 week ago

Description

Roles & Responsibilities

Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation, and managed services. Given our decade of success, we have evolved to become one of the top trusted providers in Singapore and service a client base across banking and financial services, insurance, information technology, healthcare, retail, and supply chain.

We are currently looking to hire a Data Engineer. This is an exciting opportunity to expand your skill set, and achieve job satisfaction and work-life balance. More details as below.

We are seeking a highly skilled Data Engineer with a strong background to join our dynamic team.

Responsibilities:

Data Pipeline Development: Develop and maintain data pipelines that extract, transform, and load (ETL) data from various sources into a centralized data storage system, such as a data warehouse or data lake.
Data Integration: Integrate data from multiple sources and systems, including databases, APIs, log files, streaming platforms, and external data providers.
Data Transformation and Processing: Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare the data for analysis, reporting, or machine learning tasks.
Contribute to common frameworks and best practices in code development, deployment, and automation/orchestration of data pipelines.
Implement data governance in line with company standards.
Partner with Data Analytics and Product leaders to design best practices and standards for developing and productionalising analytic pipelines.
Partner with Infrastructure leaders on architecture approaches to advance the data and analytics platform, including exploring new tools and techniques that leverage the cloud environment (Azure, Databricks, others).
Monitoring and Support: Monitor data pipelines and data systems to detect and resolve issues promptly. Develop monitoring tools, alerts, and automated error handling mechanisms to ensure data integrity and system reliability.

Requirements:

Must haves

Proven experience as a Data Engineering role (3 years +), with a strong track record of delivering scalable data pipelines.
Extensive experience designing data solutions including data modelling is required.
Extensive hands-on experience developing data processing jobs (PySpark / SQL) that demonstrate a strong understanding of software engineering principles is needed.
Experience orchestrating data pipelines using technology like ADF, Airflow etc is necessary.
Experience working with both real-time and batch data is important.
Experience building data pipelines on Azure is crucial. AWS data pipelines will be beneficial.
Fluency in SQL (any flavour), with experience using Window functions and more advanced features is required.
Understanding of DevOps tools, Git workflow and building CI/CD pipelines is essential.

Nice to Have

Domain knowledge of commodities, covering Sales, Trading, Risk, Supply Chain, Customer Interaction, etc. is highly desirable.
Familiarity with Scrum methodology and experience working in a Scrum team can be advantageous. This includes understanding of Scrum roles, events, artifacts, and rules, and the ability to apply them in a practical context.
Experience with streaming data processing technologies such as Apache Kafka, Apache Flink, or AWS Kinesis can be beneficial. This includes the ability to design and implement real-time data processing pipelines.

WHAT'S ON OFFER

You will be remunerated with an excellent base salary and entitled to attractive company benefits. Additionally, you will get the opportunity to enjoy a fun and collaborative work environment, alongside a strong career progression.

To submit your application, please apply online or email your UPDATED CV in Microsoft Word format to - Your interest will be treated with strict confidentiality.

CONSULTANT DETAILS

Consultant Name: Meenakshi

Avensys Consulting Pte Ltd

EA License 12C5759

Privacy Statement: Data collected will be used for recruitment purposes only. Personal data provided will be used strictly in accordance with the relevant data protection law and Avensys' personal information and privacy policy.

Tell employers what skills you have

Machine Learning
PySpark
Business Intelligence
Azure
Pipelines
Data Structures
Data Transformation
Software Engineering
Data Integration
Data Governance
Reliability
Data Engineering
SQL
Data Analytics
Apache
Databases

Data Engineer

19 hours ago

Singapore Land Authority Singapore

**What the role is** · - The data engineer will work with stakeholders to execute the SLA Data Strategy · (3 Pillars: People, Process, Technology). · Job Scope: · - Plan and implement technology and policies to enhance organisational integration and responsiveness in data-driven ...
Data Engineers

1 day ago

Jobline Resources Pte Ltd Singapore

**Responsibilities**: · - Develop enterprise grade Data Products using Spark and other Big Data frameworks · - Benchmark existing solutions, identify gaps, and propose solutions to eliminate them · - Be able to work within a team of data engineers, data scientists, devops enginee ...
Data Engineer

1 day ago

Progression Search Singapore

**CLIENT SUMMARY** · Our client is an innovative start-up specializing in ESG data collection & reporting. They offer a modular & customizable ESG Platform for the Financial Sector, Supply Chains, Corporate Sustainability and Investment Funds. · We are looking for a skilled Data ...
Data Engineer

19 hours ago

NodeFlair Singapore

**Job Summary**: · **Salary** · S$4,000 - S$5,500 / Monthly · **Job Type** · **Seniority** · Junior · **Years of Experience** · At least 1 year · **Tech Stacks** · ETL Informatica Analytics SSIS Talend MSSQL SQL PostgreSQL MySQL Python · **What is a Data Engineer?** · The role of ...
Data Engineer

1 day ago

ANTAES ASIA PTE. LTD. Singapore

Contribute to IT projects in the Energy industry for Antaes clients · - The Data Engineer is responsible for developing methods that transform raw data from different sources into useful, consistent, and machine-readable formats · - The Data Engineer will also develop, test, and ...
Data Engineer

19 hours ago

NodeFlair Singapore

**Job Summary**: · **Salary** · S$7,000 - S$9,500 / Monthly · **Job Type** · **Seniority** · Senior · **Years of Experience** · At least 6 years · **Tech Stacks** · Amazon RDS Strategy ETL RDS Amazon S3 Snowflake AWS Kinesis CI Glue BigQuery RedShift Shell Apache UNIX Git Spark P ...
Data Engineer

1 day ago

CDG ZIG PTE. LTD. Singapore

In this role, the Data Engineer will be exposed to many aspects of data collection and data pipeline to serve stakeholders requirements. Stakeholders can range from Business Analysts, Product Analysts, Data Analyst to Data Scientists who need datasets for modelling, visualization ...
Data Engineer

19 hours ago

INFOCEPTS PTE. LTD. Singapore

**What is a Data Engineer? · The role of a data engineer can be defined as someone who has the knowledge and skills to design and build systems for collecting, storing and analyzing data at scale. · **Roles and Responsibilities**: · - Drive the maintenance of data engineering pip ...
Data Engineer

1 day ago

INFOCEPTS PTE. LTD. Singapore

**What is a Data Engineer? · The role of a data engineer can be defined as someone who has the knowledge and skills to design and build systems for collecting, storing and analyzing data at scale. · **Roles and Responsibilities**: · - Drive the maintenance of data engineering pip ...
Data Engineer

19 hours ago

NTT SINGAPORE PTE. LTD. Singapore

**Project Summary** · - Work closely with business (research analysts, quantitative strategist, end-users, etc), data engineers, data scientists to implement and support data solutions that support common functions in the data lifecycle, e.g. data onboarding and data distribution ...
Data Engineer

19 hours ago

ZENITH INFOTECH (S) PTE LTD. Singapore

Data Engineer · This is a 12 months contract assinged to our client · Work Location: To be confirmed · Salary Range : $6,000-$9,500 · **Job Description**: · 1. Data Engineer with hands on programming skills using Python, Spark, ETL pipeline related such as · Kafka, airflow. · 2. ...
Data Engineer

19 hours ago

ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Singapore

Astek is offering a role of Data Engineer to be based in Singapore. · **Responsibilities**: · - You will be supporting data engineering activities for Data Warehouse. · - Build data systems and pipelines · - Evaluate business needs and objectives · - Interpret trends and patterns ...
Data Engineer

1 day ago

IOT SPECIALIST RECRUITMENT PTE. LTD. Singapore

We are working with an emerging e-commerce start-up to look for a Data Engineer. This will be an exciting opportunity to be part of a rapidly scaling start-up up. · **Responsibilities** · - Establish AWS Cloud data infrastructure · - Ensure the security of data infrastructure · - ...
Data Engineer

1 day ago

Nanyang Technological University Singapore

The Insurance Risk and Finance Research Centre (IRFRC) at the Nanyang Business School (NBS), Nanyang Technological University (NTU) is looking for an experienced Data Engineer to join the team. · Key Responsibilities: · - Co-evaluate business needs and objectives.- Build IT/data ...
Data Engineer

1 day ago

Unison Consulting Pte Ltd Singapore

Role: Data Engineer · - Title: BAU Team Lead · - Responsibility: · - Lead BAU team who works on all post-production activities including data platform monitoring, platform improvement, external team request handling ETL pipeline building, access control, Etc · - Required skills: ...
Data Engineer

19 hours ago

SEDHA CONSULTING PTE. LTD. Singapore

**Reporting and Analytics Developer/Data Engineer**: · **Responsibilities** · - Analyse the company's data needs and document the requirements. · - Refine data collection/consumption by migrating data collection to more efficient channels. · - Plan, design and implement data engi ...
Data Engineer

1 day ago

CXC Global Singapore

This is a permanent role for a leading global technology organization with a strong APAC presence. Due to evolving business, the organization is undergoing an exciting transformation journey and is aiming to become a data-driven decision-making organization. This is an outstandin ...
Data Engineer

19 hours ago

Capgemini Singapore

**Responsibilities**: · - Develop enterprise grade Data Products using Spark and other Big Data frameworks · - Benchmark existing solutions, identify gaps, and propose solutions to eliminate them · - Be able to work within a team of data engineers, data scientists, Devops enginee ...
Data Engineer

19 hours ago

Rapsys Technologies Singapore

Responsibilities: · - Develop enterprise grade Data Products using Spark and other Big Data frameworks · - Benchmark existing solutions, identify gaps, and propose solutions to eliminate them · - Be able to work within a team of data engineers, data scientists, Devops engineers, ...
Data Engineer

1 day ago

IHiS Singapore

**Date**:18 Jul 2023 · **Location**: SG · **Company**:Synapxe · At TRUST, we believe in the power of data to transform health and healthcare research. We provide the platform to enable access to anonymised real-world datasets to support health data analytics and innovation. · We ...