Jobs

    Senior Data Engineer(Level 3) - Singapore - AVENSYS CONSULTING PTE. LTD.

    AVENSYS CONSULTING PTE. LTD.
    AVENSYS CONSULTING PTE. LTD. Singapore

    6 days ago

    Default job background
    Description
    Roles & Responsibilities

    Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation, and managed services. Given our decade of success, we have evolved to become one of the top trusted providers in Singapore and service a client base across banking and financial services, insurance, information technology, healthcare, retail, and supply chain.

    We are currently looking to hire a Data Engineer. This is an exciting opportunity to expand your skill set, and achieve job satisfaction and work-life balance. More details as below.

    We are seeking a highly skilled Data Engineer with a strong background to join our dynamic team.

    Responsibilities:

    Data Pipeline Development: Develop and maintain data pipelines that extract, transform, and load (ETL) data from various sources into a centralized data storage system, such as a data warehouse or data lake.
    Data Integration: Integrate data from multiple sources and systems, including databases, APIs, log files, streaming platforms, and external data providers.
    Data Transformation and Processing: Develop data transformation routines to clean, normalize, and aggregate data. Apply data processing techniques to handle complex data structures, handle missing or inconsistent data, and prepare the data for analysis, reporting, or machine learning tasks.
    Contribute to common frameworks and best practices in code development, deployment, and automation/orchestration of data pipelines.
    Implement data governance in line with company standards.
    Partner with Data Analytics and Product leaders to design best practices and standards for developing and productionalising analytic pipelines.
    Partner with Infrastructure leaders on architecture approaches to advance the data and analytics platform, including exploring new tools and techniques that leverage the cloud environment (Azure, Databricks, others).
    Monitoring and Support: Monitor data pipelines and data systems to detect and resolve issues promptly. Develop monitoring tools, alerts, and automated error handling mechanisms to ensure data integrity and system reliability.

    Requirements:

    Must haves

    Proven experience as a Data Engineering role (4 years +), with a strong track record of delivering scalable data pipelines.
    Extensive experience designing data solutions including data modelling is required.
    Extensive hands-on experience developing data processing jobs (PySpark / SQL) that demonstrate a strong understanding of software engineering principles is needed.
    Experience orchestrating data pipelines using technology like ADF, Airflow etc is necessary.
    Experience working with both real-time and batch data is important.
    Experience building data pipelines on Azure is crucial. AWS data pipelines will be beneficial.
    Fluency in SQL (any flavour), with experience using Window functions and more advanced features is required.
    Understanding of DevOps tools, Git workflow and building CI/CD pipelines is essential.

    Nice to Have

    Domain knowledge of commodities, covering Sales, Trading, Risk, Supply Chain, Customer Interaction, etc. is highly desirable.
    Familiarity with Scrum methodology and experience working in a Scrum team can be advantageous. This includes understanding of Scrum roles, events, artifacts, and rules, and the ability to apply them in a practical context.
    Experience with streaming data processing technologies such as Apache Kafka, Apache Flink, or AWS Kinesis can be beneficial. This includes the ability to design and implement real-time data processing pipelines.

    WHAT'S ON OFFER

    You will be remunerated with an excellent base salary and entitled to attractive company benefits. Additionally, you will get the opportunity to enjoy a fun and collaborative work environment, alongside a strong career progression.

    To submit your application, please apply online or email your UPDATED CV in Microsoft Word format to - Your interest will be treated with strict confidentiality.

    CONSULTANT DETAILS

    Consultant Name: Meenakshi

    Avensys Consulting Pte Ltd

    EA License 12C5759

    Privacy Statement: Data collected will be used for recruitment purposes only. Personal data provided will be used strictly in accordance with the relevant data protection law and Avensys' personal information and privacy policy.

    Tell employers what skills you have

    Machine Learning
    PySpark
    Business Intelligence
    Azure
    Pipelines
    Data Structures
    Data Transformation
    Software Engineering
    Data Integration
    Data Governance
    Reliability
    Data Engineering
    SQL
    Data Analytics
    Apache
    Databases
  • ZENITH INFOTECH (S) PTE LTD.

    Data Engineer

    8 hours ago

    ZENITH INFOTECH (S) PTE LTD. Singapore

    Data Engineer · This is a 12 months contract assinged to our client · Work Location: To be confirmed · Salary Range : $6,000-$9,500 · **Job Description**: · 1. Data Engineer with hands on programming skills using Python, Spark, ETL pipeline related such as · Kafka, airflow. · 2. ...

  • Unison Consulting Pte Ltd

    Data Engineer

    22 hours ago

    Unison Consulting Pte Ltd Singapore

    Role: Data Engineer · - Title: BAU Team Lead · - Responsibility: · - Lead BAU team who works on all post-production activities including data platform monitoring, platform improvement, external team request handling ETL pipeline building, access control, Etc · - Required skills: ...

  • CDG ZIG PTE. LTD.

    Data Engineer

    22 hours ago

    CDG ZIG PTE. LTD. Singapore

    In this role, the Data Engineer will be exposed to many aspects of data collection and data pipeline to serve stakeholders requirements. Stakeholders can range from Business Analysts, Product Analysts, Data Analyst to Data Scientists who need datasets for modelling, visualization ...

  • INFOCEPTS PTE. LTD.

    Data Engineer

    8 hours ago

    INFOCEPTS PTE. LTD. Singapore

    **What is a Data Engineer? · The role of a data engineer can be defined as someone who has the knowledge and skills to design and build systems for collecting, storing and analyzing data at scale. · **Roles and Responsibilities**: · - Drive the maintenance of data engineering pip ...

  • INFOCEPTS PTE. LTD.

    Data Engineer

    22 hours ago

    INFOCEPTS PTE. LTD. Singapore

    **What is a Data Engineer? · The role of a data engineer can be defined as someone who has the knowledge and skills to design and build systems for collecting, storing and analyzing data at scale. · **Roles and Responsibilities**: · - Drive the maintenance of data engineering pip ...

  • Singapore Land Authority

    Data Engineer

    8 hours ago

    Singapore Land Authority Singapore

    **What the role is** · - The data engineer will work with stakeholders to execute the SLA Data Strategy · (3 Pillars: People, Process, Technology). · Job Scope: · - Plan and implement technology and policies to enhance organisational integration and responsiveness in data-driven ...

  • CXC Global

    Data Engineer

    22 hours ago

    CXC Global Singapore

    This is a permanent role for a leading global technology organization with a strong APAC presence. Due to evolving business, the organization is undergoing an exciting transformation journey and is aiming to become a data-driven decision-making organization. This is an outstandin ...

  • Capgemini

    Data Engineer

    8 hours ago

    Capgemini Singapore

    **Responsibilities**: · - Develop enterprise grade Data Products using Spark and other Big Data frameworks · - Benchmark existing solutions, identify gaps, and propose solutions to eliminate them · - Be able to work within a team of data engineers, data scientists, Devops enginee ...

  • Progression Search

    Data Engineer

    22 hours ago

    Progression Search Singapore

    **CLIENT SUMMARY** · Our client is an innovative start-up specializing in ESG data collection & reporting. They offer a modular & customizable ESG Platform for the Financial Sector, Supply Chains, Corporate Sustainability and Investment Funds. · We are looking for a skilled Data ...

  • NodeFlair

    Data Engineer

    8 hours ago

    NodeFlair Singapore

    **Job Summary**: · **Salary** · S$4,000 - S$5,500 / Monthly · **Job Type** · **Seniority** · Junior · **Years of Experience** · At least 1 year · **Tech Stacks** · ETL Informatica Analytics SSIS Talend MSSQL SQL PostgreSQL MySQL Python · **What is a Data Engineer?** · The role of ...

  • SMRT Corporation Ltd

    Data Engineer

    22 hours ago

    SMRT Corporation Ltd Singapore

    Data Engineer · **Job Purpose** · - We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data into useful data systems. For example, you will create and maintain optimal data pipelines architecture in cloud. Overall, you ...

  • SEDHA CONSULTING PTE. LTD.

    Data Engineer

    8 hours ago

    SEDHA CONSULTING PTE. LTD. Singapore

    **Reporting and Analytics Developer/Data Engineer**: · **Responsibilities** · - Analyse the company's data needs and document the requirements. · - Refine data collection/consumption by migrating data collection to more efficient channels. · - Plan, design and implement data engi ...

  • Elitez Asia Vietnam

    Data Engineer

    22 hours ago

    Elitez Asia Vietnam Singapore

    **About the job** · The company is a start-up aspiring to be Singapore's Digital Transformation champion, with a mission to empower Singapore's Smart Nation across public and private sectors and enhance the lives of citizens. · Their services span from strategic advisory through ...

  • Rapsys Technologies

    Data Engineer

    8 hours ago

    Rapsys Technologies Singapore

    Responsibilities: · - Develop enterprise grade Data Products using Spark and other Big Data frameworks · - Benchmark existing solutions, identify gaps, and propose solutions to eliminate them · - Be able to work within a team of data engineers, data scientists, Devops engineers, ...

  • NTT SINGAPORE PTE. LTD.

    Data Engineer

    8 hours ago

    NTT SINGAPORE PTE. LTD. Singapore

    **Project Summary** · - Work closely with business (research analysts, quantitative strategist, end-users, etc), data engineers, data scientists to implement and support data solutions that support common functions in the data lifecycle, e.g. data onboarding and data distribution ...

  • IHiS

    Data Engineer

    22 hours ago

    IHiS Singapore

    **Date**:18 Jul 2023 · **Location**: SG · **Company**:Synapxe · At TRUST, we believe in the power of data to transform health and healthcare research. We provide the platform to enable access to anonymised real-world datasets to support health data analytics and innovation. · We ...

  • TALENTSIS PTE. LTD.

    Data Engineer

    22 hours ago

    TALENTSIS PTE. LTD. Singapore

    **Job Description**: · - Be part of a team to build and maintain data systems or pipelines. · - Perform setup, installation, configuration, troubleshooting, and/or upgrade for COTS products. · - Develop or implement ways to improve data warehouses, data lakes, or equivalent platf ...

  • Nanyang Technological University

    Data Engineer

    22 hours ago

    Nanyang Technological University Singapore

    The Insurance Risk and Finance Research Centre (IRFRC) at the Nanyang Business School (NBS), Nanyang Technological University (NTU) is looking for an experienced Data Engineer to join the team. · Key Responsibilities: · - Co-evaluate business needs and objectives.- Build IT/data ...

  • Jobline Resources Pte Ltd

    Data Engineers

    22 hours ago

    Jobline Resources Pte Ltd Singapore

    **Responsibilities**: · - Develop enterprise grade Data Products using Spark and other Big Data frameworks · - Benchmark existing solutions, identify gaps, and propose solutions to eliminate them · - Be able to work within a team of data engineers, data scientists, devops enginee ...

  • ANTAES ASIA PTE. LTD.

    Data Engineer

    22 hours ago

    ANTAES ASIA PTE. LTD. Singapore

    Contribute to IT projects in the Energy industry for Antaes clients · - The Data Engineer is responsible for developing methods that transform raw data from different sources into useful, consistent, and machine-readable formats · - The Data Engineer will also develop, test, and ...