Jobs

    Senior Data Engineer - Singapore - Technology Services Group Pte. Ltd.

    Technology Services Group Pte. Ltd.
    Default job background
    Full time
    Description

    Job Responsibilities:

    • Focuses on DataOps from ingesting to deployment. Portfolio to be requested here.
    • Maintain and enhance trading pipelines.
    • Combine various data sources via API or scraping into a singular source of truth.
    • Develop feature store and automate features cleaning, processing, engineering, and monitoring of drifts.
    • Develop data lineage of each feature and also ensuring features integrity with data fingerprinting techniques.
    • Work with batch and streaming data and reduce anomalies in data or gaps in different financial data sources.
    • Build, maintain, enhance data pipelines using DataOps, MLOps and AIOps frameworks.
    • Work with full suite of data and model infrastructure and integration i.e. SageMaker Studio

    Job Requirements:

    • Bachelor's in relavent qualifications or above.
    • Must have languages: Python, SQL & NoSQL
    • Must have database experiences: Mapreduce, Partitioning, Spark etc.
    • Must have data ingestion tools: Kafka, Flume or Sqoop etc.
    • Must have data management experiences: Feature Store, Engineering Reproducibility etc.
    • Must have testing experiences: Unit Tests, Errors Handling to ensure trading system remains fault tolerance and robust
    • Must have orchestration tools: DAGs in Airflow or Prefect, MLFlow
    • Must have deployment experiences: Docker, AWS S3, Lambda etc
    • Extremely good to have languages: C, C# C++, Java
    • Extremely good to have capabilities: Scripting in vim, Neo4j

    ..Salary will be commensurate with the candidate's level of experience and qualifications, reflecting our commitment to equitable compensation practices



  • Bank of Singapore Singapore

    At Bank of Singapore, we are constantly on the lookout for exceptional individuals to join our team. We promote a culture of openness, teamwork and fairness. Most importantly, we invest in our people through our programmes that develop them on both professional and personal level ...

  • WOH HUP (PRIVATE) LIMITED

    Data Engineer

    1 week ago


    WOH HUP (PRIVATE) LIMITED Singapore

    **Job description**:Woh Hup Digital and IT department is looking for an accountable, multitalented data engineer to facilitate the operations of our data analytics and data science efforts. The data engineer will be responsible for employing machine learning techniques to create ...

  • NodeFlair

    Data Engineer

    2 weeks ago


    NodeFlair Singapore

    **Job Summary**: · **Salary** · S$4,500 - S$5,800 / Monthly · **Job Type** · **Seniority** · Junior · **Years of Experience** · At least 2 years · **Tech Stacks** · ETL Informatica Analytics Talend MSSQL SQL PostgreSQL MySQL Python · **What is a Data Engineer?** · The role of a d ...

  • REAL ESTATE ANALYTICS PTE. LTD.

    Data Engineer

    1 week ago


    REAL ESTATE ANALYTICS PTE. LTD. Singapore

    **Key Responsibilities** · - Spearhead the development of systems, architectures, and platforms that can scale to the 3 Vs of Big data (Volume, Velocity, Variety) · - Build out scalable and reliable ETL pipelines and processes to ingest data from a large number and variety of dat ...

  • Meta

    Data Engineer

    2 weeks ago


    Meta Singapore

    Every month, billions of people leverage Facebook products to connect with friends and loved ones from across the world. On the Data Engineering team, our mission is to support these products both internally and externally by delivering the best data foundation that drives impact ...

  • ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD.

    Data Engineer

    2 weeks ago


    ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Singapore

    Astek is proposing an opportunity for **Data Engineer (Lexical Search) **to support our project based in **Singapore. · **Responsibilities** · - Acquire datasets that align with business needs · - Develop algorithms to transform data into useful, actionable information · - Build, ...

  • CDG ZIG PTE. LTD.

    Data Engineer

    3 weeks ago


    CDG ZIG PTE. LTD. Singapore

    In this role, the Data Engineer will be exposed to many aspects of data collection and data pipeline to serve stakeholders requirements. Stakeholders can range from Business Analysts, Product Analysts, Data Analyst to Data Scientists who need datasets for modelling, visualization ...

  • ScienTec Consulting

    Data Engineer

    2 weeks ago


    ScienTec Consulting Singapore

    **Data Engineer** · **Job Brief** · We are looking for Data Engineer to join our team of analytics experts. The hire will be responsible for expanding and optimising data and data pipeline architecture, as well as optimising data flow and collect for cross-function teams. Data En ...

  • INFOCEPTS PTE. LTD.

    Data Engineer

    3 weeks ago


    INFOCEPTS PTE. LTD. Singapore

    **What is a Data Engineer? · The role of a data engineer can be defined as someone who has the knowledge and skills to design and build systems for collecting, storing and analyzing data at scale. · **Roles and Responsibilities**: · - Drive the maintenance of data engineering pip ...

  • INFOCEPTS PTE. LTD.

    Data Engineer

    3 weeks ago


    INFOCEPTS PTE. LTD. Singapore

    **What is a Data Engineer? · The role of a data engineer can be defined as someone who has the knowledge and skills to design and build systems for collecting, storing and analyzing data at scale. · **Roles and Responsibilities**: · - Drive the maintenance of data engineering pip ...

  • WSH EXPERTS PTE LTD

    Data Engineer

    1 week ago


    WSH EXPERTS PTE LTD Singapore

    Job Description & Requirements · **Responsibilities**: · To handle infrastructure set-up, Cloud engineering and deployment of AI/machine learning models · Review technical solutions for the deployment of AI models, along with the data pipelines and visualization interfaces · Util ...

  • 1-FINITY CONSULTING PTE. LTD.

    Data Engineer

    2 weeks ago


    1-FINITY CONSULTING PTE. LTD. Singapore

    DevOps Batch engineer: · - Develop and maintain batch processing pipelines using Airflow · - Work with data engineers to design and implement data processing solutions · - Troubleshoot and debug batch processing pipelines · - Automate data processing tasks · - Monitor and report ...

  • SEDHA CONSULTING PTE. LTD.

    Data Engineer

    3 weeks ago


    SEDHA CONSULTING PTE. LTD. Singapore

    **Reporting and Analytics Developer/Data Engineer**: · **Responsibilities** · - Analyse the company's data needs and document the requirements. · - Refine data collection/consumption by migrating data collection to more efficient channels. · - Plan, design and implement data engi ...

  • ONYX SG PTE. LTD.

    Data Engineer

    3 weeks ago


    ONYX SG PTE. LTD. Singapore

    **JOB DESCRIPTION** · Group Data team of a global asset manager with AUM of USD$35 Bn, with a diverse portfolio of alternative investments, currently seeking for a seasoned Data Engineer to join their expanding team. As a Data Engineer, you will play a crucial role in shaping the ...

  • ANTAES ASIA PTE. LTD.

    Data Engineer

    3 weeks ago


    ANTAES ASIA PTE. LTD. Singapore

    Contribute to IT projects in the Energy industry for Antaes clients · - The Data Engineer is responsible for developing methods that transform raw data from different sources into useful, consistent, and machine-readable formats · - The Data Engineer will also develop, test, and ...

  • Rapsys Technologies

    Data Engineer

    3 weeks ago


    Rapsys Technologies Singapore

    Responsibilities: · - Develop enterprise grade Data Products using Spark and other Big Data frameworks · - Benchmark existing solutions, identify gaps, and propose solutions to eliminate them · - Be able to work within a team of data engineers, data scientists, Devops engineers, ...

  • Unison Consulting Pte Ltd

    Data Engineer

    3 weeks ago


    Unison Consulting Pte Ltd Singapore

    Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data · - Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch · - Collaborate with data engineers, data scientists ...

  • NextWave Partners

    Data Engineer

    2 weeks ago


    NextWave Partners Singapore

    Location: · - Singapore- Job Type: · - Permanent- Discipline: · - Data, AI & Analytics- Salary: · - Negotiable- Contact: · - KarMun Cheah**Title**: Data Engineer · **Location**: Singapore (Changi) / Hybrid Working · **About the Role** · - Sustainable focused transport-tech organi ...

  • DATAHONDO PTE. LTD.

    Data Engineer

    1 week ago


    DATAHONDO PTE. LTD. Singapore

    **Responsibilities**: · - Design, develop, and implement data pipelines and ETL processes to extract, transform, and load data from various sources into the data warehouse or data lake. · - Collaborate with data scientists and analysts to understand their requirements and transla ...

  • Shopee

    Data Engineer

    2 weeks ago


    Shopee Singapore

    DepartmentEngineering and Technology- LevelEntry Level- LocationSingaporeThe Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with ...