- Focuses on DataOps from ingesting to deployment. Portfolio to be requested here.
- Maintain and enhance trading pipelines.
- Combine various data sources via API or scraping into a singular source of truth.
- Develop feature store and automate features cleaning, processing, engineering, and monitoring of drifts.
- Develop data lineage of each feature and also ensuring features integrity with data fingerprinting techniques.
- Work with batch and streaming data and reduce anomalies in data or gaps in different financial data sources.
- Build, maintain, enhance data pipelines using DataOps, MLOps and AIOps frameworks.
- Work with full suite of data and model infrastructure and integration i.e. SageMaker Studio
- Part of a sub-team focusing on full autonomous AI Trading under a larger trading division.
- Bachelor's and above
- Must have languages: Python, SQL & NoSQL
- Must have database experiences: Mapreduce, Partitioning, Spark etc.
- Must have data ingestion tools: Kafka, Flume or Sqoop etc.
- Must have data management experiences: Feature Store, Engineering Reproducibility etc.
- Must have testing experiences: Unit Tests, Errors Handling to ensure trading system remains fault tolerance and robust
- Must have orchestration tools: DAGs in Airflow or Prefect, MLFlow
- Must have deployment experiences: Docker, AWS S3, Lambda etc
- Extremely good to have languages: C, C# C++, Java
- Extremely good to have capabilities: Scripting in vim, Neo4j
-
Data Engineer
12 hours ago
NodeFlair Singapore**Job Summary**: · **Salary** · S$4,500 - S$5,800 / Monthly · **Job Type** · **Seniority** · Junior · **Years of Experience** · At least 2 years · **Tech Stacks** · ETL Informatica Analytics Talend MSSQL SQL PostgreSQL MySQL Python · **What is a Data Engineer?** · The role of a d ...
-
Data Engineer
1 day ago
SEDHA CONSULTING PTE. LTD. Singapore**Reporting and Analytics Developer/Data Engineer**: · **Responsibilities** · - Analyse the company's data needs and document the requirements. · - Refine data collection/consumption by migrating data collection to more efficient channels. · - Plan, design and implement data engi ...
-
Data Engineer
1 day ago
Rapsys Technologies SingaporeResponsibilities: · - Develop enterprise grade Data Products using Spark and other Big Data frameworks · - Benchmark existing solutions, identify gaps, and propose solutions to eliminate them · - Be able to work within a team of data engineers, data scientists, Devops engineers, ...
-
Data Engineer
12 hours ago
ZENITH INFOTECH (S) PTE LTD. SingaporePresently we have a Job Opening for a Data Engineer position · - Leverage your understanding of complex data analysis and modeling to ensure project teams and clients can successfully extract value from their data. Support hypothesis generation and testing, exploratory analysis, ...
-
Data Engineer
1 day ago
AZENDIAN SingaporeData Engineer · Full Time · Singapore · **What We Do Matters**: · Azendian Solutions is an Artificial Intelligence, data science solutions and operations technology startup, contributing to smart city solutions with a current focus on Education and the Built Environment. · We als ...
-
Data Engineer
12 hours ago
MAXEON SOLAR PTE. LTD. SingaporeMaxeon Solar Technologies is a global leader in solar innovation. Built from 35 years of boundary-pushing solar innovation, Maxeon designs, manufactures, and sells industry leading SunPower branded solar products. Maxeon is Powering Positive ChangeTM every day with a brilliant, p ...
-
Data Engineer
12 hours ago
UARROW PTE. LTD. SingaporeRoles & Responsibilities · - Build and optimizing 'big data' data pipelines, architectures and data sets. · - Performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement. · - To suppor ...
-
Data Engineer
1 day ago
Singapore Land Authority Singapore**What the role is** · - The data engineer will work with stakeholders to execute the SLA Data Strategy · (3 Pillars: People, Process, Technology). · Job Scope: · - Plan and implement technology and policies to enhance organisational integration and responsiveness in data-driven ...
-
Data Engineer
1 day ago
ANTAES ASIA PTE. LTD. SingaporeContribute to IT projects in the Energy industry for Antaes clients · - The Data Engineer is responsible for developing methods that transform raw data from different sources into useful, consistent, and machine-readable formats · - The Data Engineer will also develop, test, and ...
-
Data Engineer
1 day ago
Progression Search Singapore**CLIENT SUMMARY** · Our client is an innovative start-up specializing in ESG data collection & reporting. They offer a modular & customizable ESG Platform for the Financial Sector, Supply Chains, Corporate Sustainability and Investment Funds. · We are looking for a skilled Data ...
-
Data Engineer
1 day ago
NodeFlair Singapore**Job Summary**: · **Salary** · S$4,000 - S$5,500 / Monthly · **Job Type** · **Seniority** · Junior · **Years of Experience** · At least 1 year · **Tech Stacks** · ETL Informatica Analytics SSIS Talend MSSQL SQL PostgreSQL MySQL Python · **What is a Data Engineer?** · The role of ...
-
Data Engineer
1 day ago
CDG ZIG PTE. LTD. SingaporeIn this role, the Data Engineer will be exposed to many aspects of data collection and data pipeline to serve stakeholders requirements. Stakeholders can range from Business Analysts, Product Analysts, Data Analyst to Data Scientists who need datasets for modelling, visualization ...
-
Data Engineer
12 hours ago
SAKSOFT PTE LIMITED SingaporeExperience: 1 to 9 Years · Role: Data Engineer · Key Responsibilities: · - Integrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data · - Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and ind ...
-
Data Engineer
1 day ago
NTT SINGAPORE PTE. LTD. Singapore**Project Summary** · - Work closely with business (research analysts, quantitative strategist, end-users, etc), data engineers, data scientists to implement and support data solutions that support common functions in the data lifecycle, e.g. data onboarding and data distribution ...
-
Data Engineer
1 day ago
INFOCEPTS PTE. LTD. Singapore**What is a Data Engineer? · The role of a data engineer can be defined as someone who has the knowledge and skills to design and build systems for collecting, storing and analyzing data at scale. · **Roles and Responsibilities**: · - Drive the maintenance of data engineering pip ...
-
Data Engineer
12 hours ago
ScienTec Consulting Singapore**We are looking for a Data Engineer looking to make an impact by contributing to nation-wide initiatives.** · - Opportunity to work on large scale data science projects. · - Flexible work arrangements. · - Attractive remuneration package. · **Responsibilities**: · - Support data ...
-
Data Engineer
12 hours ago
Tata Consultancy Services Singapore**Required Qualifications**: · - At least 8+ years of strong data warehousing experience using RDBMS and Non-RDBMS databases. · - At least 5 years of recent hands-on professional experience (actively coding) working as a data engineer (back-end software engineer considered). · - ...
-
Data Engineer
1 day ago
INFOCEPTS PTE. LTD. Singapore**What is a Data Engineer? · The role of a data engineer can be defined as someone who has the knowledge and skills to design and build systems for collecting, storing and analyzing data at scale. · **Roles and Responsibilities**: · - Drive the maintenance of data engineering pip ...
-
Data Engineer
1 day ago
ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. SingaporeAstek is offering a role of Data Engineer to be based in Singapore. · **Responsibilities**: · - You will be supporting data engineering activities for Data Warehouse. · - Build data systems and pipelines · - Evaluate business needs and objectives · - Interpret trends and patterns ...
-
Data Engineer
1 day ago
Nanyang Technological University SingaporeThe Insurance Risk and Finance Research Centre (IRFRC) at the Nanyang Business School (NBS), Nanyang Technological University (NTU) is looking for an experienced Data Engineer to join the team. · Key Responsibilities: · - Co-evaluate business needs and objectives.- Build IT/data ...
Senior Data Engineer - Singapore - TECHNOLOGY SERVICES GROUP PTE. LTD.
Description
Roles & ResponsibilitiesOur company is at the forefront of innovation in financial technology. Our mission is to develop an AI-driven platform that predicts market trends, empowering retail investors with the tools previously only accessible to professionals. We're looking for a talented Senior Data Engineer with an interest in finance to join our growing team in our Singapore office.
Responsibilities:
Requirements:
Airflow
Pipelines
SageMaker
Data Management
Scripting
MapReduce
Trading System
SQL
Python
Docker
Java
C#
Orchestration
API
S3
C++