- Focuses on DataOps from ingesting to deployment. Portfolio to be requested here.
- Maintain and enhance trading pipelines.
- Combine various data sources via API or scraping into a singular source of truth.
- Develop feature store and automate features cleaning, processing, engineering, and monitoring of drifts.
- Develop data lineage of each feature and also ensuring features integrity with data fingerprinting techniques.
- Work with batch and streaming data and reduce anomalies in data or gaps in different financial data sources.
- Build, maintain, enhance data pipelines using DataOps, MLOps and AIOps frameworks.
- Work with full suite of data and model infrastructure and integration i.e. SageMaker Studio
- Bachelor's in relavent qualifications or above.
- Must have languages: Python, SQL & NoSQL
- Must have database experiences: Mapreduce, Partitioning, Spark etc.
- Must have data ingestion tools: Kafka, Flume or Sqoop etc.
- Must have data management experiences: Feature Store, Engineering Reproducibility etc.
- Must have testing experiences: Unit Tests, Errors Handling to ensure trading system remains fault tolerance and robust
- Must have orchestration tools: DAGs in Airflow or Prefect, MLFlow
- Must have deployment experiences: Docker, AWS S3, Lambda etc
- Extremely good to have languages: C, C# C++, Java
- Extremely good to have capabilities: Scripting in vim, Neo4j
-
Data Engineer, Data Engineering
3 weeks ago
Bank of Singapore SingaporeAt Bank of Singapore, we are constantly on the lookout for exceptional individuals to join our team. We promote a culture of openness, teamwork and fairness. Most importantly, we invest in our people through our programmes that develop them on both professional and personal level ...
-
Data Engineer
1 week ago
WOH HUP (PRIVATE) LIMITED Singapore**Job description**:Woh Hup Digital and IT department is looking for an accountable, multitalented data engineer to facilitate the operations of our data analytics and data science efforts. The data engineer will be responsible for employing machine learning techniques to create ...
-
Data Engineer
2 weeks ago
NodeFlair Singapore**Job Summary**: · **Salary** · S$4,500 - S$5,800 / Monthly · **Job Type** · **Seniority** · Junior · **Years of Experience** · At least 2 years · **Tech Stacks** · ETL Informatica Analytics Talend MSSQL SQL PostgreSQL MySQL Python · **What is a Data Engineer?** · The role of a d ...
-
Data Engineer
1 week ago
REAL ESTATE ANALYTICS PTE. LTD. Singapore**Key Responsibilities** · - Spearhead the development of systems, architectures, and platforms that can scale to the 3 Vs of Big data (Volume, Velocity, Variety) · - Build out scalable and reliable ETL pipelines and processes to ingest data from a large number and variety of dat ...
-
Data Engineer
2 weeks ago
Meta SingaporeEvery month, billions of people leverage Facebook products to connect with friends and loved ones from across the world. On the Data Engineering team, our mission is to support these products both internally and externally by delivering the best data foundation that drives impact ...
-
Data Engineer
2 weeks ago
ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. SingaporeAstek is proposing an opportunity for **Data Engineer (Lexical Search) **to support our project based in **Singapore. · **Responsibilities** · - Acquire datasets that align with business needs · - Develop algorithms to transform data into useful, actionable information · - Build, ...
-
Data Engineer
3 weeks ago
CDG ZIG PTE. LTD. SingaporeIn this role, the Data Engineer will be exposed to many aspects of data collection and data pipeline to serve stakeholders requirements. Stakeholders can range from Business Analysts, Product Analysts, Data Analyst to Data Scientists who need datasets for modelling, visualization ...
-
Data Engineer
2 weeks ago
ScienTec Consulting Singapore**Data Engineer** · **Job Brief** · We are looking for Data Engineer to join our team of analytics experts. The hire will be responsible for expanding and optimising data and data pipeline architecture, as well as optimising data flow and collect for cross-function teams. Data En ...
-
Data Engineer
3 weeks ago
INFOCEPTS PTE. LTD. Singapore**What is a Data Engineer? · The role of a data engineer can be defined as someone who has the knowledge and skills to design and build systems for collecting, storing and analyzing data at scale. · **Roles and Responsibilities**: · - Drive the maintenance of data engineering pip ...
-
Data Engineer
3 weeks ago
INFOCEPTS PTE. LTD. Singapore**What is a Data Engineer? · The role of a data engineer can be defined as someone who has the knowledge and skills to design and build systems for collecting, storing and analyzing data at scale. · **Roles and Responsibilities**: · - Drive the maintenance of data engineering pip ...
-
Data Engineer
1 week ago
WSH EXPERTS PTE LTD SingaporeJob Description & Requirements · **Responsibilities**: · To handle infrastructure set-up, Cloud engineering and deployment of AI/machine learning models · Review technical solutions for the deployment of AI models, along with the data pipelines and visualization interfaces · Util ...
-
Data Engineer
2 weeks ago
1-FINITY CONSULTING PTE. LTD. SingaporeDevOps Batch engineer: · - Develop and maintain batch processing pipelines using Airflow · - Work with data engineers to design and implement data processing solutions · - Troubleshoot and debug batch processing pipelines · - Automate data processing tasks · - Monitor and report ...
-
Data Engineer
3 weeks ago
SEDHA CONSULTING PTE. LTD. Singapore**Reporting and Analytics Developer/Data Engineer**: · **Responsibilities** · - Analyse the company's data needs and document the requirements. · - Refine data collection/consumption by migrating data collection to more efficient channels. · - Plan, design and implement data engi ...
-
Data Engineer
3 weeks ago
ONYX SG PTE. LTD. Singapore**JOB DESCRIPTION** · Group Data team of a global asset manager with AUM of USD$35 Bn, with a diverse portfolio of alternative investments, currently seeking for a seasoned Data Engineer to join their expanding team. As a Data Engineer, you will play a crucial role in shaping the ...
-
Data Engineer
3 weeks ago
ANTAES ASIA PTE. LTD. SingaporeContribute to IT projects in the Energy industry for Antaes clients · - The Data Engineer is responsible for developing methods that transform raw data from different sources into useful, consistent, and machine-readable formats · - The Data Engineer will also develop, test, and ...
-
Data Engineer
3 weeks ago
Rapsys Technologies SingaporeResponsibilities: · - Develop enterprise grade Data Products using Spark and other Big Data frameworks · - Benchmark existing solutions, identify gaps, and propose solutions to eliminate them · - Be able to work within a team of data engineers, data scientists, Devops engineers, ...
-
Data Engineer
3 weeks ago
Unison Consulting Pte Ltd SingaporeIntegrate Elasticsearch with Spark to enable efficient indexing, querying, and retrieval of data · - Optimize and tune Spark jobs for performance and scalability, ensuring efficient data processing and indexing in Elasticsearch · - Collaborate with data engineers, data scientists ...
-
Data Engineer
2 weeks ago
NextWave Partners SingaporeLocation: · - Singapore- Job Type: · - Permanent- Discipline: · - Data, AI & Analytics- Salary: · - Negotiable- Contact: · - KarMun Cheah**Title**: Data Engineer · **Location**: Singapore (Changi) / Hybrid Working · **About the Role** · - Sustainable focused transport-tech organi ...
-
Data Engineer
1 week ago
DATAHONDO PTE. LTD. Singapore**Responsibilities**: · - Design, develop, and implement data pipelines and ETL processes to extract, transform, and load data from various sources into the data warehouse or data lake. · - Collaborate with data scientists and analysts to understand their requirements and transla ...
-
Data Engineer
2 weeks ago
Shopee SingaporeDepartmentEngineering and Technology- LevelEntry Level- LocationSingaporeThe Engineering and Technology team is at the core of the Shopee platform development. The team is made up of a group of passionate engineers from all over the world, striving to build the best systems with ...
Senior Data Engineer - Singapore - Technology Services Group Pte. Ltd.
Description
Job Responsibilities:
Job Requirements:
..Salary will be commensurate with the candidate's level of experience and qualifications, reflecting our commitment to equitable compensation practices