Software Developer(Back-end Development) - Singapore - WSH Experts Pte Ltd

WSH Experts Pte Ltd

Verified Company

Singapore

3 weeks ago

Posted by:

Wei Jie

beBee Recruiter

Description

Published- March 18, 2023- Location- Singapore, Singapore- Job Type- Full-time
Description:

Job Description & Requirements:

Responsibilities
(a) Big Data Ingestion

Extract (taking the data from its current location).
Transform (cleansing and normalizing the data).
Load (placing the data in a database where it can be analysed).

(b) Big Data Aggregation.

(c) Application Deployment and Testing.

(d) Security Vulnerability Fixing.

Big Data Ingestion

Transform: Different data structures from different platforms are to be analysed and ingested into the appropriate structure so that data aggregation is made possible.
Load: Development of schedule job/task is needed to run daily ingestion of different platforms at different time.
Performance tuning is required to balance out the system resources and MongoDB database.

Big Data Aggregation

High proficiency and indepth knowledge of MongoDB is required.
MongoDB aggregation pipeline knowledge is a must, to perform big data aggregation of various data sources.
Complex and complicated BI business logic are to be translated into MongoDB aggregation pipeline.
Performance tuning is needed to fine tune the time taken to compile the daily aggregated data from the big data.
Data Accuracy is to be ensured for the compiled aggregated data.

Application Deployment and Testing

Performance and functional testing is to be carried out. Any discovered issue is to be fixed or fine tune before the launch.
Deployment is needed to be carried out in AWS which is our cloud solution provider.

Security Vulnerability Fixing

All security vulnerabilities are to be fixed before the actual launch.

Requirements:

The requirement specification comprises of back-end development and the big data aggregation pipeline development.

Programming skillset required