- Data Pipeline Development: Design, implement, and maintain scalable data pipelines for the extraction, transformation, and loading of large datasets.
- Data Modelling: Develop and optimize data models to support analytical and reporting requirements, ensuring data accuracy and reliability.
- Data Integration: Integrate diverse data sources and formats to enable seamless data flow across systems.
- Data Quality Assurance: Implement and monitor data quality checks to ensure the integrity of the data throughout the entire data lifecycle.
- Collaboration: Work closely with business analysts, colleagues and other stakeholders to understand data requirements and deliver effective solutions.
- Performance Optimization: Identify and address performance bottlenecks in data processing and storage systems.
- Documentation: Document data engineering processes, data models, and configurations for knowledge sharing and future reference.
- Adherence to Best Practices: Stay current with industry trends and best practices in data engineering within company and ensure the adoption of these practices within the team.
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- Minimum of 5 years of proven experience as a Data Engineer or similar role.
- Strong proficiency in programming languages such as Spark SQL and Python in a HIVE environment.
- Familiarity with cloud platforms such as AWS and Big Data infrastructure, Jira, Bitbucket, etc.
- Experience in CI/CD pipeline and working in an Agile environment.
- Excellent problem-solving skills and attention to detail.
- Strong communication and collaboration skills.
- Knowledge of data warehousing concepts and technologies.
- Candidates with experience in the Banking Industry will have an added advantage.
-
Cloud Engineer #IJW
2 weeks ago
RECRUIT EXPRESS PTE LTD SingaporeRoles & Responsibilities · Responsibilities: · Apply technical knowledge, hands-on and customer insights to operate and administrate a cloud infrastructure. · Ensure all configuration conforms to high levels of performance, security, scalability, maintainability, and appropriate ...
-
Data Engineer #IJW
2 weeks ago
RECRUIT EXPRESS PTE LTD SingaporeRoles & Responsibilities · Responsibilities: · Develop ETL processes to extract, transform, and load data from various sources into our data warehouse. · Develop and maintain scalable data pipelines for batch and real-time processing. · Collaboration with cross-functional teams t ...
Intermediate Data Engineer #IJW - Singapore - RECRUIT EXPRESS PTE LTD
![Recruit Express Pte Ltd background](https://contents.bebee.com/companies/sg/recruit-express-pte-ltd/background-b7irb.png)
Description
Roles & ResponsibilitiesResponsibilities:
Requirements:
Interested applicants, please Email , and look for
John (Joax) Wong
Recruit Express Pte Ltd
EA License No. 99C4599
EA Personnel Registration Number: R
Tell employers what skills you haveCSS
.NET
MySQL
Agile
JavaScript
HTML5
SQL
Python
Writing
Angular
Java
C#
API
Databases
Software Development
C++