Senior Data Engineer - Central Singapore - BBGC

BBGC

Verified Company

Central Singapore

1 week ago

Posted by:

Wei Jie

beBee Recruiter

Job Description:
Senior Data Engineer

Key Responsibilities:

Design, develop, and maintain data pipelines and ETL processes to ingest, process, and transform large volumes of structured and unstructured data from multiple sources.
Collaborate with crossfunctional teams including data scientists, analysts, and software engineers to understand data requirements and implement solutions that meet business needs.
Optimize and tune data pipelines and workflows for performance, scalability, and reliability.
Implement data governance processes and ensure data quality and integrity throughout the data lifecycle.
Design and maintain data warehouse and data lake architectures to store and organize data for analytics and reporting purposes.
Research and evaluate new technologies and tools to enhance our data infrastructure and capabilities.
Provide technical leadership and mentorship to junior members of the data engineering team.
Collaborate with infrastructure and DevOps teams to deploy and manage data solutions in cloudbased environments.
Develop and maintain documentation for data pipelines, systems, and processes.

Qualifications:

Bachelor's degree or higher in Computer Science, Engineering, or a related field.
X+ years of experience in data engineering, with a proven track record of designing and implementing complex data solutions.
Proficiency in programming languages such as Python, Java, or Scala, and experience with data processing frameworks like Apache Spark or Apache Flink.
Strong experience with distributed data storage and processing technologies such as Hadoop, Apache Kafka, Apache HBase, or similar.
Handson experience with cloud platforms such as AWS, Azure, or Google Cloud Platform, and familiarity with related services such as AWS EMR, S3, Glue, or Azure Data Factory.
Experience with SQL and relational databases (e.g., PostgreSQL, MySQL) as well as NoSQL databases (e.g., MongoDB, Cassandra).
Solid understanding of data modeling concepts and proficiency in designing efficient data schemas.
Excellent problemsolving skills and the ability to troubleshoot complex data issues.
Strong communication and collaboration skills, with the ability to work effectively in a team environment.
Experience with Agile development methodologies and tools like JIRA is a plus.