Data Analyst - Singapur, Singapore - Unison Consulting Pte Ltd

    Unison Consulting Pte Ltd
    Unison Consulting Pte Ltd Singapur, Singapore

    1 month ago

    Default job background
    Technology / Internet
    Description
    • Implement data transformation, aggregation, and enrichment processes to support various data analytics and machine learning initiatives
    • Collaborate with cross-functional teams to understand data requirements and translate them into effective data engineering solutions
    • Ensure data quality and integrity throughout the data processing lifecycle
    • Design and deploy data engineering solutions on OpenShift Container Platform (OCP) using containerization and orchestration techniques
    • Optimize data engineering workflows for containerized deployment and efficient resource utilization
    • Collaborate with DevOps teams to streamline deployment processes, implement CI/CD pipelines, and ensure platform stability
    • Implement data governance practices, data lineage, and metadata management to ensure data accuracy, traceability, and compliance
    • Monitor and optimize data pipeline performance, troubleshoot issues, and implement necessary enhancements
    • Implement monitoring and logging mechanisms to ensure the health, availability, and performance of the data infrastructure
    • Document data engineering processes, workflows, and infrastructure configurations for knowledge sharing and reference
    • Stay updated with emerging technologies, industry trends, and best practices in data engineering and DevOps
    • Provide technical leadership, mentorship, and guidance to junior team members to foster a culture of continuous learning and innovation to the continuous improvement of the analytics capabilities within the bank

    Requirements

    • 5+ Years of experience as Data Engineer(Spark, Scala and DevOps)
    • Design and deploy data engineering solutions on OpenShift Container Platform (OCP) using containerization and orchestration techniques
    • Document data engineering processes, workflows, and infrastructure configurations for knowledge sharing and reference
    • Provide technical leadership, mentorship, and guidance to junior team members to foster a culture of continuous learning and innovation to the continuous improvement of the analytics capabilities within the bank