Jobs

    Hiring for Big data Consultant - Singapore - PATH INFOTECH PTE. LTD.

    PATH INFOTECH PTE. LTD.
    PATH INFOTECH PTE. LTD. Singapore

    1 week ago

    Default job background
    Description
    Roles & Responsibilities

    · Write Spark code to Extract, Transform and Load data from heterogenous source (like CSV, JSON files, RDBMS and streaming viz Kafka) into Hive tables in different layers

    · Writing complex queries using Joins, Sub Queries, Temporary Views and CTE, Map, Group Map in Hive

    · Perform necessary aggregations, ranking data using window functions, removing duplicates from source data with spark over the extracted data which will be required for generating banking reports

    · Perform various Join operations in spark to combine results from two or more source files and build a data warehouse

    · Data pivoting, unpivoting, exception handling and logging

    · Data Validation for quality checks using Python and Spark

    · Read parameters and variables into spark code from configuration files specific to an environment

    · Performance tuning in hive with partitioning and bucketing

    · Configuring run parameters for spark job like memory configurations and available cluster resourcesü Data Migration and reconciliation between various banking core

    ü Designing robust framework which eases development on product enhancement for each sprint

    ü Performance tuning and monitoring performance of individual jobs in timely manner

    Tell employers what skills you have

    JSON
    MSSQL
    Oracle 11g
    Postgres
    Data Base Administration
    PostgreSQL
    ETL
    Logging
    Data Migration
    Performance Tuning
    MSSQL Server
    Data Visualization

  • Artefact

    Data Consultant

    3 days ago


    Artefact Singapore

    **Wie we zijn** · Artefact is a new generation of a data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we're enjoying sky ...

  • Veeva Systems

    Data Consultant

    2 days ago


    Veeva Systems Singapore

    Veeva Systems is a mission-driven organization and pioneer in industry cloud, helping life sciences companies bring therapies to patients faster. As one of the fastest-growing SaaS companies in history, we surpassed $2B in revenue in our last fiscal year with extensive growth pot ...


  • NCS Singapore

    **Senior Consultant, Data & AI Strategy**: · **Date**:18 Apr 2024 · **Location**: Singapore, Singapore · **Company**:Singtel Group · **Key Responsibilities**: · AI and Generative AI Strategy Integration: · - Leverage advanced AI and Generative AI technologies to craft data strate ...


  • Artefact Singapore

    **Wie we zijn** · Artefact is a new generation of a data service provider, specialising in data consulting and data-driven digital marketing, dedicated to transforming data into business impact across the entire value chain of organisations. We are proud to say we're enjoying sky ...


  • MHA - Internal Security Department (ISD) Singapore

    **What the role is** · - Data is integral to ISD's operations. As the use of data and analytics grows, having a vigorous data security and management regime becomes even more essential to enable secure data operations. You will join the central data management and governance team ...


  • Zühlke Singapore

    Permanent · - Full-time · - Singapur · *** · DATA & AI · **Your job.** · Zuhlke is at an incredible time of growth. Having seen over 50 years of success in Europe, Zuhlke has brought its top-of-the-line offerings across continents to its Singapore, Hong Kong, and Vietnam offices. ...


  • Zühlke Singapore

    Permanent · - 100% · - Singapur · *** · DATA & AI · Zuhlke is at an incredible time of growth. Having seen over 50 years of success in Europe, Zuhlke has brought its top-of-the-line offerings across continents to its Singapore, Hong Kong, and Vietnam offices. Taking the next step ...


  • Zühlke Singapore

    Permanent · - 100% · - Singapur · *** · Zuhlke is at an incredible time of growth. Having seen over 50 years of success in Europe, Zuhlke has brought its top-of-the-line offerings across continents to its Singapore, Hong Kong, and Vietnam offices. Taking the next step in its expa ...


  • NCS Singapore

    **Consultant, Data Centre & BCP**: · **Date**:15 Apr 2024 · **Location**: Singapore, Singapore · **Company**:Singtel Group · Are you looking for value adding and impactful work? · Do you want to make a difference with your expertise? · With us, you'll be able to make it happen. · ...


  • Intellect Minds Pte Ltd Singapore

    We are a fast growing company that aims to help you with all in job finding matching to your skills. · **Responsibilities**: · - Partner with multiple management, development & Implementation teams to ensure appropriate integration of functions to meet goals as well as identify a ...


  • STELLAR LINK PARTNERS PTE. LTD. Singapore

    **Job Title**:Consultant - Tableau, Data Visualization · **Location**:Central · **Position Type**:12 months contract, renewable based on project needs · **About Us**:My client is a leading consulting firm specializing in providing data-driven solutions to clients in the investmen ...


  • Assembly Singapore

    We are Assembly - and we're not like the rest. We're the modern alternative agency, bringing together industry-leading data, talent, and tech to Find the Change That Fuels Growth for the best brands on the planet, including Adobe, Lane Crawford, Marina Bay Sands, and more. Our di ...


  • FDM SINGAPORE CONSULTING PTE. LTD. Singapore

    **About The Role · The demand for big data professionals has never been higher. If you're a graduate with a strong interest in data, finding patterns in data, and are drawn to programming this could be your opportunity to embark on an exciting future as a Data Engineer. · **About ...


  • Luxoft Singapore

    **Project** Description**: · **Responsibilities**: · - Participate in the configuration of EMDMS software solutions based on Bank's requirement. · - Responsible for their configuration and unit testing within Bank's EMDMS implementation project. · - Provide best practice guidance ...


  • PAN-ASIA RESOURCES PTE LTD Singapore

    Responsibilities: · - Data Migration Detailed activity planning and tracking - Master Plan. · - Data migration Approach Preparation and Scrutinization. · - Data Migration Briefing and walkthrough with client for each DM cycle. · - Data Migration requirement gathering (Transformat ...


  • Pontoon Asia Pacific Singapore

    This role is for a Digital Forensics Analyst. Anyone working within the Digital Forensics team can expect the following: · - Utilising your extensive Digital Forensics and Incident Response experience to conduct and manage your individual caseload across the entire incident respo ...


  • PATH INFOTECH PTE. LTD. Singapore

    Write Spark code to Extract, Transform and Load data from heterogenous source (like CSV, JSON files, RDBMS and streaming viz Kafka) into Hive tables in different layers · - Writing complex queries using Joins, Sub Queries, Temporary Views and CTE, Map, Group Map in Hive · - Perfo ...


  • BIOQUEST ADVISORY PTE. LTD. Singapore

    At BioQuest Advisory, we are offering an exciting opportunity for a Management Consultant Intern who specializes in data analytics. This position will have you delving deep into the heart of the consulting industry, combining strategic management insights with data-driven decisio ...


  • Cognizant Technology Solutions Singapore

    Role: Consultant - Data Governance Operating Model · Location: Singapore · **About Cognizant** · **The Cognizant Difference - Engineering Modern Businesses** · At Cognizant Consulting, our Technology Modernization consultants orchestrate the capabilities to truly change the game— ...


  • Bioquest Advisory Singapore

    At BioQuest Advisory, we are offering an exciting opportunity for a Management Consultant Intern who specializes in data analytics. This position will have you delving deep into the heart of the consulting industry, combining strategic management insights with data-driven decisio ...