Big Data Engineer - Singapur, Singapore - Virtusa

Virtusa Singapur, Singapore

Found in: Talent SG C2 - 1 day ago

Default job background

Description

Big Data Engineer Description

Job Summary

We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environment , Cloudera Data Platform. Overall experience can be 5 to 10 years.. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs as per business requirements. Candidate will also be integrating data sets to provide seamless data access to users.

Key Responsibilities

• Analyze the Authority's data needs and document the requirements.

• Refine data collection/consumption by migrating data collection to more efficient channels.

• Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs.

• Develop test plan and scripts for system testing, support user acceptance testing.

• Work with the Authority's technical teams to ensure smooth deployment and adoption of new solution.

• Ensure the smooth operations and service level of IT solutions.

• Support production issues - Track record in implementing systems with high availability, high performance, high security

What we are looking for

• Good understanding and completion of projects using waterfall/Agile methodology.

• Good understanding of analytics and data warehouse implementations.

• Ability to troubleshoot complex issues ranging from system resource to application stack traces.

• Strong SQL, data modelling and data analysis skills are a must.

• Hands-on experience in big data engineering jobs using Python, PySpark, Linux, and ETL tools like Informatica.

• Track record in implementing systems using Hive, Impala and Cloudera Data Platform will be preferred.

• Hands-on experience in DevOps deployment and data virtualization tools like Denodo will be preferred.

• Understanding/ Hands on experience of reporting or visualization tool like SAP BO and Tableau will be beneficial but not required.

• Passion for automation, standardization, and best practices

• Good written and verbal communication and interpersonal skills, ability to understand the business requirement, communicate confidently with stakeholders.

Primary Location Moulmein-Kallang, Central Singapore, Singapore Job Type Experienced Years of Experience 5 Qualification

Job Summary

We are seeking a highly skilled and experienced Big Data Engineer to join our team. The ideal candidate must have a minimum of 4 years of experience managing data engineering jobs in big data environment , Cloudera Data Platform. Overall experience can be 5 to 10 years.. The successful candidate will be responsible for designing, developing, and maintaining the data ingestion and processing jobs as per business requirements. Candidate will also be integrating data sets to provide seamless data access to users.

Key Responsibilities

• Analyze the Authority's data needs and document the requirements.

• Refine data collection/consumption by migrating data collection to more efficient channels.

• Plan, design and implement data engineering jobs and reporting solutions to meet the analytical needs.

• Develop test plan and scripts for system testing, support user acceptance testing.

• Work with the Authority's technical teams to ensure smooth deployment and adoption of new solution.

• Ensure the smooth operations and service level of IT solutions.

• Support production issues - Track record in implementing systems with high availability, high performance, high security

What we are looking for

• Good understanding and completion of projects using waterfall/Agile methodology.

• Good understanding of analytics and data warehouse implementations.

• Ability to troubleshoot complex issues ranging from system resource to application stack traces.

• Strong SQL, data modelling and data analysis skills are a must.

• Hands-on experience in big data engineering jobs using Python, PySpark, Linux, and ETL tools like Informatica.

• Track record in implementing systems using Hive, Impala and Cloudera Data Platform will be preferred.

• Hands-on experience in DevOps deployment and data virtualization tools like Denodo will be preferred.

• Understanding/ Hands on experience of reporting or visualization tool like SAP BO and Tableau will be beneficial but not required.

• Passion for automation, standardization, and best practices

• Good written and verbal communication and interpersonal skills, ability to understand the business requirement, communicate confidently with stakeholders.

Travel No

Data Engineer, Data

Found in: Talent SG C2 - 3 days ago

EY Singapur, Singapore

The opportunity · EY DnA is the data and advanced analytics capability within EY Asia-Pacific, with over 500 specialist employees working across multiple industry sectors. · We implement information-driven strategies, data platforms and advanced data analytics solution systems t ...
Data Engineer

Found in: Talent SG 2A C2 - 4 days ago

AVENSYS CONSULTING PTE. LTD. Singapore

Roles & Responsibilities · Avensys is a reputed global IT professional services company headquartered in Singapore. Our service spectrum includes enterprise solution consulting, business intelligence, business process automation, and managed services. Given our decade of success, ...
Data Engineer

Found in: Talent SG 2A C2 - 1 day ago

ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Singapore

Roles & Responsibilities · Job Description: · Evaluate new data visualization products and tools for enterprise use. · Create data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems. · Design and develop PowerBI dashboards and re ...
Data Engineer

Found in: Talent SG 2A C2 - 3 days ago

HAYS SPECIALIST RECRUITMENT PTE. LTD. Singapore

Roles & Responsibilities · Your new company · My client is a leading security solution provider looking to recruit a Data Engineer at various levels (Multiple headcount) · Your new role · Build and manage data systems, configure data products and utilise data storage efficiently. ...
Data Engineer

Found in: Talent SG 2A C2 - 1 day ago

JONDAVIDSON PTE. LTD. Singapore

Roles & Responsibilities · Degree in computer science or a numerate subject (e.g. engineering, sciences, or mathematics) or Bachelor's/Master degree with 6 years of experience · Hand-on Development experience with Spark, ScalaSpark and Distributed computing. · Development and imp ...
Data Engineer

Found in: Talent SG 2A C2 - 5 days ago

ASE SINGAPORE PTE. LTD. Singapore

Roles & Responsibilities · As a Data Engineer assigned to the Test/Product Department, you will be working with various internal teams to develop Smart Engineering solutions through Artificial Intelligence and Machine Learning. · Responsibilities: · Work with Test/Product Enginee ...
Data Engineer

Found in: Talent SG 2A C2 - 4 days ago

MOOVITA PTE. LTD. Singapore

Roles & Responsibilities · Responsibilities: · Design, develop, and maintain data pipelines and ETL processes to ingest, process, and transform large volumes of structured and unstructured data from autonomous vehicles · Collaborate with different stakeholders from technical, pro ...
Data Engineer

Found in: One Red Cent Asia eFC C2 - 3 days ago

Beyondsoft International Singapore Full time

COMPANY DESCRIPTION · Beyondsoft International (Singapore) Pte. Ltd. was set up in 2007 and established as the regional headquarters for the Southeast Asia (SEA) and European markets in September 2015. Based on our vision of "Using technology to promote social progress, economic ...
Data Engineer

Found in: Talent SG 2A C2 - 4 days ago

COMBUILDER PTE LTD Singapore

Roles & Responsibilities · We are looking for aspiring Data Engineer/Software Developer to join our product development team, you will be responsible for the design and implementation of data integration pipeline and asynchronous data event using event driven architecture approac ...
Data Engineer

Found in: Talent SG 2A C2 - 8 hours ago

MIGHTY BEAR GAMES PTE. LTD. Singapore

Roles & Responsibilities · We are looking for an experienced and motivated Data Engineer. · As a Data Engineer at Mighty Bear Games, you will play a crucial role in shaping our data analytics platform. Your expertise will drive the development, maintenance, and optimization of d ...
Data Engineer

Found in: Talent SG 2A C2 - 1 day ago

ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Singapore

Roles & Responsibilities · Astek is proposing an opportunity for Data Engineer (Python/Java/SQL) to support our project based in Singapore. · Responsibilities · Work closely with business analyst and data scientists to implement and support data solutions that support common func ...
Data Engineer

Found in: Talent SG 2A C2 - 2 days ago

MALTEM ASIA PTE. LTD. Singapore

Roles & Responsibilities · Maltem Singapore is currently seeking a Data Engineer for our Wealth Management Client. · Summary : · The successful candidate will be supporting the Central Data Service Layer project · Responsibilities: · Work closely with business (Research Analysts, ...
Data Engineer

Found in: One Red Cent Asia eFC C2 - 4 days ago

Kerry Consulting Pte Ltd Singapore Full time

Roles & Responsibilities · Data Engineer for a Leading MNC (Day Rate Contract) · Job posting done by Sheralynn Tjioe, Head of Interim and Contracting Solutions (Technology) Recruitment at Kerry Consulting · Email: · My Client is a leading stable firm in Singapore. · Responsibili ...
Data Engineer

Found in: Talent SG 2A C2 - 3 days ago

ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD. Singapore

Roles & Responsibilities · ASTEK has been providing IT and Engineering solutions for some of the world's largest industrial and services groups for more than 35 years with 7200 passionate experts in 22 countries throughout Europe, APAC, Middle East and the Americas. · Currently, ...
Data Engineer

Found in: Talent SG 2A C2 - 4 days ago

DYNAMIC TECHNOLOGY LAB PRIVATE LIMITED Singapore

Roles & Responsibilities · Data Engineers coordinate with researchers to ensure efficient processing of large-scale data. · Responsibilities · Develop and manage data inventories · Design a strong data framework · Monitor and maintain data production on a daily basis · Qualificat ...
Data Engineer

Found in: Talent SG 2A C2 - 1 day ago

H2 GAMES PTE. LTD. Singapore

Roles & Responsibilities · We are seeking for a Big Data Engineer/Data Architect to join our dynamic data support team. This candidate will be responsible for various professional fields including big data, data warehousing, and data analytics, supporting the company's petabyte-l ...
Data Engineer

Found in: Talent SG 2A C2 - 4 days ago

THALES DIS (SINGAPORE) PTE. LTD. Singapore

Roles & Responsibilities · As a Data Engineer in AIR Lab, you should be someone who enjoys designing, discussing topics around processing patterns like data quality control, streaming SQL, data sources/sinks and data synchronization; streaming-backfill, stream-to-stream joins etc ...
Data Engineer

Found in: Talent SG 2A C2 - 4 days ago

KERRY CONSULTING PTE. LTD. Singapore

Roles & Responsibilities · Job posting done by Sheralynn Tjioe, Head of Interim and Contracting Solutions (Technology) Recruitment at Kerry Consulting · Email: · My Client is a leading stable firm in Singapore. · Job Title: Data Engineer (System Support) - Contract · Job Summary ...
Data Engineer

Found in: Talent SG 2A C2 - 4 days ago

CAPGEMINI SINGAPORE PTE. LTD. Singapore

Roles & Responsibilities · Responsibilities: · Build robust, efficient and reliable data pipelines consisting of diverse data sources to ingest and process data · Design and develop real time streaming and batch processing pipeline solutions · Assemble large, complex data sets to ...
Data Engineer

Found in: Talent SG 2A C2 - 4 days ago

SUNRAY WOODCRAFT CONSTRUCTION PTE LTD Singapore

Roles & Responsibilities · Responsibilities: · ● Design, construct, install, test, and maintain highly scalable data management systems. · ● Ensure systems meet business requirements and industry practices. · ● Build high-performance algorithms, prototypes, predictive models, and ...