- We are seeking an experienced Big Data Platform Staff Engineer to join our team, responsible for managing and optimizing our Big Data infrastructure platform. The successful candidate will have a deep understanding of Big Data technologies, architectures, and systems, as well as experience with managing large-scale data processing and analytics environments. The role will involve designing, implementing, and maintaining the Big Data infrastructure platform, ensuring high availability, scalability, and performance.
- Design, implement, and manage the Big Data infrastructure platform, including Hadoop, Spark, NoSQL databases, and data lakes.
- Manage Big Data clusters, including monitoring, troubleshooting, and optimizing cluster performance, as well as managing job scheduling and resource allocation.
- Design and implement storage solutions for Big Data workloads, including HDFS, S3, and other object storage systems.
- Ensure the security and governance of the Big Data infrastructure platform, including managing access controls, implementing data encryption, and conducting regular security audits.
- Collaborate with data engineers and data scientists to optimize Big Data application performance and provide technical support and guidance on using the Big Data infrastructure platform.
- Plan and manage Big Data resource capacity, including forecasting, procurement, and deployment of new hardware and software.
- Bachelor's degree in Computer Science, Engineering, or a related field.
- At least 8 years of experience in managing Big Data Platforms. Proven experience with technologies like Spark, Kafka, Hadoop, Elastic Stack, Kudu, NiFi and Kafka.
- Strong knowledge of Big Data architectures, including data lakes, data warehouses, and data pipelines.
- Experience in troubleshooting and resolving issues of the Big Data stack, ranging from hardware, networking, operating system to software
- Strong understanding of data storage systems, including HDFS, S3, and other object storage systems.
- Experience with scripting languages, such as Python, Scala, or Java.
- Experience in managing physical and virtual infrastructures.
- Experience in supporting search workloads in multi-terabytes and billions of records.
- Experience in distributed systems.
- Proven experience in using DevOps tools and CI/CD pipelines effectively.
- Experience in leading engineering teams.
- Certifications in Big Data, such as Hadoop Certified Developer or Spark Certified Developer.
- Experience with cloud-based Big Data platforms, such as AWS EMR, Google Cloud Dataproc, or Azure HDInsight.
- Experience with machine learning and deep learning frameworks, such as TensorFlow, PyTorch, or Scikit-learn.
- Familiarity with containerization, such as Docker or Kubernetes.
- Experience with agile development methodologies and version control systems, such as Git.
- Experience with cloud computing platforms, such as AWS, Azure, or Google Cloud.
- Experience with containerization, such as Docker or Kubernetes.
-
运维开发工程师 / SRE Platform Engineer( · 岗位职责 · 负责公司运维工具与自动化平台的后端开发,交付稳定可靠的 API 与平台能力; · 深入理解业务与运维需求,与 SRE、后端团队协作,共同推动运维能力平台化、产品化; · 参与平台架构设计与实现,持续优化系统性能、可用性与可维护性; · 通过完善的工程实践(代码规范、测试、监控与文档)保障平台在规模化场景下的长期迭代; · 参与公司内部关键运维系统(如工单、巡检平台、CI/CD、监控告警等)的建设与演进。 · 任职要求 · 拥有扎实的运维基础,理解现代运维体系与云原生理念, ...
Singapore1 week ago
-
SimplifyNext runs a strong AI and automation practice, enabling our platform teams to support modern, containerised, and enterprise-scale workloads. · ...
Singapore3 weeks ago
-
The OpenShift / Kubernetes Container Platform Engineer is responsible for designing · , deploying, · managing, · and optimizing containerized environments using Red Hat OpenShift · and Kubernetes. · ...
Singapore1 month ago
-
We are hiring an OpenShift SME to join our team. · Drive the modernization of legacy applications to container-based platforms across both on-prem and cloud environments. · ...
Singapore3 weeks ago
-
Role · We are seeking an experienced engineer to join our team, responsible for managing and optimizing our Data Exploration Platform. The successful candidate will be responsible for ensuring the resiliency, stability, security and performance of our platform, as well as providi ...
Singapore $110,000 - $180,000 (SGD) per year Full time3 days ago
-
We are looking for a skilled and motivated Platform Engineer to join our team in Singapore. · Minimum 2-3 years in a professional environment with much of the past two years in MDM · JAMF experience essential; · Familiar with systems administration concepts · ...
Singapore2 months ago
-
The Platform Engineer will play a pivotal role in delivering the next-generation inventory and forecasting systems for FairPrice Group. · This position will oversee the technical implementation of all integrations, ensuring they adhere to enterprise architecture standards while e ...
Singapore $110,000 - $180,000 (SGD) per year2 weeks ago
-
Platform Engineer · Domain-Banking · Working Location-Singapore · Experience-3-5 Years · Key Domain/ Technical Skills: · •System Design and Architecture · •Full stack engineer (Typescript, Python, SQL) · Responsibilities: · We are seeking a Platform Engineer (Contract) to join th ...
Singapore $110,000 - $180,000 (SGD) per year3 days ago
-
We are looking for a talented Platform Engineer (or Site Reliability Engineer) to join our engineering team. · ...
Singapore1 month ago
-
We are looking for talented engineer to manage the Data Exploration Platform. · This platform helps our users to understand and derive insights from their data. · It allows users to explore, visualize, and interact with data in a flexible and intuitive way.The successful candidat ...
Singapore1 month ago
-
Vortexa was founded to solve the immense information gap that exists in the energy industry. By using massive amounts of new satellite data and pioneering work in artificial intelligence, Vortexa creates an unprecedented view on the global seaborne energy flows in real-time, brin ...
Singapore $110,000 - $180,000 (SGD) per year1 week ago
-
Job Description: · Position Titte: Platform Operations Engineer · Position Overview · The Platform Operations Engineer will be responsible for managing and maintaining critical platform leveraging on infrastructure-as-code (laC) with a specific focus on SHIP-HATS environments and ...
Singapore $110,000 - $180,000 (SGD) per year1 week ago
-
You will be part of a dynamic team responsible for researching, exploring and adopting the latest cloud technologies to modernise platform services and solutions. You must have a good understanding of IT architecture, System Design, Application & System Integration, DevSecOps and ...
Singapore $110,000 - $180,000 (SGD) per year Full time3 days ago
-
· We are looking for a passionate and driven Platform Engineer to help us design and build our next-generation on-premise testing platform, enabling the organisation to stay ahead of emerging cyber threats. In this role, you will work with a team to develop scalable services tha ...
Singapore, Singapore $110,000 - $180,000 (SGD) per year2 days ago
-
About Capgemini · Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group ...
Singapore $110,000 - $180,000 (SGD) per year4 days ago
-
Vortexa was founded to solve the immense information gap that exists in the energy industry.By using massive amounts of new satellite data and pioneering work in artificial intelligence, Vortexa creates an unprecedented view on the global seaborne energy flows in real-time, bring ...
Singapore1 month ago
-
The successful applicant will be part of the Container Platform team under the Platform Architecture and Engineering (PAE). Manage day-to-day operations of Container Platform administration for business-critical systems including cluster deployment patching configuration migratio ...
Singapore1 month ago
-
This is an exciting opportunity for a Platform Engineer to take ownership of enterprise integration platforms. The role involves managing the lifecycle of Informatica Cloud and SnapLogic platforms. · Manage the complete lifecycle of Informatica Cloud (IICS) and SnapLogic platform ...
Singapore3 weeks ago
-
· CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of operations, including but not limited to Counter-terrorism and Computer Network Defence. · Join the awesome CSIT family and use cutting-edge technologies to ...
Singapore, Singapore $110,000 - $180,000 (SGD) per year2 days ago
-
· SimplifyNext is a fast-growing consulting and technology firm founded by veterans from top-tier consulting companies, focused on AI, Automation, and Application Platforms. Our mission is to drive business transformation across industries by combining strategic insight with dee ...
Singapore $110,000 - $180,000 (SGD) per year3 days ago
-
We are seeking a Platform Engineer (Contract) to join the Site Reliability Engineering (SRE) team within the Service Automation department.This role focuses on building, operating, and improving large-scale, distributed, fault tolerant systems with strong emphasis on automation r ...
Singapore1 month ago
Staff Platform Engineer - Singapore - Csit
Description
CSIT develops products to advance the national security interests of Singapore. We use our products in a wide range of operations, including but not limited to Counter-terrorism and Computer Network Defence. We are looking for talented Senior Big Data Platform Staff Engineer. Join the awesome CSIT family and use cutting-edge technologies to protect the nation.
Role
Responsibilities
Requirements (Minimum Qualifications)
Nice to Have
-
SRE Platform Engineer
Gate- Singapore
-
Platform Engineer
Only for registered members Singapore
-
Platform Engineer
Only for registered members Singapore
-
Platform Engineer
Only for registered members Singapore
-
Platform Engineer
Full time Csit- Singapore
-
Platform Engineer
Only for registered members Singapore
-
Platform Engineer
Only for registered members Singapore
-
Platform Engineer
Only for registered members Singapore
-
Platform Engineer
Only for registered members Singapore
-
Platform Engineer
Only for registered members Singapore
-
Platform Engineer
Only for registered members Singapore
-
Platform Engineer
Only for registered members Singapore
-
Platform Engineer
Full time Csit- Singapore
-
Platform Engineer
Only for registered members Singapore, Singapore
-
Platform Engineer
Capgemini- Singapore
-
Platform Engineer
Only for registered members Singapore
-
IT Platform Engineer
Only for registered members Singapore
-
Platform Engineer
Only for registered members Singapore
-
Platform Engineer
Only for registered members Singapore, Singapore
-
Platform Engineer
Only for registered members Singapore
-
Platform Engineer
Only for registered members Singapore
