Lowongan Data Engineer di PT Data Labs Analytics

Responsibilities:

• Design, develop, and maintain data pipelines and ETL processes to efficiently extract, transform, and load data from diverse sources into our data warehouse.
• Collaborate closely with data scientists, analysts, and other stakeholders to understand data requirements and implement data solutions that meet business needs.
• Build and optimize data models and schema designs to support data analytics and reporting.
• Ensure data quality, integrity, and reliability throughout the data pipeline by implementing data validation and data cleansing processes.
• Work with GCP services such as Google Cloud Storage, BigQuery, Dataflow, and Pub/Sub to architect and implement scalable and efficient data processing solutions.
• Monitor and troubleshoot data pipeline issues, identifying and resolving bottlenecks, errors, and performance problems.
• Implement security and access controls to protect sensitive data and ensure compliance with data privacy regulations.
• Collaborate with DevOps teams to automate deployment and scaling of data pipelines.
• Stay up to date with emerging data engineering technologies and best practices, and actively contribute to the team's knowledge base.
• Provide technical guidance and mentorship to junior data engineers as needed.
• Document data processes, data flows, and architectural decisions.

Requirements:

• Bachelor's degree in Computer Science, Engineering, or a related field. Master's degree is a plus.
• Proven experience as a Data Engineer or similar role, with a minimum of 1 years of experience in designing and building data pipelines and ETL processes.
• Strong proficiency in Google Cloud Platform (GCP) services such as BigQuery, Dataflow, Pub/Sub,Composer/Airflow and Cloud Storage.
• Solid programming skills in languages such as Python, Java, or Scala.
• Experience with data modeling, data warehousing concepts, and relational databases.
• Proficiency in SQL and database design principles.
• Familiarity with data integration and ETL tools.
• Strong understanding of data governance, data security, and data quality best practices.
• Experience with version control systems and collaborative development workflows.
• Excellent problem-solving skills and the ability to work with complex data requirements.
• Strong communication and teamwork skills, with the ability to collaborate effectively with cross-functional teams.
• Detail-oriented mindset with a focus on delivering high-quality solutions.
• Experience in Agile development methodologies is a plus.
• Relevant certifications in Google Cloud Platform (GCP) are desirable.