Data Engineering Team Lead

RM16,000 - RM20,000 monthly
  • Rapid River Software
  • Bangsar South, Jalan Kerinchi, Bangsar South, Kuala Lumpur, Federal Territory of Kuala Lumpur, Malaysia
  • Jan 02, 2019
Full time Software Developers/Architects, Applications Systems Engineers/Architects Systems/Business and Data Analysts Project Managers Business Intelligence Analysts Database Architects Data Warehousing Specialists

Job Description

Rapid River manages several mission-critical data analysis systems for one of our clients. These systems include a web analytics data warehouse, a generic clickstream ingestion pipeline, and a suite of tools used for business intelligence analysis.

We are looking for a person who can lead our initiatives in this area - who can own the problem of data analysis for this part of our client’s operations.

Responsibilities

  • Analyze existing and upcoming requirements for the data platform; design and lead the implementation of new features and platform modifications.
  • Support the Data Engineering team with daily maintenance of and improvements to the existing Data Warehouse platform.
  • Develop new Hadoop workflows and enhance existing ones.
  • Mentor and develop the technical skills of more junior members of the team.
  • Grow the Data Engineering team as necessary by being involved in recruitment activity.

Requirements

  • Proven experience building, debugging and optimizing complex distributed systems or backend services
  • Established history with Big Data technologies. Production engineering with Hadoop ecosystem strongly preferred. Including HBase, Spark, Kafka.
  • Demonstrated development experience with Python or Scala.
  • Very strong SQL skills.
  • Ability to communicate complex technical concepts to non-technical stakeholders.
  • Must be collaborative, quick to learn and drive for results with a balance between quality and quantity.

Years of experience

5 - 10 years  

Required Languages

English  

Do you accept foreigners

Yes

Required Skills

Hadoop Ecosystem, HBase, Spark, Kafka, Python, Scala, SQL

Additional Information (eg. Company Benefits or Project Details)

Benefits

  • Remote-first culture: flexible working hours, near-total freedom to manage your own schedule.
  • Space in our Bangsar South office for use if working from home doesn’t appeal to you.
    • Parking and lunch provided if you do!
  • Competitive salary.
  • Medical insurance and dental/optical allowance.
  • Laptop (Macbook Pro) will be supplied for carrying out work duties.