RESPONSIBILITIES

• A Data engineer in Company works on the data pipeline infrastructure that is veritably the backbone of our business. In a day’s job you would be writing elegant functional SCALA code to crunch TBs of data on Hadoop clusters, mostly using Spark. In a week’s job, you would be owning a data pipeline deployment to clusters : on-prem or on-cloud (AWS or GCP or more). In a month’s job, you would be managing Hadoop clusters right from security to reliability to HA. Did we mention we are building a pluggable, unified data-lake from scratch? Time to time you have new challenges for automating and scaling tasks for Data science team. We constantly look to improve our framework and pipelines, hence learning on the job is sort of a given. This is the big picture of our big data system.
• Our expertise and requirements include but are not limited to Spark, Scala, HDFS, Yarn, Hive, Kafka, Distributed Systems, Python, Datastores (Relational and NoSql) and Airflow.

REQUIREMENTS

• Understanding of distributed computing principles.
• Experience with Java. (Scala/Python is a plus).
• Experience in Big Data stacks including Hadoop’s ecosystem.
• Knowledge of various ETL techniques and frameworks, such as MapReduce, Spark etc.
• Experience with NoSQL databases.
• Experience with various messaging systems, such as Kafka or RabbitMQ.

BENEFITS

• Opportunity to work and learn from one of the best and brightest technology teams in Vietnam.
• Be part of a winning team with exponential growth regionally, experience recruiting world-class talents.
• Top market rate pay.
• Generous benefits: health insurance package for family, Free Food at the office.
• All Day, Grab for work allowance.