Data Engineer - EdTech

RESPONSIBILITIES:

- Work in tandem with data scientists, building pipelines that transform data into formats they can use for projects

- Assembling large, complex sets of data that meet non-functional and functional business requirements

- Identifying, designing and implementing internal process improvements including re-designing infrastructure for greater scalability, optimizing data delivery, and automating manual processes

- Defining and leading our strategy in making data engineering skills accessible for our community members

- Continuously learning new tools in Data Engineering and evangelizing them within our community

- Set up Data Engineering labs

- Leading industry events, meetups and webinars

- Develop custom data models and algorithms to apply to real life use cases.

REQUIREMENTS:

- 3+ years of experience in Data Engineering in companies dealing with huge datasets.

- Prior experience with training will be an advantage.

- Having experience in Data Engineering technologies like Apache Spark, Hadoop, HDFS, Hive, Python

- Having experience in one of the Cloud providers - Azure or AWS.

- Experience with relational SQL and NoSQL databases.

- Experience with data pipeline and workflow management

- Have Ability to quickly grasp new technologies and products and create training programs to increase adoption

- Strong problem solving and communication skills (English).