Data Architect - Data Platform - IT

DATA ARCHITECT - JOB DESCRIPTION

We are looking for an Architect to work on our Data platform that would handle large volume of structured, semi-structured as well as unstructured data. Our Data platform is built using latest technologies like In-Memory Data Fabric and Columnar Store to ensure high-throughput and low latency while dealing with terabytes of data.

RESPONSIBILITIES

- Work with Product and Engineering team to drive the product vision and technology road map.

- Understand Business Requirements/One-Liners and Translate them into Technology Requirements.

- Implement architecture best practices, repeatable and scalable frameworks.

- Design and Implement Data Platform, make appropriate changes to the Data Infrastructure as it evolves.

- Design data models for high volume data management, real-time and distributed data process.

- Design and Develop Pipeline for Data Ingestion. Identify and resolve issues in data pipeline.

- Implement tools for data governance, security and quality as part of the platform.

- Automate deployment of the data platform on Public/Private Cloud Environments.

CANDIDATE PROFILE

10 to 15 years of experience in architecting, developing and implementing large scale data products.

Excellent working knowledge on

- Relational databases like SQL Server, Oracle, MySQL.

- NoSQL Databases like Cassandra, Druid, Neo4J

- Hadoop stack (Hadoop, Hive, Pig, HBase etc.).

- Stream and Batch Processing Engines like Spark, Flink, Apex, Spring XD.

- Cloud Ecosystem - AWS, Azure ecosystem.

- Awareness of the In-Memory Database Ecosystem (IMDB, IMDG, IMDF) and Data Lake.

- Understanding of one of the BI tools such as Qlikview, Power BI, Tableau.

- Excellent problem solving, hands-on engineering, and communication skills.

Relevant exp in Big data technologies should be 4+ Years.