SM-Big Data: - Manage Developments, Releases and DevOps of high volume and complex data Processing Engine processing millions of rows every day using multiple processing algorithms and models. Should be able to handle multiple projects and be able to manage development cycles over multiple technology stacks. - Working on IoT device and handling data stream from them will be added advantage. A view of global standards and strategies. Responsibilities : - Draft Understanding of big data requirements for providing solution design and manage development sprints. - Documenting pipelines and strategizing automations. - Document and manage end to end development, testing and deployment tasks. - Responsible for reviewing and optimizing existing ETL processes. - Knowledge of IoT device and handling data coming from the same. - Documentation and production support. - Release management across multiple projects. - Responsible for developing and managing workflows of various modules in data validation pipeline. - Delivery of big data reports over different data structures and transformation tools for resolving Ad-hoc business queries/reported bugs within SLAs. - Delivering presentation to management on the team updates. - Working knowledge for setting up cloud infrastructure and managing the same. - Fast turnaround on requirements to solution document and delivery. - Agility and flexibility in managing iterative developments. - Excellent understanding of Requirements and Edge cages and hidden vulnerabilities/use cases of application. - Manage Documentation on requirements, solution, ATP-UAT, and Deployment with a constant code review. - Managing SLAs as per development process for bug-raised vs bug-fixed. Must Have : - Strong and demonstrable hands-on experience managing Big Data Projects. - Deep Knowledge of Hadoop, Spark, and Job Server Environment. - Strong knowledge of Performance Tuning and Advanced Optimization. - Knowledge of SQL / query languages and working with SQL as well as NoSQL databases. - Good understanding of data structures and database management needed. - Able to handle the various development environment. - Analytical skills over Advanced SQL. - Good knowledge of different technology stacks should be able to manage/mentor development cycle. - Ability in High Volume Data Processing Production environment (not pilots or POCs). - Knowledge of Git, SVN and JIRA. - Working knowledge on Jenkins. - Good knowledge of AWS, EMR and management of servers. Good to Have: - Other programming languages like Java, C#, Kotlin, Objective C. - Java Script frameworks like Angular/Vue/React. - Good hold on Programming concepts like MVC, MVVC, Functional programming, OOP. - Databases PostgreSQL and MongoDB - AWS knowledge and architecture. - CI/CD implementation

Mumbai

Senior Manager - Big Data - Data Processing Engine  

Senior Manager - Big Data - Data Processing Engine   ,Job Description for Senior Manager - Big Data - Data Processing Engine   in Iris Corporate Solutions in  Mumbai for (10-18) years of experience. Apply Now!

Job Description for Senior Manager - Big Data - Data Processing Engine   in Iris Corporate Solutions in  Mumbai for (10-18) years of experience. Apply Now!