Senior Data Oerations Professional to be based in Pune (Hybrid)
An esteemed client of Innoquest Consulting a financial service provider, is looking for DataOps professional for their Pune location (Hybrid mode).
Roles and Responsibilities:- Assisting customer with creation a near real-time data ingestion and transformation framework.
- Collaborate with AWS and Team leads to identify the infrastructure and functional requirements for the Data workstream.
- Collaborate with DevOps engineers in the creation of the Data workstream environment.
- Develop the data Data Transformations required based on the business workflows of the applications consuming the Data platform.
Skills Required:- Candidate with 5+ yrs of relevant experience.
- Develop the data Data Transformations required based on the business workflows of the applications consuming the Data platform.
- Experience with deploying/utilizing the following AWS services:EMR / Glue / Spark o Data Lake / Lake Formation Lambda Athena Kinesis Firehose or Kafka S3 Postgres DynamoDBRedisSnowflake
- Experience with complex Data Transformations using ETL services such as Glue and Spark.
- Experience with Data Definition/Description Language (DDL).
- Strong Python experience for Data manipulation/ETL