Senior Data Engineer

Hello

Hope you’re doing well

Title: Senior Data Engineer

Location: Hyderabad (Remote)

Duration: Contract Long term / Full time

Salary : DOE

Working Hours : 8:30 PM IST to 4:30 AM IST

JD:

• 6+ years of experience working with enterprise data platforms, building and managing data lakes and using big data technologies
• 5+ years of experience working with relational and non-relational / NoSQL databases, advanced knowledge of SQL
• 4+ years of experience working with AWS platform. Experience with solutioning on AWS infrastructure using services like AWS IAM, S3, API Gateway, Lambda, Glue, Lake formation, Redshift, DynamoDB, RDS
• 4+ years of experience with using Python for data engineering and developing high performance and scalable data pipeline
• 2+ years of experience working with Apache Airflow for orchestrating analytics workload
• 2+ years of experience with IaC solutions like terraform, cloud formation
• Preference to candidates with MLOps experience and exposure to executing ML/AI use cases in AWS cloud utilizing services like Sagemaker, Bedrock
• Strong understanding of concepts around data warehousing, BI, data security, data quality and profiling
• Prior experience with traditional ETL tools like Talend Open Studio, Informatica, Pentaho or something similar
• Cloud DevOps experience utilizing products like Gitlab, Bitbucket or similar ones
• Prior experience with AWS EKS service, setting up and managing kubernetes clusters and services is preferred
• Have to be a team player and open to working with newer technologies as well as supporting legacy systems