EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential. We seek a Senior Data DevOps Engineer to join our group and take a leading role in the development and optimization of data infrastructure and workflow processes on Azure. You will design, deploy, and manage scalable data systems while collaborating with data engineering and multi-disciplinary teams to guarantee pipeline efficiency, system reliability, and performance improvements. Apply now to advance your career with us. Responsibilities Architect and operate data infrastructure using Azure services such as Data Lake, Databricks, Synapse, and Data Factory Partner with data engineering teams to build and support effective data pipelines and workflows Automate data workflows using Python to enhance process productivity and reliability Configure and maintain CI/CD pipelines with Jenkins, GitHub Actions, or similar tools Work across teams to improve scalability, reliability, and performance of data systems Install and maintain data tools like Apache Spark and Kafka in both cloud-based and on-premises environments Proactively monitor data platforms to detect and resolve performance and scalability issues Troubleshoot and address complex problems within data platforms and pipeline operations Requirements Minimum of 3 years experience in Data Engineering or related positions Expertise in Python programming for batch processing workflows Proficiency in SQL for handling and querying extensive datasets Strong experience with Azure cloud services for data infrastructure management Hands-on familiarity with Infrastructure as Code tools such as Ansible, Terraform, or CloudFormation Capable of creating and managing CI/CD pipelines using Jenkins, GitHub Actions, or equivalent Experience with data processing and orchestration tools including Spark, Airflow, or R Advanced Linux OS knowledge with scripting and system administration skills Thorough understanding of network protocols like TCP, UDP, ICMP, DHCP, DNS, and NAT Strong English language proficiency at B2+ level, both spoken and written Nice to have Knowledge of additional cloud platforms such as AWS or GCP Experience with Kubernetes for container orchestration in data workflows Familiarity with monitoring and observability tools such as Prometheus, Grafana, or Azure Monitor Exposure to Big Data technologies and complex data analytics processes Experience in cloud data governance and security best practices We offer International projects with top brands Work with global teams of highly skilled, diverse peers Employee financial programs Paid time off and sick leave Upskilling, reskilling and certification courses Unlimited access to the LinkedIn Learning library and 22,000+ courses Global career opportunities Volunteer and community involvement opportunities EPAM Employee Groups Award-winning culture recognized by Glassdoor, Newsweek and LinkedIn #J-18808-Ljbffr
Senior Data Devops Engineer (Azure) - Cloud Data Pipelines
EPAM SYSTEMS
estado de méxico, estado de méxico
Publicado hace 7 días
Denunciar empleo