Principal Data Engineer

Overview: - Saviynt is seeking a Principal Data Engineer to lead ElasticSearch development, administration, and optimization. - The role is critical for modernizing data infrastructure, ensuring high availability, security, and performance. Key Responsibilities: - Upgrade ElasticSearch from version 6.x to 7.x and from 7.x to 8.x with minimal downtime. - Design and implement scalability, performance tuning, and security best practices for ElasticSearch clusters. - Optimize search indexing and query performance for large-scale datasets. - Develop and maintain monitoring and alerting mechanisms for ElasticSearch clusters. - Collaborate with cross-functional teams to integrate ElasticSearch with existing applications and infrastructure. - Evaluate and implement multi-tenant architecture for ElasticSearch. - Define and enforce data modeling, indexing strategies, and cluster sharding best practices. - Troubleshoot and resolve issues related to query performance, data consistency, and infrastructure scaling. - Maintain and enhance security configurations, including encryption, access control, and compliance. - Automate operational tasks using scripting and infrastructure-as-code tools for ElasticSearch management. - Mentor and guide engineers on ElasticSearch administration, optimization, and best practices. Requirements/Skills/Qualifications: - 8+ years of experience in Data Engineering, DevOps, or Software Engineering with a focus on ElasticSearch. - Proven experience upgrading ElasticSearch in production environments. - Strong expertise in ElasticSearch performance tuning, cluster scaling, and optimization techniques. - Experience with multi-tenant solutions, indexing strategies, data partitioning, and sharding techniques. - Solid understanding of Elasticsearch security best practices. - Proficiency in SQL, NoSQL databases, and data storage technologies (e.g., MySQL, Redis, S3). - Experience integrating ElasticSearch with Java/SpringBoot applications and working with RESTful APIs. - Experience with cloud platforms (AWS, Azure) and deploying ElasticSearch in containerized environments (Docker, Kubernetes). - Experience with infrastructure automation tools (Terraform, Ansible, Helm, or CloudFormation) for managing ElasticSearch clusters. - Strong problem-solving and analytical skills. - Excellent communication and collaboration skills. Compensation & Benefits: - $215,000 - $280,000 a year (Note: The compensation and benefits section is provided as per the original text, but no additional details are included.)