Job Description

• Design and develop data integration modules to extract, transform and load (ETL) data from multiple sources using Elastic technologies including Logstash and Beats.
• Design and implement custom data pipelines to ingest data into Elastic using tools such as Logstash or custom scripts.
• Design and develop code modules using Elastic API to ingest data, configure indices, build dashboards and to perform advanced search queries.
• Build powerful search queries using KQL to build advanced dashboards.
• Design, define and modify ingest pipelines.
• Define data mapping and custom analyzers.
• Enrich data using runtime fields and Elasticsearch scripting Design and write search queries for data aggregations, across clusters and using runtime fields.
• Lead design sessions around Elasticsearch implementation and provide technical guidance to the team.
• Act as a subject matter expert and a trusted advisor related to all Elasticsearch topics in the project.
• Responsible for testing the code modules by developing unit tests as part of Test-Driven Development (TDD) process.
• Debug/troubleshoot production issues related to data ingestion, data reports and visualizations.
• Work in an Agile environment as part of cross-functional team.

• Bachelor's Degree and 6+ years of experience in developing search applications using ELK stack.
• Experience as a technical lead in application development using Elastic.
• Thorough understanding of Elastic deployments including cluster design in Elastic Cloud Enterprise (ECE).
• Ability to debug, troubleshoot existing logic units in code modules.
• Experience in writing Extract, Transform and Load (ETL) jobs and ability to troubleshoot ETL tasks.
• Ability to write SQL queries for data extraction and validation.
• Hands-on experience in using Elastic API and Painless scripting.
• A thorough understanding of JSON and XML.
• Thorough knowledge of code building and deployment tools including Git and experience in CI/CD processes.

Job Tags

Similar Jobs