Senior Software Engineer

About the Role

The Avaya team is looking for an Observability Engineer. You will lead the effort in refactoring and maintaining our Monitoring Infrastructure (Logging, Metrics, Tracing) which is currently built on Datadog and will work closely with Software Engineers to provide the right tooling to measure the reliability of our systems. This person will also be responsible for building out dashboards, monitors and alerts, using Infrastructure as Code (IAC) techniques.

Responsibilities

• Administrator of the enterprise Datadog account as part of a team
• Assist teammates and other Engineering teams on DataDog implementation and Administration.
• Implement and enhance our enterprise DataDog account and its configurations.
• Assist with building and improving dashboards. Must be able to understand and articulate what key metrics are useful to visualize that can be implemented into monitoring dashboards
• Create and maintain custom integrations with other enterprise tools (eg. Opsgenie for notifications, Jira tickets for low priority notifications)
• Enhance APM, RUM, SUM, metrics and logging capabilities as needed.
• Extend product capabilities around build tooling and dashboards via pipelines, among others.
• Define company standards for tagging and naming around observability infrastructure.

Must-Have Qualifications

If you don't think you meet all of the criteria below but still are interested in the job, please apply. Nobody checks every box, and we're looking for someone excited to join the team.

• Experience with monitoring & logging with one of the major telemetry solutions (Datadog, Opentracing, OpenTelemetry, etc…)
• Have experience developing and modifying dashboards
• Working knowledge of Linux systems and subsystems.
• Have excellent debugging and troubleshooting skills
• Good communication skills.
• Strong analytical skills.
• Fluent in one or more scripting languages such as: Python, Groovy, etc…

• Experience with Amazon Web Services or other Cloud Platform
• At least 1 year of Kubernetes experience on real-world projects.

Nice-to-Have Qualifications

• Hands on experience working with Datadog
• Experience with Terraform, or some other cloud provisioning tool