Senior Infrastructure

Lead Systems Engineer

The client Operations Center is seeking a Lead Systems Engineer to support the Systems Monitoring initiatives for several SOW’s 2023 and beyond. Responsible for software tool administration for systems and applications monitoring tools. Expertise with at least one of the Monitoring tools like Data Dog. Data Dog Administration experience on Linux platform to instrument Java based applications running on Tomcat Application Server.

Configuration experience in Infrastructure Monitoring, Network Monitoring and Centralized Logging. Or similar Administration experience with ELK Stack – Elasticsearch (search and analytics engine), Logstash (ingest pipeline) and Kibana (visualization and creating dashboards). Excellent Linux platform (Red Hat) background. Automation experience with scripting (Python, Shell, ANSIBLE) preferred. Understanding of SSL setup on Linux servers. Installing CA certs etc. Experience with Network Monitoring and knowledge on Network components like Switches, Routers, Palo Alto Network utilization SNMP, F5 Load Balancers, Web Seal, Info Blocks, Gigamon, Network Mapping is a plus.

Working knowledge of other monitoring tools like Big Panda, Cloud Beat (Synthetic Monitoring) is desired. These tools are used to monitor applications and business transactions that impact the business and customers, currently. Responsibilities include script writing, installing, managing, and maintaining the monitoring tools, as needed, as well as integration with other tools and collaboration with other groups and their tools.

• Manages, configures and maintains the Data Dog tool on Linux platform.
• Responsible for Network Monitoring, Infrastructure/Server Monitoring (Linux, Windows, AIX) using Data Dog, Application, SNMP and Log Monitoring.
• Configure centralized logging of all logs from different sources like Web Sphere / Tomcat and IHS Web Servers on AIX servers to Data Dog on Linux. Knowledge of Load Balancers like F5 to route logs to Log server. Handling different types of Log formats.
• Creates required dashboards with data visualization in Data Dog.
• Manages, configures and maintains the Data Dog APM tool on Linux platform.
• Responsible for Java Applications’ instrumentation with Data Dog, set up health rules and fine tune monitoring in Data Dog.
• Setup End User Monitoring / Browser Real User Monitoring of Data Dog for applications, using Java script injection.
• Creates Selenium scripts to monitor business transactions using Cloud Beat’s Synthetic Monitoring.
• Provides support to all significant production issues. Activities may include gathering information from a wide variety of sources across all platforms to analyze for correlations, identifying specific performance causes, recommending a variety of possible solutions to remedy issue and issue reports with key findings and next steps.
• Creates documentation to support the management and maintenance of Data Dog / Data Dog tools. Provides training on tools and the associated processes and procedures.
• Analyzes tool data and usage. Communicates weekly with management verbally and via written detailed status reports regarding potential problems and concerns.
• Works with different Systems and Application Architecture teams to ensure that systems monitoring requirements are addressed early in the development process. Coordinates with project teams to ensure that monitoring of new applications is available before release for production.
• Assists in reviewing and analyzing business & system requirements and specifications for systems monitoring tool protocols and future tool usage.

• Effective organizational, interpersonal, analytical, communications skills and Hands on technical experience
• Self-motivated, adaptable to change, forward-thinking
• Must be able to prioritize and manage time under tight deadlines and demonstrate initiative in problem-solving.
• Enthusiasm to engage in continuous learning, internal drive, intellectual curiosity, ability to learn, and desire to help the customers succeed
• Excellent technical skills and ability to work proactively
• Comfortable working under Project Manager supervision

• 5-8…