Performance Testing Intermediate Analyst

Performance Testing Engineer — C11

IT Quality Intermediate Analyst | TTS Cash Management | Citi

Position Overview

Citi Treasury and Trade Solutions (TTS) delivers services globally, covering 96 markets and transacting in 144 currencies. Recognized as a World's Best Financial Innovation Lab, TTS relies on robust performance engineering to establish service level agreements and deliver exceptional user experiences.

The Non-Functional Testing (NFT) group supports over 100 applications within the TTS Cash Management group. This senior role requires Subject Matter Expert (SME)-level expertise to manage end-to-end performance testing solutions for complex, distributed payment architectures.

The TTS Cash NFT team is seeking an IT Quality Intermediate Analyst - C11 (Senior Performance Testing Engineer) to own application performance testing solutions and act as an SME. This role involves collaborating with Development, Architecture, and Business teams to gather requirements, design performance testing approaches, and certify application changes before production deployments.

The position requires close collaboration with the Global NFT team and may involve leading a small team alongside the NFT Practice Manager. Candidates should possess strong knowledge of Non-Functional Testing (Performance Testing & Engineering) for complex applications, with exposure to monitoring, profiling, and analysis using industry-standard tools.

Primary Skills

• Performance Testing & Engineering

Tools & Technology Stack

The team utilizes a variety of tools and technologies for performance testing and analysis:

• Load Testing: LoadRunner Enterprise (MF Performance Center) for Web, Web Services (REST/Microservices), MQ (Java), and Database testing.
• APM / Profiling: AppDynamics for full-stack application profiling, transaction tracing, and bottleneck identification.
• Log Analysis: Kibana & ELK Stack for log aggregation, correlation, and visualization during test runs.
• Monitoring: BMC TrueSight / HP SiteScope for infrastructure and system health monitoring.
• Database: SQL (Oracle, MS SQL, PostgreSQL) for query optimization and AWR analysis.
• NoSQL Database: MongoDB for NoSQL performance testing and data management.
• Container Orchestration: ECS (Elastic Container Service) for containerized application performance testing.
• Messaging / Streaming: Apache Kafka for performance testing of event-driven and streaming architectures.
• Message Queue: IBM MQ for MQ-based load testing, throughput validation, and queue performance.
• Programming: C Programming for low-level scripting, system-level performance analysis, and driver development.
• Programming: Java for test script development and framework automation.

Key Responsibilities

Performance Engineering & Testing:

• Lead end-to-end impact assessments, testing approach design, planning, execution, application profiling, metrics analysis, reporting, and risk management for assigned projects and applications.
• Implement and execute a performance test framework for non-functional testing, including load, volume, stress, capacity, and scalability testing.
• Assess and design standalone component or end-to-end testing approaches for complex payment flows.
• Profile application performance end-to-end and identify application and hardware/OS-level bottlenecks using AppDynamics and other monitoring tools.
• Perform AWR analysis for Oracle database performance tuning and provide recommendations.
• Conduct SQL query performance analysis and optimize database interactions for high-throughput scenarios.
• Validate MongoDB query performance, indexing strategies, and data access patterns under load.

Messaging & Streaming Systems:

• Design and execute performance tests for Kafka-based event-driven architectures (producer/consumer throughput, partition performance, lag analysis).
• Conduct IBM MQ / RabbitMQ performance testing (queue depth analysis, message throughput, latency benchmarking).
• Test ECS containerized workloads (auto-scaling, container resource utilization, service mesh performance).

Monitoring & Analysis:

• Leverage AppDynamics, Kibana, and BMC TrueSight to analyze system health and identify bottlenecks.
• Produce and maintain Key Performance Indicators (KPIs) and manage service quality/SLA/OLA compliance.
• Provide tuning recommendations for infrastructure components (Application Servers, Database Servers, Message Buses, Web Servers).

Framework & Continuous Improvement:

• Identify, recommend, and implement frameworks, strategies, and toolsets to optimize test execution, expand test coverage, and reduce risk.
• Drive continuous process improvement and test framework/script optimization.
• Automate repetitive tasks.
• Support creation of performance testing artifacts including Performance Test Strategy, Test Plans/Estimates, Optimization Reports, and KPI Dashboards.
• Work in an Agile testing methodology environment.

Technical Skills & Competencies

Core Performance Engineering Skills (Required):

• Load, volume, stress, capacity, and scalability testing design and execution.
• End-to-end application profiling and bottleneck identification.
• Performance test strategy, planning, and documentation.
• SLA/OLA definition, measurement, and reporting.
• Infrastructure tuning (Application Servers, Database Servers, MQ, Web Servers).
• AWR analysis for Oracle database performance.
• SQL performance analysis.
• MongoDB query analysis.
• Kafka performance testing (producer/consumer throughput, lag analysis).
• IBM MQ / RabbitMQ performance and throughput testing.
• ECS containerized workload performance testing.
• C programming for system-level scripting and driver development.
• Java programming for test framework development and automation.
• Agile testing methodology.

Monitoring & Tooling (Required):

• AppDynamics (full-stack APM and profiling).
• Kibana / ELK Stack (log analysis and visualization).
• LoadRunner Enterprise (MF Performance Center).
• BMC TrueSight / HP SiteScope (infrastructure monitoring).

Good to Have:

• Additional programming languages: JavaScript, Python, C#, Ruby.
• Business domain knowledge: Corporate Digital Channels, Payments, Receivables, Treasury & Trade.
• Knowledge of containerization and microservices architectures.

Qualifications

• 5-8 years of experience in an IT Quality role with demonstrated ability to work independently or within cross-functional teams on complex projects.
• In-depth knowledge, understanding, and analytical thought.
• Comprehensive knowledge of IT Quality areas and industry understanding.
• Strong understanding of testing processes, in-depth understanding of the Systems Development Lifecycle (SDLC), and solid experience in several phases of systems development, preferably in testing program management.
• Must demonstrate confidence and ownership in area of expertise.

Education

• Bachelor's / University degree in Computer Science, Information Technology, Engineering, or a related field.
• Equivalent professional experience will also be considered.