Principal Engineer - Observability Events Management

About this role:

Wells Fargo is seeking a Principal Engineer in Technology as part of our CTO organization. Learn more about the career areas and lines of business at wellsfargojobs.com.

Wells Fargo is seeking a Principal Engineer to play a key role in driving technology‑led innovation at enterprise scale. This role will help transform Telemetry, Monitoring, and Observability across on‑premises platforms as well as private and public cloud environments.

Our vision is to deliver best‑in‑class observability capabilities that provide consumer‑grade insights at a competitive cost by leveraging open‑source technologies and open standards. Through this modernization, we aim to reduce the cost of failure, improve platform availability, and optimize software engineering capacity across the enterprise.

In this role, you will:

• Act as an advisor to leadership to develop or influence applications, network, information security, database, operating systems, or web technologies for highly complex business and technical needs across multiple groups
• Lead the strategy and resolution of highly complex and unique challenges requiring in-depth evaluation across multiple areas or the enterprise, delivering solutions that are long-term, large-scale and require vision, creativity, innovation, advanced analytical and inductive thinking
• Translate advanced technology experience, an in-depth knowledge of the organizations tactical and strategic business objectives, the enterprise technological environment, the organization structure, and strategic technological opportunities and requirements into technical engineering solutions
• Provide vision, direction and expertise to leadership on implementing innovative and significant business solutions
• Maintain knowledge of industry best practices and new technologies and recommends innovations that enhance operations or provide a competitive advantage to the organization
• Strategically engage with all levels of professionals and managers across the enterprise and serve as an expert advisor to leadership

Required Qualifications:

• 7+ years of Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
• 3+ years of experience with distributed streaming and event driven architectures, using technologies such as Kafka
• 3+ years of experience in database design and data architecture, including relational and/or NoSQL systems, data modeling, and high throughput data access patterns
• 7+ years of programming experience in Java, C# and/or Python, building scalable, production grade backend systems and APIs

Desired Qualifications:

• AIOps expertise spanning alert ingestion, correlation, enrichment, and AI‑driven incident analysis within large‑scale enterprise observability platforms.
• Experience in AI/ML technologies, including Large Language Models (LLMs), prompt engineering, model integration, or applied machine learning in production environments
• Experience designing and integrating APIs and microservices, including REST/gRPC services and service orchestration patterns
• Knowledge of API security, OAuth, authentication/authorization platforms, and reverse proxy or gateway patterns
• Experience working with cloud native platforms like OCP, including containerization, distributed systems, and scalable deployment models
• Experience incident & problem management, technology change management and performance testing and tuning
• Experience with system design and architecture for high scale applications, including performance optimization, fault tolerance, and resiliency
• Strong verbal, written, and interpersonal communication skills
• Ability to influence and build relationships with LOB stakeholders, technology leadership, external service providers, and architecture teams
• Experience of modern software development lifecycle, including TDD, CI/CD, Pairing, Build Automations, Automated Testing, Agile Games, Chaos Engineering
• Knowledge of Agile methodologies, and product operating model
• Knowledge and understanding of application or software security: web application penetration testing, secure code review, secure static code analysis
• Knowledge and understanding of technology architecture: solutions development
• Knowledge and understanding of complex enterprise systems and frameworks including frontends, middleware, services layer, database, backend, and downstream interfaces

Job Expectations:

• Willingness to work on-site at stated location on the job opening

Pay Range
 

Reflected is the base pay range offered for this position. Pay may vary depending on factors including but not limited to demonstrated examples of prior performance, skills, experience, or work location. Employees may also be eligible for incentive opportunities.

$159,000.00 - $305,000.00

Posting End Date:

26 Apr 2026

*Job posting may come down early due to volume of applicants.

We Value Equal Opportunity

Wells Fargo is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other legally protected characteristic.

Employees support our focus on building strong customer relationships balanced with a strong risk mitigating and compliance-driven culture which firmly establishes those disciplines as critical to the success of our customers and company. They are accountable for execution of all applicable risk programs (Credit, Market, Financial Crimes, Operational, Regulatory Compliance), which includes effectively following and adhering to applicable Wells Fargo policies and procedures, appropriately fulfilling risk and compliance obligations, timely and effective escalation and remediation of issues, and making sound risk decisions. There is emphasis on proactive monitoring, governance, risk identification and escalation, as well as making sound risk decisions commensurate with the business unit’s risk appetite and all risk and compliance program requirements.

Applicants with Disabilities

To request a medical accommodation during the application or interview process, visit Disability Inclusion at Wells Fargo.

Drug and Alcohol Policy

 

Wells Fargo maintains a drug free workplace.  Please see our Drug and Alcohol Policy to learn more.

Wells Fargo Recruitment and Hiring Requirements:

a. Third-Party recordings are prohibited unless authorized by Wells Fargo.

b. Wells Fargo requires you to directly represent your own experiences during the recruiting and hiring process.