AI Solutions Architect

Job Family:

Data Science & Analysis

Travel Required:

Up to 10%

Clearance Required:

Active Top Secret (TS)

Guidehouse is seeking an AI Solutions Architect / Technical Lead to join our Technology / AI and Data team, supporting mission-critical initiatives for Defense and Security clients. In this role, you will serve as the principal architect for advanced AI platforms, driving end-to-end design across ingestion, retrieval-augmented generation (RAG), large language model (LLM) inference, and secure, scalable workflows. You will provide technical leadership and architectural governance to ensure coherence, performance, and compliance with stringent federal standards, while collaborating with engineers, data specialists, and mission stakeholders to deliver innovative solutions that enable data-driven decision-making. This is an opportunity to shape cutting-edge AI capabilities that directly support national security objectives.

What You Will Do:

• Serves as the principal technical architect for the FBI adjudication AI platform, responsible for end-to-end architecture spanning ingestion, RAG, LLM inference, structured scoring, continuous learning loops, and analyst-facing mission workflows.
• Leads a dual-path LLM strategy that supports self-hosted open‑weight LLMs in AWS GovCloud as well as FedRAMP High managed model endpoints, ensuring secure, scalable, compliant, and mission‑aligned model operations.
• Provides architectural governance across backend services, model pipelines, data engineering, DevSecOps, and UI/UX components to ensure coherence, performance, and SEAD‑4 adjudication alignment.
• Ensures platform architecture conforms to FedRAMP High, RMF, NIST 800‑53, and FBI ATO requirements, including boundary definition, logging standards, and continuous monitoring readiness.

Architecture & Platform Leadership

• Define the complete technical architecture for document ingestion, long‑document processing, embedding generation, vector search, anomaly detection, LLM inference, and adjudication memo generation components.
• Architect scalable infrastructure for 200M+ tokens/month processing volumes, supporting GPU‑based inference clusters, model routers, caching layers, and workflow orchestration services.
• Establish architectural standards for both self‑hosted GPU clusters and managed model endpoints, defining patterns for batching, KV‑cache utilization, parallel inference, and latency optimization.
• Produce architectural diagrams, sequence flows, integration contracts, and service interaction models to guide all development teams and maintain architectural consistency.

AI/ML Workflow & Learning Strategy

• Oversee design of AI/ML workflows supporting entity extraction, evidence linkage, SEAD‑4 scoring, anomaly detection, summarization, and document reasoning.
• Define fine‑tuning strategies using SFT, LoRA/QLoRA, dataset curation, evaluation pipelines, drift monitoring, and regression testing for consistent model quality.
• Establish standards for retrieval‑augmented generation (RAG), including embedding selection, retrieval indexing, chunking strategies, context assembly, and chain‑of‑thought management.
• Build monitoring patterns to detect hallucinations, scoring inconsistencies, bias, and model performance degradation across adjudicative domains.

Security, Compliance & ATO Alignment

• Ensure architecture supports FedRAMP High and RMF controls across data governance, encryption, access management, logging, segmentation, and monitoring.
• Author ATO documentation including SSPs, boundary diagrams, data flow diagrams, control implementation statements, and continuous monitoring artifacts.
• Embed secure‑by‑design engineering practices across APIs, data pipelines, LLM workflows, inference gateways, and audit logging layers.
• Define end‑to‑end auditability standards capturing prompts, model outputs, retrieval contexts, scoring rationales, and analyst overrides.

Technical Leadership & Stakeholder Engagement

• Provide senior engineering guidance to FBI leadership, translating complex model architecture, system behavior, and design tradeoffs into mission‑relevant insights.
• Guide sprint planning, backlog prioritization, code review practices, engineering QA, and decision analysis across AI/ML, backend, cloud, and security teams.
• Mentor senior engineers and ensure adherence to best practices for LLM integration, microservices development, and secure cloud operations.
• Collaborate directly with adjudicators, policy SMEs, mission stakeholders, and IT partners to ensure platform capabilities meet operational requirements.

Innovation & Mission Enhancement

• Identify and evaluate new technologies—including multimodal LLMs, knowledge graphs, retrieval fusion methods, and reasoning verification tools—to improve mission outcomes and analyst efficiency.
• Develop long‑term modernization strategies around learning loops, evidence provenance tracking, justification generation, and adaptive adjudication workflows.
• Support Guidehouse AI strategy, whitepapers, proposals, and federal AI modernization initiatives through technical leadership and domain expertise.

What You Will Need:

• An ACTIVE and MAINTAINED "TOP SECRET" Federal or DoD security clearance.

• 8+ years of experience designing secure, scalable cloud architectures using container orchestration, distributed systems, workflow automation, microservices, and GPU-accelerated workloads.

• Deep expertise in AWS GovCloud, Kubernetes/EKS, GPU workloads, distributed systems, workflow orchestration, and microservice architecture.

• Proven experience architecting AI/ML or LLM-enabled platforms.

• Experience working within FedRAMP High, RMF or similar compliance frameworks.

• Ability to lead multi-disciplinary engineering teams and define end-to-end system architectures.

What Would Be Nice To Have:

• An ACTIVE and MAINTAINED "TOP SECRET" Federal or DoD security clearance.

  • Once onboard with Guidehouse, new hire MUST be able to OBTAIN and MAINTAIN a Federal or DoD "TOP SECRET/SCI (TS/SCI)" security clearance.

• AWS GovCloud services (EC2, S3, EKS, Lambda, KMS, API Gateway, etc.)

• Kubernetes/EKS specifically (vs. generic container orchestration).

• Step Functions / EventBridge / Bedrock.

• Vector DB experience (FAISS, pgvector, Milvus).

• LLM serving frameworks (vLLM, TGI, Sagemaker).

• Experience with SEAD‑4 adjudication, personnel vetting, continuous vetting, or investigative review workflows.

• Experience fine‑tuning open‑weight LLMs in secure or air‑gapped environments using LoRA/QLoRA or SFT.

• Experience with knowledge graphs, entity resolution pipelines, reasoning verification, or explainability frameworks.

• AWS Solutions Architect Professional, Security, or Machine Learning certifications.

What We Offer:

Guidehouse offers a comprehensive, total rewards package that includes competitive compensation and a flexible benefits package that reflects our commitment to creating a diverse and supportive workplace.

Benefits include:

• Medical, Rx, Dental & Vision Insurance

• Personal and Family Sick Time & Company Paid Holidays

• Position may be eligible for a discretionary variable incentive bonus

• Parental Leave and Adoption Assistance

• 401(k) Retirement Plan

• Basic Life & Supplemental Life

• Health Savings Account, Dental/Vision & Dependent Care Flexible Spending Accounts

• Short-Term & Long-Term Disability

• Student Loan PayDown

• Tuition Reimbursement, Personal Development & Learning Opportunities

• Skills Development & Certifications

• Employee Referral Program

• Corporate Sponsored Events & Community Outreach

• Emergency Back-Up Childcare Program

• Mobility Stipend

About Guidehouse

Guidehouse is an Equal Opportunity Employer–Protected Veterans, Individuals with Disabilities or any other basis protected by law, ordinance, or regulation.

Guidehouse will consider for employment qualified applicants with criminal histories in a manner consistent with the requirements of applicable law or ordinance including the Fair Chance Ordinance of Los Angeles and San Francisco.

If you have visited our website for information about employment opportunities, or to apply for a position, and you require an accommodation, please contact Guidehouse Recruiting at 1-571-633-1711 or via email at RecruitingAccommodation@guidehouse.com. All information you provide will be kept confidential and will be used only to the extent required to provide needed reasonable accommodation.

All communication regarding recruitment for a Guidehouse position will be sent from Guidehouse email domains including @guidehouse.com or guidehouse@myworkday.com.  Correspondence received by an applicant from any other domain should be considered unauthorized and will not be honored by Guidehouse.  Note that Guidehouse will never charge a fee or require a money transfer at any stage of the recruitment process and does not collect fees from educational institutions for participation in a recruitment event. Never provide your banking information to a third party purporting to need that information to proceed in the hiring process.

If any person or organization demands money related to a job opportunity with Guidehouse, please report the matter to Guidehouse’s Ethics Hotline. If you want to check the validity of correspondence you have received, please contact recruiting@guidehouse.com. Guidehouse is not responsible for losses incurred (monetary or otherwise) from an applicant’s dealings with unauthorized third parties.

Guidehouse does not accept unsolicited resumes through or from search firms or staffing agencies. All unsolicited resumes will be considered the property of Guidehouse and Guidehouse will not be obligated to pay a placement fee.