The role
From JPMorgan Chase's own posting.
Join us to shape the future of AI-powered solutions at JPMorganChase. You’ll leverage the firm’s scale, data, and technology to deliver measurable impact across the Commercial & Investment Bank and Payments. As a Lead AI and ML Engineer, you’ll collaborate with talented teams in a fast-paced environment, building agents that real businesses depend on. We offer opportunities for career growth, exposure to cutting-edge platforms, and the chance to make a difference in a regulated, secure setting.
As a Lead AI and ML Engineer in Digital & Platform Services / Data Analytics, you will design, productionize, and operate LLM-powered Agentic Commerce B2B agents on NEO. You will apply MLOps for automation, continuous delivery, and compliance, turning innovative ideas into shipped, production-grade agents. You’ll partner closely with business, product, data science, and engineering teams, expanding NEO’s portfolio of production agents across CIB sub-LOBs and Payments. Your work will help drive secure, auditable, and impactful AI solutions.
Job Responsibilities:
Design and ship production agents on NEO, owning them from prototype through production
Build robust retrieval systems using Graph RAG, knowledge-graph traversal, vector search, chunking, ranking, and grounding strategies
Design agent memory, including episodic and semantic memory nodes, recall, summarization, and decay policies
Manage organizational context, assembling entitlement-, lineage-, and tenant-aware context for secure agent reasoning
Compose multi-agent workflows using A2A and integrate tools and data through MCP servers (Bitbucket, Confluence, Databricks, Kubernetes, Snowflake, Splunk)
Build and run task-level and end-to-end agent evaluations, regression suites, LLM-as-judge, and quality/safety gating
Deploy and operate solutions on public cloud (AWS and/or Azure) with strong SDLC, security, resiliency, and observability practices
Partner with product and business teams to turn use cases into shipped, supported agents
Build traditional ML model training pipelines and productionize them using MLOps best practices
Develop batch and online inference for ML models
Required Qualifications, Capabilities, and Skills:
MS in Computer Science, Statistics, Mathematics, Machine Learning, or related field (or equivalent experience)
Hands-on experience building LLM-powered or agentic applications in production, including tracing, evaluations, and guardrails
Strong programming skills in Python, with deep knowledge of data structures, algorithms, machine learning, data mining, information retrieval, and statistics
Knowledge of Kubernetes (AWS EKS)
Experience with training models in Databricks and SageMaker
Experience working with MLFlow
Practical RAG experience—retrieval quality, embeddings, and vector stores; Graph RAG a strong plus
Expert knowledge of at least one of: AWS, Azure, Kubernetes
Knowledge of data management and data model design; real-time processing using SQL (e.g., Postgres) and NoSQL stores (e.g., OpenSearch, Redis)
Excellent communication skills with the ability to partner effectively with senior technical and business stakeholders
Preferred Qualifications, Capabilities, and Skills:
Experience with agent frameworks or runtimes, A2A, or MCP
Agent memory design (memory nodes, episodic/semantic memory) and organizational context management
Knowledge graphs and graph databases used for retrieval
Understanding of LLM fine-tuning and small language model inference
Ability to develop full-stack products using modern JavaScript/TypeScript frameworks (e.g., Next.js, Svelte) for agent UIs (AG-UI / NEO UI SDK)
Experience working in the financial or payments domain at a large institution