Product Manager, Applied AI
- Pay
- Not stated
- Required
- Model evaluation, LLMOps and observability, prompt and agent design, Retrieval-augmented generation, Python, SQL
- Experience
- 6+ years
- Visa
- No visa sponsorship
- Posted
- November 17, 2026
- Company
- CSI
Who it can hire
We read the post for each of the 21 countries we cover.
Open to people in the US
The employer lists this job as remote there: “Remote, USA”.
Not open to people in the other 20 countries we cover, as far as the post says.
The job post
Job Description:
This role shapes how generative and agentic AI shows up across our data and digital banking products — building AI experiences that are genuinely useful, and the evaluation backbone that makes them reliable and safe in a regulated industry. The hard part of this work isn't access to models; it's the product discipline to turn powerful but probabilistic capabilities into experiences people trust. You will partner with AI architecture, data science, and engineering to bring AI from promising prototype to dependable production feature.
Responsibilities:
AI Product Strategy & Roadmap
- Own the vision, strategy, and roadmap for LLM-powered and agentic AI experiences across multiple products.
- Identify the highest-value applications of AI for our users and translate them into a prioritized roadmap.
- Balance ambitious experimentation with a clear-eyed view of what can be delivered reliably.
Building Reliable AI Experiences
- Turn probabilistic model capabilities into reliable, valuable, and trustworthy user experiences.
- Define how AI features behave, where humans stay in the loop, and how the product degrades gracefully when models are uncertain.
- Work across emerging agentic patterns and tool/interface standards to expand what AI can do for users.
Evaluation, Quality & LLMOps
- Define the evaluation frameworks, quality bars, and guardrails for AI features, balancing reliability, cost, latency, and safety.
- Partner with AI architecture and data science on the tooling and operating practices — evaluation, observability, and LLMOps — that let AI scale across the portfolio.
- Use quantitative and qualitative signals to continuously improve AI feature performance.
Responsible AI & Compliance
- Champion responsible AI — fairness, privacy, transparency, and accountability — throughout the product lifecycle.
- Partner with risk and compliance stakeholders to ensure AI practices meet the expectations of a regulated, financial-services environment.
Cross-Functional Partnership
- Collaborate closely with AI architecture, data science, engineering, and design to ship AI features from concept to production.
- Communicate AI capabilities, limitations, and trade-offs clearly to both technical and non-technical audiences.
Requirements
- 6+ years of product management experience, with proven experience shipping LLM/GenAI or ML-powered products to production.
- Working knowledge of model evaluation, LLMOps and observability, prompt and agent design, and retrieval-augmented generation (RAG).
- Hands-on familiarity with the modern AI product stack — e.g., LLM evaluation and observability platforms (Langfuse, LangSmith, Helicone), orchestration and agent frameworks (such as LangChain), vector databases and retrieval tooling, and experiment-tracking tools (such as MLflow) — along with comfort using Python and SQL.
- Strong cross-functional leadership and sound judgment on AI risk and safety.
- A Bachelor's degree in a technical or quantitative discipline, with a Master's degree a plus.
Preferred Qualifications
- Financial services or banking industry experience (preferred).
- Experience with agentic systems and tool protocols (e.g., Model Context Protocol).
- A conversational UX background, or experience delivering AI in a regulated industry.
As a forward-thinking software provider, Computer Services, Inc. (CSI) helps community and regional financial institutions solve their customers’ needs through open and flexible technologies. In addition to its award-winning core banking platform, these include the latest in lending, digital banking, payments, financial crime prevention and cybersecurity. Building on its 60-year track record of personalized service, CSI is shaping the future of banking and empowering its customers to rival their competition. For more information about CSI, visit www.csiweb.com
CSI provides rewarding and challenging career opportunities for our employees. When determining your pay, we consider various factors such as your skills, qualifications, experience and location. Along with a competitive salary, this position includes eligibility for incentive awards based on both individual and business performance. We also offer a comprehensive range of benefits. To learn more about our benefits, visit: Benefits Summary
CSI is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, pregnancy, sexual orientation, gender identity, national origin, age, physical and mental disability, marital status, veteran status, or any other characteristic protected by applicable law. If you need an accommodation during the recruitment process, please email us at recruiter@csiweb.com and we will work with you to meet your accessibility needs.
For applicants residing in California, please read Privacy Notice for California Residents | CSI (csiweb.com)
Visa Sponsorship: We are unable to offer visa sponsorship for this position. Applicants must be authorized to work in the United States without the need for sponsorship now or in the future.
First Monday isn’t the employer or a recruiter and isn’t affiliated with CSI. Details may have changed since; confirm with the employer before you apply.