Job Description
Here’s a summary of the role:
You’ll use your applied machine learning andgenerative AIskills to design and ship LLMp owered product experiences that solve real problems for real users. You turn messy documents and complex language into smart assistants, agentic solutions, and search experiences that feel fast, reliable, and trustworthy.
In this role you work end -to- end: framing problems, shaping prompts and workflows, orchestrating tools and retrieval, and partnering with engineers and product managers to bring modern AI into production. If you enjoy building with large language models and care deeply about evaluation, safety, and impact, you’ll feel at home here.
Here’s a breakdown of what you’ll do (not all of it, just the important stuff):
Design, prototype, and refine LLM b ased featuresover large document sets.
Orchestrate multistep, agentic workflows and tool calling (including MCP servers and other integrations) so LLMs can take meaningful actions, not just generate text.
Define evaluation frameworks, experiments, and metrics so you can measure model quality, relevance, and safety with confidence.
Use AWS services(i.e. AWS Bedrock) to deliver reliable, secure, and scalable AI capabilities.
Work closely with domain experts, PMsand software engineers to turn prototypes into reliable, productionready services.
Handle complex, domainspecific text (e.g. legal, financial, or regulatory content) with a strong focus on accuracy, robustness, and privacy.
Communicate your findings clearly, share best practices, and stay up to date with the latest ML and AI research that can improve your solutions.
These are the essentials you’ll need to get an interview:
Hands-on experience building LLMpoweredapplications or features (for example RAG systems, chatbots, assistants, agentic solutionsor documentcentric workflows) — not just using chat interfaces.
Strong Python skills and everyday comfort with the modern data / AI ecosystem (e.g. pandas, NumPy, basic ML libraries, HTTP APIs, and SDKs for cloud AI services).
Practical experience with LLM powered solutiondesign, evaluation, and iteration: you know how to test, compare approaches, and choose the one that works best with real data.
Familiarity with at least one cloud platform (ideally AWS) and building or contributing to services or pipelines that run in production.
A degree in Computer Science, Data/Applied Science, Mathematics, Statistics, or a related technical field, or equivalent practical experience.
Clear communication skills, collaborative mindset, and a genuine interest in learning, sharing knowledge, and iterating quickly based on feedback.
It would be great if you had these to, but we’ll support you if you don’t:
Experience designing and implementing agentic workflows (multistep reasoning, toolcalling, planners) and/or building MCP servers or similar tool integrations.
Hands-on experience with AWS Bedrock or comparable platforms (model selection, configuration, guardrails, evaluation, and cost/performance trade-offs).
Experience with semantic search, vector databases, and information retrieval techniques in production systems.
Familiarity with observability and evaluation for LLM applications (e.g. logging, feedback loops, offline and online evaluation, safety checks).
Experience working with complex or regulated content such as legal, risk, compliance, financial, or governance documents.
#LI-Hybrid
About Us
Diligent is the AI leader in governance, risk and compliance (GRC) SaaS solutions, helping more than 1 million users and 700,000 board members to clarify risk and elevate governance. The Diligent One Platform gives practitioners, the C-Suite and the board a consolidated view of their entire GRC practice so they can more effectively manage risk, build greater resilience and make better decisions, faster.
At Diligent, we’re building the future with people who think boldly and move fast. Whether you’re designing systems that leverage large language models or part of a team reimaging workflows with AI, you’ll help us unlock entirely new ways of working and thinking. Curiosity is in our DNA, we look for individuals willing to ask the big questions and experiment fearlessly - those who embrace change not as a challenge, but as an opportunity. The future belongs to those who keep learning, and we are building it together. At Diligent, you’re not just building the future - you’re an agent of positive change, joining a global community on a mission to make an impact.
Learn more at diligent.com or follow us on LinkedIn and Facebook
What Diligent Offers You
- Creativity is ingrained in our culture. We are innovative collaborators by nature. We thrive in exploring how things can be differently both in our internal processes and to help our clients
- We care about our people. Diligent offers a flexible work environment, global days of service, comprehensive health benefits, meeting free days, generous time off policy and wellness programs to name a few
- We have teams all over the world. We may be headquartered in New York City, but we have office hubs in Washington D.C., Vancouver, London, Galway, Budapest, Munich, Bengaluru, Singapore, and Sydney.
- Diversity is important to us. Growing, maintaining and promoting a diverse team is a top priority for us. We foster and encourage diversity through our Employee Resource Groups and provide access to resources and education to support the education of our team, facilitate dialogue, and foster understanding.
Diligent created the modern governance movement. Our world-changing idea is to empower leaders with the technology, insights and connections they need to drive greater impact and accountability – to lead with purpose. Our employees are passionate, smart, and creative people who not only want to help build the software company of the future, but who want to make the world a more sustainable, equitable and better place.
Headquartered in New York, Diligent has offices in Washington D.C., London, Galway, Budapest, Vancouver, Bengaluru, Munich, Singapore and Sydney. To foster strong collaboration and connection, this role will follow a hybrid work model. If you are within a commuting distance to one of our Diligent office locations, you will be expected to work onsite at least 50% of the time. We believe that in-person engagement helps drive innovation, teamwork, and a strong sense of community.
We are a drug free workplace. Diligent is proud to be an equal opportunity employer. We do not discriminate based on race, color, religious creed, sex, national origin, ancestry, citizenship status, pregnancy, childbirth, physical disability, mental disability, age, military status, protected veteran status, marital status, registered domestic partner or civil union status, gender (including sex stereotyping and gender identity or expression), medical condition (including, but not limited to, cancer related or HIV/AIDS related), genetic information, or sexual orientation in accordance with applicable federal, state and local laws. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. See also Diligent’s EEO Policy and Know Your Rights. We are committed to providing reasonable accommodations for qualified individuals with disabilities and disabled veterans in our job application procedures. If you need assistance or an accommodation due to a disability, you may contact us at [email protected].
To all recruitment agencies: Diligent does not accept unsolicited agency resumes. Please do not forward resumes to our jobs alias, Diligent employees or any other organization location. Diligent is not responsible for any fees related to unsolicited resumes.
