Senior MLOps / LLMOps Engineer

Job Description

Why Scout24?

Scout24 is home of ImmoScout24, Germany’s #1 for real estate. With ImmoScout24 we have been revolutionizing the real estate market in Germany and Austria for more than 25 years. Our goal is to build a digital ecosystem that brings homeowners, seekers, and agents together. Finding the right home and property is one of the most important decisions in life. So is your career! #WorkingatScout24 means being part of a diverse and inclusive team of around 1100 colleagues and 58 nationalities. We embrace difference and celebrate individuality. By encouraging open mindedness and authenticity we enable a true learning culture and prepare the ground for personal development.  Mistakes are a chance to grow and to innovate. Together we act proactively, strive for improvement, and take responsibility. We talk about success and challenge while treating each other with respect because we are #oneteam.

If this sounds interesting to you, we would love to see you joining us!  Even if you may not tick all the boxes of the job requirements, we are happy to hear about the value you can add to the team.  Grow with us!. Welcome home!

Aside from our people and company culture we are offering awesome benefits that make Scout24 a great place to work!

• Compensation: A competitive salary package and a bonus on top.
• Flexibility: We offer a hybrid work model with three days of on-site work per week in the office, and you can organize the remaining days as you wish. We offer you 30 days of vacation per year.
• Work from abroad: We offer you the possibility to work from abroad for 10 days per year, subject to the business requirements of the company and team.
• Relocation: Our relocation agency supports you with your visa process and an attractive relocation package.
• Use our products: As an employee you can take advantage of our plus membership for tenants on ImmoScout24 to find a new place to live.
• Development: Dedicated learning time per month, online courses on our ScoutAcademy, regular book challenges, structured feedback, “Lunch & Learn”-Events and individual career paths to push your career to the next level.
• Have kids? We’ll support you with a professional family service, which helps you to find a childcare center or offers emergency childcare.
• Furry feel good manager: Bring your dog to work (upon approval, as we prioritise the well-being of our employees and ensure that our dog policy is considerate of allergic individuals and prevents overcrowding on each office floor).
• Mobility: We subsidize public transport or Job Bikes.
• Commitment to sustainability and Diversity, Equity & Inclusion (DEI): We have clear environmental and climate protection goals and are involved in social activities and charitable organizations throughout the year. We live the diversity. Our theme weeks on diversity, mental well-being, and other social issues give us time and space to develop ourselves on DEI and sustainability.
• Pension scheme: We offer a company pension scheme and support your own contribution with an attractive subsidy.
• Most innovative office: Our office is barrier-free and in the heart of Berlin right at the central station. It was awarded for the most innovative office concept. We have an own gym with regular courses, napping room, rooftop terrace, organic coffee, cafeteria, 100% green electricity and a massage therapist that comes in once a week.
• Health: Life Situation Coaching, regular health check ups
• We are a tech company: We work with the latest technical tools and hardware.

Build and operate scalable ML and LLM-based systems in production, with a focus on self-hosted models, evaluation frameworks, and platform reliability. You will help shape Scout24’s AI platform by enabling teams to efficiently develop, deploy, and scale both traditional ML and generative AI solutions for multi-modal use cases.

Working at the intersection of software engineering, ML platform engineering, and product, you ensure ML/LLM applications are robust, observable, and cost-efficient. You establish best practices for LLMOps, including gateway services, MCP integrations, evaluation, and lifecycle management, while leveraging AI-native workflows to drive faster development and higher engineering productivity.

How your role will look like:

• Design and maintain scalable ML/LLM infrastructure and pipelines
• Productionize traditional ML and generative AI solutions with cross-functional product teams
• Own the ML/LLMOps lifecycle: prompting, deployment, monitoring, evaluation and optimization
• Build and evolve an LLM Gateway service to standardize access, routing, and governance
• Develop evaluation frameworks to measure quality, performance, and reliability of LLM outputs
• Design and implement MCP-compatible services to enable standardized context exchange between LLMs, tools, and data sources
• Integrate MCP into internal platforms to support tool use, retrieval, and agent-based workflows across teams
• Work with AWS and integrate self-hosted open-source AI models for scalable, secure applications
• Ensure observability, cost efficiency, and system performance
• Contribute to project management, stakeholder communication and cross-team collaboration

What you need to succeed:

• Strong experience in MLOps (CI/CD, Docker, Kubernetes) and operating production-grade systems
• Proficiency in Python and solid software engineering and scalable system design skills
• Hands-on experience with LLMs and generative AI technologies (e.g.GPT, Gemini or Anthropic-like models)
• Expertise in prompt engineering, agent orchestration, context management, and output validation
• Experience with LLM evaluation frameworks and deploying self-hosted LLMs
• Familiarity with cloud platforms (e.g. AWS, GCP) as well as DevOps, testing, and observability practices
• Strong communication skills and ability to collaborate with cross-functional teams and stakeholders

We aim to further enhance the diversity of our company and support the professional development of people with disabilities. We have a disability representative who will assist you throughout the application process. If you require this support, please let us know in advance.