AI / ABAP Architect (f/m/d) - ABAP AI Central

We help the world run better
At SAP, we keep it simple: you bring your best to us, and we'll bring out the best in you. We're builders touching over 20 industries and 80% of global commerce, and we need your unique talents to help shape what's next. The work is challenging – but it matters. You'll find a place where you can be yourself, prioritize your wellbeing, and truly belong. What's in it for you? Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed. 

 

 

What you’ll build 

 

In this role, you’ll design and deliver model-agnostic AI related solution architectures for ABAP landscapes - integrating ABAP Cloud, Private Cloud, Public Cloud, SAP BTP (AI Core/Launchpad), and other SAP and Non SAP Integrations. You’ll create reusable patterns for RAG, prompt templates, multi-model routing/fallback, semantic caching, and guardrails so teams ship reliable, secure AI features faster. You’ll define SLOs for quality, latency, and cost, and implement LLMOps (evaluation harnesses, registries, CI/CD) to keep solutions current as models evolve. You’ll lead TCO modeling and cost governance (token budgets, batching, context strategies, provider choices) to ensure scalable, compliant, and margin-aware AI. Your work will improve ABAP developer experience, reduce inference spend, and unlock safe AI capabilities for partners and customers.

 

What you bring

 

• Deep SAP ABAP expertise (ABAP Cloud, RAP, CDS, OData) and SAP BTP integration 
• Hands-on GenAI/LLM architecture: RAG, embeddings, prompt engineering, evaluation 
• LLMOps & observability: prompt/model versioning, Benchmarking
• Proven TCO modeling & runtime cost controls (limits, caching, etc) 
• Security, privacy, and Responsible AI for enterprise/regulated contexts 
• Stakeholder leadership with product, partners, and customers; clear communication 
• Nice-to-have: AI Core/Launchpad, Kyma/Kubernetes, major cloud AI

 

Where you belong

 

You’ll join a pragmatic central team focused on simplicity, safety, and measurable outcomes. We partner with product and customers, share reusable assets, and mentor ABAP devs. You’ll thrive with hands-on architecture, fast iteration with guardrails, and shaping SAP’s AI backbone.

 

#SAPABAPCareers #ABAP #GenAI #LLMOps #RAG #SAPBTP #RAP #LI-JH2 

 

​

Bring out your best
SAP innovations help more than four hundred thousand customers worldwide work together more efficiently and use business insight more effectively. Originally known for leadership in enterprise resource planning (ERP) software, SAP has evolved to become a market leader in end-to-end business application software and related services for database, analytics, intelligent technologies, and experience management. As a cloud company with two hundred million users and more than one hundred thousand employees worldwide, we are purpose-driven and future-focused, with a highly collaborative team ethic and commitment to personal development. Whether connecting global industries, people, or platforms, we help ensure every challenge gets the solution it deserves. At SAP, you can bring out your best.  

We win with inclusion
SAP’s culture of inclusion, focus on health and well-being, and flexible working models help ensure that everyone – regardless of background – feels included and can run at their best. At SAP, we believe we are made stronger by the unique capabilities and qualities that each person brings to our company, and we invest in our employees to inspire confidence and help everyone realize their full potential. We ultimately believe in unleashing all talent and creating a better world.

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. If you are interested in applying for employment with SAP and are in need of accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to Recruiting Operations Team: Careers@sap.com.

For SAP employees: Only permanent roles are eligible for the SAP Employee Referral Program, according to the eligibility rules set in the SAP Referral Policy. Specific conditions may apply for roles in Vocational Training.