Orchestrating AI Services with the Spring AI Framework

Modern AI applications demand more than just prompt engineering—they require orchestration of models, search, and tools into a cohesive system. In this talk, we’ll show how the Spring AI Framework empowers you to do exactly that, using the full power of the Spring ecosystem. We’ll dive into practical examples of integrating LLMs like OpenAI or Ollama, combining them with vector search, and wiring API tools using Spring AI’s native function-calling support. You’ll see how prompt templates and observability are handled with familiar Spring Boot conventions. Whether you’re building intelligent assistants, RAG pipelines, or AI-first APIs, this session will help you go from prototype to production with clean architecture, modular code, and fully Spring-native solutions.