Enterprises struggle with productionizing LLM-powered applications due to a lack of established practices, and developer constraints in productionizing LLM-powered applications. Moving beyond PoCs is especially difficult for conversational applications.
Inspired by how Netflix Championed microservices, we created the Intelligent Agents Platform (iA Platform) to reimagine AI development with agents as core building blocks, addressing these challenges and ensuring rapid adaptability. Outcome:
- Deployed LLM chat and voice apps across Europe, reducing agent handover by 20%.
- Achieved nearly 85% acceptable answers with less than 5% hallucinations.
- Enabled fast, independent agent development, cutting dev time for an agent to under a week.
Speaker
Arun Joseph
AI Engineering Lead @Deutsche Telekom, Previously Built IIoT Platforms for Merck, Thought Leader & Builder
Arun Joseph leads the Architecture and Engineering teams at Deutsche Telekom's AI Competence Center, driving the development and deployment of cutting-edge Generative AI (GenAI) solutions group wide across Europe. As a thought leader in applied AI, Arun has spearheaded the creation of an enterprise-grade agents computing platform, which now powers Deutsche Telekom’s LLM powered AI applications , including the award-winning service bot, Frag Magenta.
Arun is deeply passionate about the potential of GenAI solutions and the engineering design that heralds a new era of computing. His commitment to building world-class digital products and systems is matched by his dedication to nurturing top-tier teams. He is also an advocate for open source development; under his leadership, his teams have open source agents development frameworks.
Outside of work, Arun is a staunch advocate for the ethical deployment of technology, particularly AI. He champions the concept of the "Right to AI", striving for a more equitable world where access to AI is justly and ethically enabled for all.
Find Arun Joseph at:
Speaker
Patrick Whelan
Senior Software Engineer @Deutsche Telekom, 20+ Years in Engineering Enterprise Front- and Backends
- Over 20 years as Software Engineer, building enterprise Applications, both in the backend and frontend.
- Spent the last year as a lead Engineer on building an LLM-powered ChatBot for the Deutsche Telekom.
- Prior joining the AI Team, worked on applications around IoT, Cloud Service, and Content Management Systems for Online Portals.
- Interested in Koltin, Flutter and creating innovative applications around Generative AI.
- Creator and maintainer of the Kotlin AT framework
Arc: Agents Reactor (https://lmos-ai.github.io/arc)
