In this podcast, Meryem Arik, Co-founder/CEO at TitanML, discusses the innovations in Generative AI and Large Language Model (LLM) technologies including current state of large language models, LLM Deployment, state-of-the-art Retrieval Augmented Generation (RAG) apps, and inference architecture stack for LLM applications.

Read a transcript of this interview: https://bit.ly/3X5ZVPu 

Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:
www.infoq.com/software-architects-newsletter

Upcoming Events:

InfoQ Dev Summit Boston (June 24-25, 2024)
Actionable insights on today’s critical dev priorities.
devsummit.infoq.com/conference/boston2024

InfoQ Dev Summit Munich (Sept 26-27, 2024)
Practical learnings from senior software practitioners navigating Generative AI, security, modern web applications, and more.
devsummit.infoq.com/conference/munich2024

QCon San Francisco (November 18-22, 2024)
Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies.
qconsf.com/

QCon London (April 7-9, 2025)
Discover new ideas and insights from senior practitioners driving change and innovation in software development.
qconlondon.com/

The InfoQ Podcasts:
Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:

- The InfoQ Podcast www.infoq.com/podcasts/
- Engineering Culture Podcast by InfoQ www.infoq.com/podcasts/#engineering_culture
- Generally AI

Follow InfoQ:
- Mastodon: techhub.social/@infoq
- Twitter: twitter.com/InfoQ
- LinkedIn: www.linkedin.com/company/infoq
- Facebook: bit.ly/2jmlyG8
- Instagram: @infoqdotcom
- Youtube: www.youtube.com/infoq

Write for InfoQ:
Learn and share the changes and innovations in professional software development.
- Join a community of experts.
- Increase your visibility.
- Grow your career.
www.infoq.com/write-for-infoq

Transcript

Meryem Arik on LLM Deployment, State-of-the-art RAG Apps, and Inference Architecture Stack

In this episode of the podcast, members of the InfoQ editorial staff and friends of InfoQ will be discussing the current trends in the domain of AI, ML and Data Engineering.

One of the regular features of InfoQ are the trends reports, which each focus on a different aspect of software development. These reports provide the InfoQ readers and listeners with a high-level overview of the topics to pay attention to this year.

InfoQ AI, ML and Data Engineering editorial team met with external guests to discuss the trends in AI and ML areas, and what to watch out for the next 12 months. This podcast is a recording of this discussion where panelists discuss how the innovative AI technologies are disrupting the industry.

Read a transcript of this podcast panel: https://bit.ly/3LXMcUk 
Find the written report and trends graph on InfoQ: https://bit.ly/3Z8Z5CF 

Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies:
www.infoq.com/software-architects-newsletter

Upcoming Events:

InfoQ Dev Summit Munich (Sept 26-27, 2024)
Practical learnings from senior software practitioners navigating Generative AI, security, modern web applications, and more.
devsummit.infoq.com/conference/munich2024

QCon San Francisco (November 18-22, 2024)
Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies.
qconsf.com/

QCon London (April 7-9, 2025)
Discover new ideas and insights from senior practitioners driving change and innovation in software development.
qconlondon.com/

The InfoQ Podcasts:
Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts:

- The InfoQ Podcast www.infoq.com/podcasts/
- Engineering Culture Podcast by InfoQ www.infoq.com/podcasts/#engineering_culture
- Generally AI

Follow InfoQ:
- Mastodon: techhub.social/@infoq
- Twitter: twitter.com/InfoQ
- LinkedIn: www.linkedin.com/company/infoq
- Facebook: bit.ly/2jmlyG8
- Instagram: @infoqdotcom
- Youtube: www.youtube.com/infoq

Write for InfoQ:
Learn and share the changes and innovations in professional software development.
- Join a community of experts.
- Increase your visibility.
- Grow your career.
www.infoq.com/write-for-infoq

AI, ML, and Data Engineering Trends in 2024

¿Quieres usar la inteligencia artificial sin comprometer tu privacidad? Descubre cómo ejecutar Modelos de Lenguaje Grandes (LLM) como LLaMA 3 y Mistral directamente en tu Mac con chips Apple Silicon (M1, M2, M3). En este episodio, te explicamos de manera sencilla por qué la arquitectura de memoria unificada de Apple es ideal para la IA, qué herramientas como Ollama y LM Studio puedes usar, y te damos una guía paso a paso para empezar. Aprende a aprovechar el rendimiento, la eficiencia energética y la privacidad de tu Mac para la IA local. Ideal para desarrolladores, creativos y curiosos de la tecnología.

IA-Local-en-tu Mac-con-Apple-Silicon

A personal reflection on managing AI implementation projects, the challenges of maintaining strategic focus, and the practical realities of working with generative AI in a corporate environment.


AI as a Product: Losing and Finding the North Star

My Soul

My soul

Bruno Flaven has been a Project Manager in a wide variety of Internet (Mobile, Website) for 20 years now. Since 2023, Bruno Flaven is working mainly on AI.

Productor Musical. desarrollador multidisciplinario enfocado en soluciones creativas con inteligencia artificial, seguridad informática y automatización de sistemas. Con experiencia práctica en scripting Python, Bash, y entornos como Termux, LM Studio y Docker, ha construido herramientas de análisis de seguridad para Android, asistentes virtuales locales, y entornos personalizados para interacción hombre-máquina.

Apasionado por el aprendizaje continuo, combina arte digital, música y tecnología para crear experiencias disruptivas que trascienden las plataformas tradicionales. Actualmente trabaja en la integración de asistentes locales inteligentes con visión estética y funcionalidades de ciberseguridad avanzadas.


Software engineers, architects and team leads have found inspiration to drive change and innovation in their team by listening to the weekly InfoQ Podcast. They have received essential information that helped them validate their software development map. We have achieved that by interviewing some of the top CTOs, engineers and technology directors from companies like Uber, Netflix and more. Over 1,200,000 downloads in the last 3 years.

New tracks tagged #Ollama