The Prompt Desk

Conversations about LLMs, prompt design and more.

Listen

Episodes

How do we know if Llama 3 is actually any better with Maxime Labonne

If you are anything like us, for 36 hours your Twitter and LinkedIn feeds were set ablaze by claims that Llama 3 is the greatest LLM since sliced bread. But how do we know that is actually the case? How do we separate the hype and noise from the reality? On what basis can we credibly claim that one LLM is better than another?On this episode of The Prompt Desk, Justin Macorin and I brought on LLM expert Maxime Labonne, who has developed the open-source package LLM-autoeval. In the episode, he shares with us the techniques researchers are using to compare and contrast different LLM models.Check out the LLM-autoeval Github here: https://github.com/mlabonne/llm-autoevalFind Maxime Labonne on LinkedIn here: https://www.linkedin.com/in/maxime-labonne/Follow Maxime on Twitter here: https://twitter.com/maximelabonne?lang=en—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

The Importance of Decomposition in Prompt Engineering

As AI language models become increasingly powerful, more and more people are discovering the potential of well-crafted prompts to boost productivity and solve complex problems. Justin and Brad share their expertise on designing effective prompts that adhere to rigorous engineering principles. They highlight real-world examples of prompts that have yielded impressive results and provide valuable insights into the art and science of prompt engineering. We discuss decomposing problems into manageable steps, offering strategies to optimize this process for maximum efficiency.Check out the latest episode of The Prompt Desk to learn more about decomposition and prompts.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

How LLM’s have changed MLOps with Andy McMahon

What is LLM and ML Ops? How has the field of MLOps changed with the introduction of LLM models? What is the emerging field of Prompt Ops? How should we measure the effectiveness of our models in production? To answer these questions, we invited MLOps expert Andrew McMahon to chat.Check out Andrew's LinkedIn, Twitter, and book using these links:Linkedin - https://www.linkedin.com/in/andrew-p-mcmahon/ Twitter/X - @electricweegieBook - https://packt.link/w3JKL—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

A Process for Prompt Experimentation

Dive into the exciting world of prompt experimentation and uncover the secrets to crafting the perfect prompts! In this episode, we share our tried-and-true techniques for iterative prompt engineering, from running prompts on realistic inputs to making creative modifications that can transform a prompt's performance. We also explore the tantalizing possibilities of using datasets to generate prompts and the challenges of integrating AI conditional logic into source code - it's a wild ride you won't want to miss!—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Prompt Injections to Coerce any LLM to do Anything You Want with Jonas Geiping

Prompt Injections might be the single biggest risk to the deployment of LLM systems. In this episode of The Prompt Desk, your host Bradley Arsenault sits down with researcher Jonas Geiping to talk about his research on LLM security.Jonas and his colleagues have found optimization techniques that allow them to find prompts that they can put into any LLM model that can make it do anything. The open-ended nature of the AI security flaws they have found pose serious risks to pretty much any company adopting LLM technology.See the paper: "Coercing LLMs to do and reveal (almost) anything": https://arxiv.org/abs/2402.14020Add Jonas Geiping on LinkedIn: https://www.linkedin.com/in/jonas-geiping-9684441b5/—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Is Your AI Really an Agent?

Explore the six essential components that define an AI agent in 2024, including input/output, memory, loops and recursion, third-party actions, and comprehension. Join Brad and Justin as they discuss the criteria needed for a sophisticated AI system to be considered an agent, and how these requirements contribute to realizing the sci-fi vision of AI depicted in movies.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

AI Agents in the Enterprise with Alan Wunsche

Are you wondering how LLM Agents can be applied in large enterprises? Are we all going to become managers to teams of AI systems, cobbled together like a rag-tag group of robot butlers? In the latest episode of The Prompt Desk, hosts Justin Macorin and Bradley Arsenault sit down with Alan Wunsche to talk about the deployment and rollout of AI agents in enterprise business environments.Check out Alans' Book Agentware here: https://www.amazon.com/AGENTWARE-Unveiling-Future-Humanitys-Tomorrow/dp/1738297403—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Programming 10x Faster with AI Augmentation

In this episode of The Prompt Desk, hosts Justin Macorin and Bradley Arsenault discuss the various ways they have been using coding assistants, such as Github Copilot, in order to boost their productivity as software developers. The two exchange ideas, thoughts and techniques on how to better use these tools.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Prompt Design for AI Art with Sachin Kamath

Join us with Sachin Kamath as we explore how to use AI in creative projects effectively and how we may effectively integrate AI into existing workflows, significantly enhancing productivity and creative output. We discuss frameworks for advanced prompting, ethical considerations, and best practices in AI.Consistent Character GPT:https://chat.openai.com/g/g-a9JivI0y2-consistent-character-gpt-fast-high-qualityAI Bootcamp for Creatives:https://maven.com/ai-lemon-academy/generative-ai-training-for-creativesYouTube:https://www.youtube.com/@ailemonacademy—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Voodo in Prompt Engineering

Does Voodo in prompt engineering exist? The evolution from manual prompt crafting to automated refinement and optimization in AI interactions marks a transition from art to science. Let's discuss how initial natural language inputs transform, improving communication with large language models for more precise and effective outputs. Join us as we explore the fascinating process of refining prompts for AI, highlighting the blend of creativity and technical precision in advancing AI interactions.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Using LLMs to Generate Source Code: Part 2

This episode discusses improving code generation with LLMs by dynamically extracting functions and context, using techniques like Python's inspect modules and JavaScript's toString. The goal is to produce code that integrates well with existing projects, enhancing customization and practicality.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

LLM System Engineering with Denys Linkov

Join us as we explore the advancements and challenges in implementing Retriever-Augmented Generation (RAG) systems for document retrieval and summarization, examining selective information inclusion, re-ranking strategies, and the importance of document parsing and query pre-processing. We discuss with Denys Linkov the practical applications, benefits, and considerations of RAG-based solutions in improving information retrieval accuracy and relevance.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Why AI is NOT a competitive advantage

Don't miss out on our discussion about the critical factors of expert domain knowledge, intellectual property, and the impact of first-mover advantage. These factors remain the most important competitive advantages, even in today's rapidly evolving technological landscape.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Prompt injection and LLM Security a Deep Dive with Peter Gostev

In today's world, application security is more important than ever before. One of the most significant risks to application security is prompt injection. It can cause irreparable damage to your business. That's why it's critical to understand the various injection techniques, their impact on your business, and how you can mitigate the risks.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Why Small Language Models are Going to Eat the World

Let's discover the rise of local Small Language Models (SLMs), contrasting them with their larger, internet-dependent counterparts - LLMs. We discuss real-world applications like Google Maps, in-browser neural networks, and Apple Photos, examining the benefits of local installation for speed, reliability, privacy, and cost, and address the challenges and opportunities for engineers in this evolving landscape.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Data-free Quality Analysis of Deep Neural Nets with Charles H. Martin

In this episode, we interview Charles H Martin about his open-source Weight Watcher project ( found here https://weightwatcher.ai/ ), which provides ways to test the quality and fit of deep neural networks without having to rely upon a validation dataset. Given the scarcity of high-quality data and the complexity of modern multi-stage ML training and deployment pipelines, this technique could prove to be extremely valuable to any AI engineer, and we were interested to learn more.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Why AI Systems are More Complex than they Seem

Artificial Intelligence (AI) systems are often considered magical, but they are actually composed of several components, with LLMs being only one of them. It is essential to understand that AI systems utilize a range of components, including classification models, transformers, code execution, API calls, and IO read/write file calls, among others, to enhance their functionality. These components work together to provide AI systems with the required functionality, which is crucial to their overall success.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

How LLM-based Logic can Revolutionize Product Design

Conditional logic powered by Large Language Models (LLMs) is transforming the traditional if/else statements in software applications, enabling quicker and more efficient integration of AI-based conditional logic. This advancement significantly enhances non-technical specialists' ability to customize complex applications easily.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Natural Language APIs

Should computers talk English to eachother? This podcasts discusses how computers can use natural language queries to execute API and database calls. Join us as we discuss the challenges, opportunities, and future potential of natural language processing in computer communication.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Prompt Development Lifecycle: Part 1

Dive deep into the world of prompt development where we break down the different steps of developing prompt-based applications. From your first prompt to a fine-tuned version, we unravel the intricacies of prompt engineering, exploring how to effectively craft, test, and refine prompts to optimize interaction and functionality in AI-driven applications.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Using LLMs to Generate Source Code: The First Step

Dive deep into the world of using Large Language Models (LLMs) to generate source code as we explore the importance of types and schema definitions. Join us as we discuss the challenges of generating accurate and reliable code, the role of types and schema in improving code quality, and how LLMs can be leveraged to enhance the development process. Whether you're a developer looking to optimize your code generation or a researcher interested in the potential of LLMs in software engineering, this episode provides valuable insights into the intersection of AI and programming.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad’s AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Did OpenAI really just kill 1,000 Startups?

Dive deep into OpenAI's newest press release as we discuss and examine the implications of their newest features, and draw parallels with past tech giants like AOL, Netscape, and Apple's Flashlight application. Join us for a thought-provoking journey through the evolution of AI and technology.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brad's AI Consultancy at bradleyarsenault.meAdd Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Sandwich Prompts: Instructions, Data, and Everything in Between

Dive deep into how instruction and data placement can have a significant impact on prompt and output quality. Join us as we explore how we use statistics to measure prompt quality and what data and instruction placements yield the best success.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brads AI Consultancy at bradleyarsenault.me.Add Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Prompt Size: Best Practices From Zero-Shot to Few-Shot Prompts

Dive deep into the art of prompt engineering as Brad and Justin share their personal experiences with machine learning models, unravel the mysteries of why shorter prompts often yield better results and the nuances of zero-shot vs. few-shot prompts. Whether you're seeking to understand the neural network mechanics or looking for best practices in crafting your own prompts, this episode sheds light on the intricacies of achieving the best model performance. Join us in exploring how to strike the balance between detail and efficiency in prompt design.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brads AI Consultancy at bradleyarsenault.me.Add Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Decoupling for Clarity: The Future of Prompt-Based Development

Dive into the world of prompt deleveopment best practices as we explore the importance of decoupling prompts from source code. Learn about the challenges of hard-coding, the rising trends in the realm of prompts engineering, and how proper decoupling can foster collaboration, clarity, and future-proof your projects.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brads AI Consultancy at bradleyarsenault.me.Add Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.

Decoding LLM Quality: From Unit Testing to User Feedback

Dive deep into the nuances of measuring the quality of Large Language Model (LLM) prompts, as we explore past methodologies, and evaluate both qualitative assessments and large-scale testing techniques. Join us as we discuss the challenges of traditional metrics, the role of user feedback, and brainstorm new ways to gauge generative model performance.—Continue listening to The Prompt Desk Podcast for everything LLM & GPT, Prompt Engineering, Generative AI, and LLM Security.Check out PromptDesk.ai for an open-source prompt management tool.Check out Brads AI Consultancy at bradleyarsenault.me.Add Justin Macorin and Bradley Arsenault on LinkedIn.Please fill out our listener survey here to help us create a better podcast: https://docs.google.com/forms/d/e/1FAIpQLSfNjWlWyg8zROYmGX745a56AtagX_7cS16jyhjV2u_ebgc-tw/viewform?usp=sf_linkHosted by Ausha. See ausha.co/privacy-policy for more information.