微提示LLMs和SLM从复制品到代理工作量

AI Hardware & Systems@aiandsystemsMicro-Prompting LLMs and SLMsFrom Copilots to Agentic WorkloadsDonald ThompsonDistinguished EngineerMicrosoft / LinkedInAI Hardware & Systems@aiandsystemsAgenda•Macro-prompting vs micro-prompting•Micro-prompting example•Automatic prompt optimization•Automatic fine-tuning•SLMs vs LLMsAI Hardware & Systems@aiandsystemsMacro-PromptingThe Current Paradigm in GenAI•Dominant approach since late 2022•Crafting extensive, detailed prompts•Provides comprehensive instructions to frontier LLMsJailbreak and RAI safeguardsIntent ClassificationTask Instructions and ExamplesContext and Conversational MemoryFunction Calling / Formatting InstructionsAnatomy of a Macro-Prompt> 8k tokensAI Hardware & Systems@aiandsystemsMacro-PromptingApplication Engineering Challenges•Limited expertise in prompt engineering•Limited time budget for iteration and evaluation•Default reliance on expensive, scarce models (GPT-4)•Reduced opportunity for fine-tuningAI Hardware & Systems@aiandsy