We have a PA that has a prompt that it 52.34 KB, 51337 Characters, much of which is guides for formatting webpage output.
Are there any rules of thumb about how to optimally allocate this text between the prompt (optimal length? Is it a function of the model?), and KB articles (is there any optimal length or keyword density? I guess the KB has an internal selection mechanism?)
Thanks in advance to anyone who has experimented with this issue, willing to share results.
Good question. It’s less about length and more about clarity. What matters is conveying exactly what you need, and sometimes that takes a few lines, sometimes a lot more.
A few extra words here and there usually won’t change costs in any meaningful way, but unclear instructions absolutely will. If the AI doesn’t fully understand the rules, you’ll pay for it later in retries and inconsistent output.
Use the prompt for things that must always hold true like behavior, structure, and formatting rules. Use the Knowledge Base for reference material, examples, and documentation the AI can pull in when relevant. If it’s a rule the AI should never break, keep it in the prompt. If it’s something the AI can look up when needed, put it in the KB.
Clear instructions beat short instructions every time. 
Thanks, @abhi - this falls into the category I call “meta”. I wish vibe coding platforms in general were a bit more “self-aware” (Yeah, Terminator), and could police things like this to help us humans out.