Hi everyone,
I plan to build a test simulator for my students (a bit like an SAT). I have a number of questions and answers (multiple choice).
The test will follow this format: 50 questions under a time constraint.
The database will hold as many question types as i can add (1000+) categorised by type (maths, verbal, logic)
My components are:
the quiz - probably relatively straight forward with an airtable database. I’m guessing i use forms.
feedback - where the student is going wrong, tips on how to get better, traps to look out for.
focus questions - separate groups of questions that focus on a weak area (eg. algebra)
Are their existing templates out there? (i’m not sure pickaxe does this yet)
Any things to look out for? Errors to avoid?
I’m hoping this is straightforward build, but whenever i think that i find out it isn’t.
Thanks in advance.
Love this use case. I haven’t seen a ready-made template that nails it yet, but other community members might have something if they’re working on a similar flow or have seen one in the wild. Please keep us posted as you build and share updates. Excited to see your Pickaxe in action!
@broadlymagical you can build a studio and embed the Airtable form in it. Then you can create a pickaxe with an Airtable action or MCP server that connects to Airtable and analyses the responses. You will need to authenticate the user so you are accessing the correct data in Airtable and provide the correct feedback.
With a bit of work you could create additional pages or pickaxes that are initially hidden and get unlocked after the iniitial quiz is completed based on what the focus questions should be.
Yes, this sounds good. I’ve embedded an airtable form before so that’s simple enough.
The logic for showing responses will be a learning curve…but I’ll figure it out.
Thanks for the response.
Building on the conversation, the Airtable approach is definitely a viable one. However, for what you’re trying to achieve, it might be a little complicated for your case. Airtable is a handy tool (if you’ve already mastered it), but when applying quiz logic, it can complicate the issue and make the system harder to maintain.
Heading
If you’re up for adopting a simpler setup, Pickaxe is perfectly capable of handling this solution on its own with a simpler setup.
Here’s what a similar strategy I implemented for clients looked like:
Step 1: Structure Your Questions in a CSV File
Instead of a database, simply use a spreadsheet. Create it in Google Sheets or Excel with the following columns, as this structure is key for the agent’s logic.
QuestionID
Category
QuestionText
OptionA
OptionB
OptionC
OptionD
CorrectAnswer
Explanation
M001
Maths
If 2x + 5 = 15, what is the value of x?
3
5
7
10
B
First, subtract 5 from both sides to get 2x = 10. Then, divide by 2 to get x = 5.
V001
Verbal
Which word is a synonym for ‘ephemeral’?
Lasting
Temporary
Bright
Quiet
B
Ephemeral means lasting for a very short time.
Save this file as a CSV (.csv) and upload it directly to your Pickaxe agent’s Knowledge Base. This file will be the single source of truth for your entire quiz.
Step 2: The Agent’s Prompt and Logic Flow
Now, create your chatbot agent in Pickaxe. The prompt is where you’ll define all the rules for how the quiz runs, referencing the CSV file you just uploaded.
Here is a prompt structure you can use:
You are an expert SAT Test Simulator. Your entire knowledge of test questions comes from the CSV file in your knowledge base. Your goal is to administer a 50-question test, provide feedback, and then run targeted practice sessions.
**Phase 1: The Main Test**
1. Greet the student and wait for them to say they are ready to start.
2. Your primary task is to conduct a 50-question test. You must select 50 UNIQUE questions from your knowledge base. Use the 'QuestionID' column to ensure you do not ask the same question twice in one session.
3. For each question, present only the 'QuestionText' and the four options.
4. After the student provides an answer, check the 'CorrectAnswer' column in your knowledge base to determine if they are correct.
5. **CRITICAL RULE:** Do NOT reveal the correct answer or the explanation after each question. Simply note internally whether the student was right or wrong and the question's 'Category'.
6. Repeat this process until 50 different questions have been asked.
**Phase 2: Feedback and Analysis**
1. Once the 50-question test is complete, inform the student.
2. Calculate and present their final score (e.g., "You answered 38 out of 50 questions correctly.").
3. Analyze the results, focusing on the 'Category' for the questions they answered incorrectly. Identify their top 1-2 weakest categories.
4. Provide a summary of these weak areas and offer constructive feedback and tips.
**Phase 3: Focused Practice**
1. Ask the student if they would like to do a 10-question practice quiz on their weakest category.
2. If they agree, select 10 new questions from the knowledge base that belong ONLY to that specific category and administer the short quiz.
This method keeps everything cleanly inside Pickaxe, making it the simplest and most maintainable (long-term) solution for your project.
My only concern is being able to show images. I have graphs and tables that make up part of the question. What do you think of being able to return them alongside the question?
