Exam generater — Study Path Agent

Chapter 1

Assessment foundations (goals, blueprints, rules)

1

Define learning objectives (skills, outcomes, cognitive levels)

2

Create an exam blueprint (topics × difficulty × points)

3

Set exam policies & constraints (time, attempts, sections, rules)

Chapter 2

Question bank & item authoring

4

Choose item types (MCQ, multi-select, short answer, coding, essay)

5

Write high-quality questions (clarity, distractors, bias checks)

6

Metadata & tagging schema (topic, difficulty, objectives, prerequisites)

7

Review workflow & versioning (draft → review → publish, audit trail)

8

Item statistics (difficulty, discrimination, reliability) and iteration

Chapter 3

Data modeling & storage

9

Design database entities (items, options, exams, attempts, scores)

10

Store rich content (Markdown/HTML/LaTeX, images, code blocks)

11

Import/export formats (CSV/JSON, QTI concepts, backups)

Chapter 4

Exam generation algorithms (assembly & constraints)

↗ Metadata & tagging schema (topic, difficulty, objectives, prerequisites) (see Chapter 2)

12

Randomization with constraints (no repeats, balanced tags, section rules)

13

Blueprint-based assembly (match targets for topic/difficulty/points)

14

Adaptive testing basics (CAT concepts)

3 subtopics

15

Item Response Theory (IRT) fundamentals (ability, item curves, assumptions)

16

Calibrate items & estimate ability (data needs, drift, validation)

17

Exposure control & stopping rules (precision, max items, content balancing)

18

Anti-collusion variants (pools, shuffling, parameterized questions)

Chapter 5

Scoring, feedback & analytics

19

Automated grading (keys, tolerances, unit tests for items)

20

Rubrics & human grading workflow (queues, moderation, regrade requests)

↗ Item statistics (difficulty, discrimination, reliability) and iteration (see Chapter 2)

21

Reporting dashboards (cohorts, standards mastery, item analysis)

22

Feedback generation (explanations, hints, remediation links)

Chapter 6

Delivery platform & UX

23

Candidate UI basics (navigation, timers, autosave, accessibility)

24

Admin UI (authoring, tagging, preview, assemble & publish exams)

25

Printable/PDF exam rendering (pagination, LaTeX templates, answer sheets)

26

Integrations (LMS, gradebook sync, SSO, roster import)

Chapter 7

Security, integrity & operations

27

Authentication/authorization (roles, permissions, item bank access)

28

Integrity controls (browser lockdown concepts, logs, anomaly signals)

29

Privacy & compliance basics (PII handling, retention, FERPA/GDPR overview)

30

Deployment & ops (CI/CD, monitoring, backups, incident response basics)