AiVidya Guru — Comic Lesson Video Evaluation Guide

For: Subject evaluators / reviewers What you're reviewing: AI-generated animated comic lesson videos for CBSE students (Classes 5–9), one per chapter, across Arts, English, Science, Social Science, EVS, ICT, Physical Education and Vocational Education. Why: These are candidate learning videos. Your review decides whether each is fit to publish to students, needs fixes, or should be rejected. Be strict — this is student-facing content.

1. How to access the videos

• URL: https://aividya-eval.pages.dev
• Access code: aividya-eval-2026 (enter it once; do not share outside the review team)
• Videos are grouped Class → Subject → Chapter. Click any tile to play.
• View-only: playback is streamed and gated; there is no download. Please don't screen-record or redistribute.
• Works on laptop or phone, on a normal internet connection.

If a video won't play: refresh once; if it still fails, note the Class/Subject/Chapter and report it as a Technical issue (Section 4).

2. How to review each video (workflow)

1. Open the chapter's NCERT textbook for that class alongside the video (the video should teach that chapter's content).
2. Watch the full video once, uninterrupted, as a student would.
3. Watch a second time with this checklist open, pausing to note the timestamp (mm:ss) of anything you flag.
4. Fill one row per issue in the reporting sheet (Section 5). Give the video an overall rating + recommendation at the end.

Budget ~3× the video length per video (a 90-second video ≈ 4–5 minutes of review).

3. What to check — the 10 checkpoints

For each video, assess every category. Each has concrete things to look for.

A. Curriculum alignment & factual accuracy ⭐ (most important)

• Does the video actually teach this chapter of this class's NCERT syllabus?
• Are all facts, definitions, formulae, dates, names, and examples correct?
• Any statement that contradicts NCERT? Any oversimplification that becomes wrong?
• Flag every factual error with the exact wording and timestamp.

B. Concept coverage & completeness

• Are the chapter's key concepts / learning objectives all present?
• Anything important missing, or any irrelevant tangent added?
• Is the depth right for the class (not too shallow, not beyond syllabus)?

C. Level & language appropriateness

• Is the vocabulary and sentence complexity right for that class level?
• Language mix (English / Hindi / Hinglish) — is it consistent and appropriate for the audience?
• Any word/phrase a student that age wouldn't understand?

D. Narration & audio

• Is the voice clear and correctly paced (not rushed/too slow)?
• Pronunciation — especially names, technical terms, Hindi/Sanskrit words.
• Audio quality: no distortion, clipping, dead air, or wrong volume.
• Does narration match what's on screen?

E. Visual quality & readability

• Is the comic art clear and pleasant, not distorted or "creepy"?
• Any on-screen text — is it legible, correctly spelled, and correct?
• Diagrams/labels (esp. Science/Maths) — accurate and readable?

F. Character & prop continuity ⚠️ (known weak spot)

• Does each character stay consistent across panels — same face, hair, clothing colour, age, gender?
• Do objects/props stay consistent — e.g. a ball shouldn't change size or become a different sport's ball; an item shouldn't change colour or shape between shots.
• Watch for wrong details (e.g. a boy drawn with a braid/choti, a dress changing colour mid-scene).
• Flag each continuity break with both timestamps (where it was right vs wrong).

G. Cultural & contextual appropriateness

• Names, settings, examples suited to Indian students?
• Anything culturally off, insensitive, or stereotyped (gender, religion, region, caste, disability)?
• Festivals, attire, food, currency, etc. shown correctly?

H. Pedagogy & engagement

• Is it engaging — a hook, a story, a reason to keep watching?
• Does the storytelling actually aid understanding, or is it decoration?
• Logical flow: intro → concept → example → recap?

I. Safety & bias

• Nothing frightening, violent, unsafe, or age-inappropriate.
• No misinformation, stereotyping, or biased framing.
• Nothing that could embarrass or exclude any group of students.

J. Technical playback

• Loads and plays fully; audio–video in sync; no freezing, black frames, or abrupt cut-offs.
• Correct video is under the correct Class/Subject/Chapter tile (no mislabelling).

4. Severity — tag every issue

5. How to report — one row per issue

Use the shared sheet (EVALUATOR_REPORT_template.csv). Columns:

Rules for good reports - Be specific and quote: "At 00:34 narration says 'water boils at 90°C' — should be 100°C at sea level" beats "science is wrong." - Always give a timestamp for anything time-bound. - One issue per row. A video with no issues = one row, rating 5, Recommendation Approve, Description "No issues." - If unsure whether something is an error, still log it as Minor with a note "please verify."

Example rows

6. When you're done

• One completed sheet per reviewer, covering every video you were assigned.
• Make sure every video has at least one row (even if just "No issues, rating 5, Approve").
• Send the sheet to ‹TBD – coordinator name / email› by ‹TBD – deadline›.
• Any doubts about scope or a specific chapter → contact ‹TBD – coordinator name / email›.

Thank you — your review directly protects the quality of what students learn.