Reviewing VTA Analytics (Page 9)

Written By Asad Jobanputra

Last updated 3 months ago

Overview

This guide explains the VTA Analytics dashboard, which provides instructors with crucial insights into student usage, engagement, and most importantly, the specific course concepts students are struggling with. This dashboard helps you identify learning gaps and refine your lectures.

Who it's For

  • Instructors: To review student usage, measure VTA effectiveness, and identify weak points in the course content.

  • LMS Admins: To gauge overall VTA adoption and success rates across the institution.

Why Use It

The Analytics dashboard is your feedback loop. It allows you to:

  • Validate VTA Value: See concrete metrics (e.g., NEW QUESTIONS, ACTIVE STUDENTS) that demonstrate the VTA is providing support.

  • Refine Content: Use the Most VTA Topics and Weekly Topics data to adjust lectures or add clarification to course materials.

  • Audit Performance: Review chat history to ensure the VTA is answering accurately and adhering to academic integrity guardrails.

Key Dashboard Metrics

The dashboard opens with immediate, high-level indicators of VTA activity and student engagement:

Metric

What It Measures

Example Interpretation (Current Data)

NEW QUESTIONS

The total number of unique prompts asked this month.

You had 20 questions this month. The VTA is actively being used.

NEW CONVERSATION

The number of new student sessions initiated this month.

11 students or sessions started interactions, indicating adoption.

ACTIVE STUDENTS

The total number of unique students who used the VTA this month.

4 unique students actively used the VTA for support.

FEEDBACK RATE

The percentage of students who provided a positive/negative rating on the VTA's answers.

A rate of 0 suggests students are generally accepting answers, but may indicate a need to encourage feedback.

Analyzing Usage Trends

These charts provide visual confirmation of adoption and active student counts:

  • Total number of questions and Total number of conversations (prompts Responses): Tracks weekly usage. (In the example, usage peaks near the beginning of the month, likely during Week 1.)

  • Total Active User and Active Users Over Time: Shows the count of unique students using the VTA weekly, visualized with Active/Inactive Users.

Identifying Learning Gaps (Most VTA Topics)

This is the most valuable section for instructors. It shows the subjects students most frequently ask the VTA about. If a topic is high on this list, it often means the course material was unclear, or the topic is difficult.

Top Topics Interpretation:

  1. High Logistical Topics: Topics like Quiz Preparation and Upcoming Assignments are high, suggesting students need clearer communication on logistics, deadlines, or grading schemes.

  2. High Content Topics: The topic Ionic Bond is high. Action: The instructor may need to dedicate more class time to this concept, provide additional reading, or upload a specific clarifying PDF to the VTA's knowledge base.

  3. Low/Unclear Topics: Safety Contract is low, meaning students likely understand that material well.

Auditing and Feedback

  • Feedback: Shows student satisfaction scores and comments for individual answers.

  • Chat History (Requires "Save Chat History" ON): Allows the instructor to click into any conversation to review the full transcript, verifying accuracy and monitoring for attempted violations of the Academic Integrity Guardrails.