-
Insights and Reporting: FAQ
Read articleThis article provides answers to frequently asked questions regarding the insights and reporting features available for Udemy Business, including dashboards and data export reports. To learn more about insights and reporting, see:
- An overview of the insights and reporting available in Udemy Business
- How to generate, schedule, and download data export reports
- Descriptions for all data export report fields
Table of Contents
General insights and reporting questions
- Can Udemy Business integrate with business intelligence tools, such as Power BI and Tableau?
- Why is there a discrepancy between the User Activity dashboard and the Course Activity report?
- How frequently are reports and dashboards updated?
- On the Assignments page, what does “Assigned to” refer to?
- On the Paths Insights dashboard, what does “User enrolled” refer to?
- What constitutes an active learner in Udemy Business?
Data export report questions
- Are groups present in the Reporting API?
- Can I download a User activity report that includes all users, regardless of their activity status?
- Do reports include the course progress of unenrolled users?
- What timezone are the data exports in?
- Why does my Udemy Path insights report not include data for all paths?
Reporting dashboard questions
- On the Learner feedback dashboard, why is there a discrepancy between the number of learners who have responded to a survey and the total number of responses?
- On the User adoption funnel, what does the Licenses Allocated percentage represent?
- Why do the total hours watched on the Skill insights dashboard differ from the total hours watched on the User activity dashboard?
General Insights and Reporting questions
Can Udemy Business integrate with business intelligence tools, such as Power BI and Tableau?
Yes, you can leverage Udemy Business' APIs to sync Course, Learning Path, and Reporting Insights to business intelligence tools. Please work with your Customer Success Representative to discuss how to call our Udemy Business APIs from your BI systems.
Why is there a discrepancy between the User Activity dashboard and the Course Activity report?
The User activity dashboard and Course activity report in Udemy Business serve different purposes and use distinct data sources and timeframes, leading to variations in metrics.
The User Activity dashboard shows near real-time activity for users who have started watching lectures or attempting practice tests, with metrics localized to the user’s time zone. In contrast, the Course Activity report includes all user activities, including those who have just enrolled, with timeframes aligned to Pacific Standard Time (PST) days.
Learn more about the User Activity dashboard for:
How frequently are reports and dashboards updated?
See how frequently Udemy Business insights and reporting data is updated.
On the Assignments page, what does “Assigned to” refer to?
Assigned to on the Assignments page refers to the number of learners who have the learning assigned to them by an admin.
On the Paths Insights dashboard, what does “User enrolled” refer to?
Users enrolled on the Path insights page refers to the number of learners who are currently enrolled in the assigned path.
What constitutes an active learner in Udemy Business?
Learn about what defines an active learner in Udemy Business.
Data export report questionsAre groups present in the Reporting API?
Groups are not present in the Reporting API, but customers can use our User API to get group data. In addition, when exporting reports, the list of groups is scrollable for easier selection.
Can I download a User activity report that includes all users, regardless of their activity status?
You can use the User activity report (All Users) to retrieve data on all activated users in an account. Learn more about the data included in User activity reports.
Do reports include the course progress of unenrolled users?
If a user unenrolls from a course, or their enrollment is transferred from another account, including an account at the Udemy marketplace, some activity data will be reflected in the User course activity report.
Many of the report fields, however, are dependent on the original enrollment record and will therefore have no data if a learner unenrolls. Specifically, unenrolling can affect data such as % Marked Completed, Date Enrolled, and Date Completed in the User course activity report.
Learn more about the report fields included in data export reports.
What timezone are the data exports in?
Learn about the applicable timezones for data export reports.
Why does my Udemy Path insights report not include data for all paths?
The path reports only include data Udemy Business public learning data. Learn more about learning paths reports.
Why might a learner’s certificate of completion have a different date/timestamp than the date/timestamp for that course in reports?
The certificates of completion that learners receive are localized to the timezone of the IP address of the learner's device at the time they complete the course. The data export reports, however, are in standard UTC format. Therefore, the date/timestamps may be different, but they will always equate to the same date and time.
For example, a learner located in San Francisco, California, U.S.A. completes a course at 9:00 PM / 21:00 Pacific Standard Time on February 25. When we convert to UTC standard format, it would equate to 5:00 AM / 05:00 on February 26. So, that is the date/timestamp that would be listed in the data reports.
Reporting dashboard questions
On the Learner feedback dashboard, why is there a discrepancy between the number of learners who have responded to a survey and the total number of responses?
This discrepancy exists as users can respond to a question each time they see the survey.
On the User adoption funnel, what does the Licenses Allocated percentage represent?
The percentage of licenses allocated represents the number of learners who have accepted the license and joined. Learn more about the user adoption funnel and how licenses are allocated.
Why do the total hours watched on the Skill insights dashboard differ from the total hours watched on the User activity dashboard?
A course can exist within more than one subcategory and courses with the same primary topic can also exist in different subcategories. As a result, this means that learning attributed to a single topic can be split across multiple subcategories, which is why the skill insights data might be higher than the user activity data.
-
User Assessment Reports
Read articleAdmins and group admins can download User assessment activity, User assessment proficiency, and User skills proficiency reports to view deeper insights into assessments.
- See what insights and reporting are available in Udemy Business.
- Learn how to generate, schedule, and download data export reports.
- Review definitions for data export report fields.
- View skill proficiency improvements at a glance with the Skills Proficiency Insights dashboard.
User assessment activity report
The User assessment activity report provides a summary of the assessments your users have attempted.
The User assessment activity report includes the highest proficiency level achieved across all attempts for a single assessment.
User assessment proficiency report
The User assessment proficiency report shows how your employees are performing on their assessments, enabling you to track assessment performance across your organization over time.
The report includes the proficiency level reached for each completed attempt, as well as overall patterns, so that you can use it for quick status updates or deeper analysis of learner progress.
It’s designed to give you a clear view of each employee’s skill development, whether you're checking their most recent results or looking at long-term trends.
Note: When an assessment version changes, we recommend being cautious about comparing the proficiency level between two different versions, as the assessment may be significantly different enough to make a comparison inaccurate. For example, the new version could be harder, which would account for a lower proficiency score.
User skills proficiency report
The User skills proficiency report provides insights into how your employees are performing on assessments, including the skill topic associated with each assessment. The Skill topic column enables you to see which skills employees are developing as a result of assessment performance.
Understanding proficiency levels
The scores on an assessment can range from 0-200 and are grouped into four major segments. Each segment corresponds to a specific proficiency level:
- Level 1: Beginning (0-49)
- Level 2: Developing (50-99)
- Level 3: Established (100-149)
- Level 4: Advanced (150-200)
You can think of these labels as completing this sentence:
- Compared to others, this person’s skills are {performance level achieved}.
Learn more about assessment benchmarking and how to interpret proficiency levels.