-
Practice Tests: How Activity And Time is Tracked
Read articleThis article includes answers to frequently asked questions about how activity and time are tracked when learners progress through practice tests.
- Learn more about practice tests and how they work.
Table of contents
- What practice test activities have time-tracked?
- How is time tracked and calculated when users progress through practice tests?
- Examples of how time is tracked during practice tests
- How time tracking works depending on the practice test status
- What reports will include practice test time spent?
What practice test activities have time-tracked?
Time is only tracked for practice test lectures, and is not tracked for quizzes or coding exercises.
How is time tracked and calculated when users progress through practice tests?
Time spent tracking starts when users start the practice test by clicking the Begin test button.
- Time continues to be tracked between each relevant practice test action. Actions include:
- Time spent before submitting a question.
- Time spent before clicking the pause button.
- Time spent before the practice test is paused.
- Time spent before clicking the finish test button
- etc.
- Time is not tracked when:
- When a user leaves the page or refreshes the page.
- Users click the Finish test button.
- Users click the pause button.
- Users finish the practice test.
- The practice test will automatically pause if the user is idle for 5 minutes.
Examples of how time is tracked during practice tests
Scenario Time tracked by the system Reason
A user is taking the practice test and takes 3 minutes to submit an answer for question 1.3 minutes (or 180 seconds)
After starting the practice test, the user took 3 minutes to submit an answer.
A user takes 3 minutes to submit an answer for question 1, and then takes 5 minutes to submit an answer for question 2.8 minutes (or 480 seconds)
After starting the practice test:
- The user spent 3 minutes to submit an answer for question 1.
- The user spent 5 minutes to submit an answer for question 2.
A user spends 1 minute on question 1 before pressing the pause button.1 minute (or 60 seconds)
After starting the practice test: - the user was on the page for 1 minute before pressing the pause button.
A user spends 1 minute on question 1 before pressing the pause button. They resume the practice test and spend 1 more minute on question 1, before submitting an answer.2 minutes (or 120 seconds)
After starting the practice test:
- The user is on the page for 1 minute before pressing the pause button.
- No time is tracked while the practice test is paused.
- The user spent 1 minute before submitting an answer.
While reviewing question 1 of a practice test, the user switches to a different tab and does not return to the practice test.5 minutes (or 300 seconds)
After starting the practice test:
- The user is idle for 5 minutes
- The practice test is automatically paused for the user, since they have not taken an action within the past 5 minutes
How time tracking works depending on the practice test status
Practice test status Screenshot After the test begins: Time spent tracking starts when a user starts the practice test by clicking the Begin test button. Between actions: Udemy continues to track time between each relevant practice test action (e.g. submit answer, click pause). The test is paused, idle or left. Udemy stops tracking time when: - A user leaves the page or refreshes the page.
- A user clicks the pause button.
- The practice test is automatically paused when the user is idle for 5 minutes.
The practice test is completed.
Udemy stops tracking time when:
- A user clicks the Finish test button
- A user finishes the practice test
What reports will include practice test time spent?
- The data export reports below will include the time spent on practice tests:
- User activity report (active users)
- User activity report (all users)
- Note: The column in this report titled “Minutes Video Consumed” will include time spent taking practice tests.
- Note: this does not include the reports listed under Legacy Reports on the Data export reports page
Learn more about data export reports.
-
What is a Beta Assessment?
Read articleThis article explains what a Beta tag for assessments indicates, how they work and what may come next after a beta ends.
- Learn more about assessments and how to access them.
- Assessments are only available to Udemy Business Pro users.
What is a “Beta” tag and what do they look like?
A ‘Beta’ tag on an assessment indicates that the assessment is new and that we are gathering data to make improvements. You can see an example of a Beta tag below.
What kind of changes can be expected during and after Beta?
Beta status is not indicative of the assessment being experimental or in a trial period, it's just an indication that we're still collecting the user data that lets us fully model the balancing and cohort mechanics for score benchmarking. Beta assessments are still a great way to get meaningful directional feedback on skill proficiency and to get guidance to specific learning areas based on questions missed.
During beta we may deactivate or change individual questions that present a poor user experience or give us concerns about our ability to validly assess a skill with them. (In fact, we continue to monitor quality and make improvements even after Beta.)
How are questions selected before entering Beta?
Questions have already gone through a significant amount of quality control before the first exposure to learners, so in general, a large percent of any problematic items have already been eliminated or fixed well before entering Beta. Since Beta assessments are brand new, it’s not uncommon for our team to tweak a few items in response to our data gathering and/or in-product feedback. But in most cases, there won't be extensive changes to a significant percentage of questions in the transition from Beta.
How is the Beta period used?
The kinds of improvements we make during the Beta period are primarily focused on improving score accuracy for each particular assessment.
When we first release an assessment, we make some basic assumptions for scoring about how the assessment questions will function and how users will perform in relation to the content. Over time with sufficient data we can go back and tailor those original assumptions for a more accurate scoring model.
Since our major refinements to scoring are made during Beta, once an assessment is calibrated the ongoing updates and improvements we make over time will be more subtle and happen on a slower cadence. This makes our calibrated assessments that much better of a tool with which skill growth can be looked at via retakes.
What score modeling assumptions are made during Beta?
We make an initial modeling assumption with Beta assessments that all questions are roughly the same difficulty, and that average user knowledge of the assessed skill is normally distributed and well aligned with question difficulty. Over time, and with sufficient data, we revise those assumptions and remove the ‘Beta’ flag to indicate the initial calibration process is complete and that learner scores now reflect the unique difficulty of the specific items they answered. The percentile scores reported to learners are also updated to reflect the most recent performance data from assessment responses on the platform.
How are scores impacted by Beta?
If a learner took a beta assessment, and that assessment later becomes calibrated, there's no retroactive change to their results page. The first results remain intact as a snapshot of the original scoring under beta.
If the user retakes the assessment post Beta, they may see some shift in score, percentile, and/or proficiency level based on changes in item calibration and cohort (aside from their own possible shifts in performance). Since all of that will be conflated together it's important not to make any kind of definitive progress/growth conclusions based on a Beta vs Calibrated (non-Beta) comparison.
Therefore, in a scenario where comparisons between multiple assessments takes are being used to draw skill growth conclusions, note that the most accurate readings will be comparing multiple takes of a fully calibrated (non-Beta) assessment.
-
Admin Overview: Team Plan
Read articleAs an admin or group admin, when you log into Udemy Business, you will see an insights summary dashboard called the Admin Overview page. This article outlines how you can access the Admin Overview for Team Plan accounts and what insights it includes.
Please note: an expanded version of this page is available with the Enterprise Plan.
- Enterprise Plan account: learn how to access your admin overview.
What is the Team Plan Admin Overview?
The Team Plan Admin Overview provides admins with a digestible summary of insights at a glance, with personalized recommendations.
Team Plan Admins will be able to review these insights for all of the learners in their Udemy Business account.
This centralized, personalized landing page provides admins with:
- An intuitive dashboard that tells the story behind your learner data and recommended actions to take.
- Data that can be leveraged to make quick and easy decisions that increase learner engagement.
How to access your Admin Overview
1. In Udemy Business, an admin's log-in home page is the Admin Overview. Once you've navigated away from the Admin Overview, it can be accessed at any time via your account’s homepage.
Please note: If you want to navigate back to the learner homepage with courses and content, click on the logo on the top left hand corner of your logged-in account.
2. Here’s what you can do in your Team Plan Admin Overview -
- Manage Users - Set your account up for success by managing users. See what percentage of licenses you’ve used already and view pending invitations, as well as inviting new users to sign up.
- Manage your subscription - Upgrade your plan or add new licenses
- Drive structured learning - Discover and recommend content with Course Categories and check learner activity
- Discover Insights View your most active learners in the Team Plan user activity dashboard, recent ratings and quickly access the user adoption funnel
- Upgrade to Udemy Business Enterprise Plan - Learn more about the features you’ll get when you upgrade to Enterprise Plan
-
Admin Overview: Enterprise Plan
Read articleAs an admin or group admin, when you log into Udemy Business, you will see an insights summary dashboard called the Admin Overview page. This article outlines how you can access the Admin Overview for Enterprise Plan accounts and what insights it includes.
- Team Plan account: Learn how to access your admin overview.
What is the Admin Overview?
The Admin Overview provides admins and group admins with a digestible summary of insights at a glance, with personalized recommendations.
Admins will be able to review these insights for all of the learners in their Udemy Business account, while group admins will have access to this information for just their specific groups.
This centralized, personalized landing page provides admins and group admins with:
- An intuitive dashboard that tells the story behind your learner data and recommended actions to take.
- Data that can be leveraged to make quick and easy decisions that increases learner engagement.
How to access your Admin Overview
- After logging into Udemy Business, admins or group admins can access the Admin Overview on their account's landing page.
- Please note: If you want to navigate back to the learner homepage with courses and content, click on the logo on the top left hand corner of your logged in account.
- Here’s what you can do in your Admin Overview -
- a) Manage Users - Set your account up for success by managing users. See what percentage of licenses you’ve used already and view pending invitations, as well as inviting new users to sign up.
- b) Review your learners’ feedback - See what feedback your learners are sharing about their experience on Udemy Business.
- c) Active users - See what percentage of your users are active and download best practices to engage your learners.
- d) Check out skills - See what skills are popular in your industry and in your organization.
- e) Insights quick links - Quick access to see your user adoption funnel and course insights.
- f) Learning paths - Quick links to explore and create learning paths, track engagement and see the most enrolled learning path in your organization
- g) Share content - Share with your team by exploring, sharing and viewing assigned courses and content.
- h) Udemy Business Pro - Learn more about how you can access immersive learning for your tech teams.
-
Viewing Learner’s Badge Data Within Your Udemy Business Account
Read articleThis article explains how admins and group admins can view their learners’ certification badge achievements within the Udemy Business product.
Please note: Udemy Business supports the Open Badge standard only.
- Open Badges are web-enabled versions of a credential, certification or learning outcome that provide employers with verifiable evidence of skills achieved through learning.
- Learn more about Open Badges (English only).
- For customers in Austria, Germany or Switzerland learner badge data will be hidden from admins and group admins.
About learner badge data
Udemy Business enables admins and group admins to view a learner’s imported badges and the learning content they used to prepare and pass their certification exam.
How to access a learner’s badge information
1. After logging in to your Udemy Business account, scroll to Manage and click Manage Users.
2. Select a learner, and then click on the Badges tab. Here, you can view which certification badges they have imported, along with key learning data.
3. Click on a Certificate Name to view more information about the badge and the learning content that was completed on Udemy to obtain it.
-
Streaks: Frequently Asked Questions
Read articleThis article includes answers to frequently asked questions we receive regarding Streaks.
Please note: this feature is only available with the Enterprise Plan.
Table of contents
- What is a Streak? How does it work?
- Where are Streaks being surfaced?
- Can’t see the Streak feature in the Udemy Business native app?
- Why did you launch Streaks?
- How often does lecture watching data update?
- Are there associated emails that will go to learners?
- Can admins switch it off?
- Can admins set a time limit for the Streak?
- What will learners see on desktop and mobile?
What is a Streak? How does it work?
A Streak is a feature that encourages learners to learn each week to maintain their Streak. Learners can maintain their streak by logging in and watching 30 minutes of course videos each week. A Visit ring appears closed once a learner logs in. A Watch Ring updates as they progress through watching video minutes each week. Once they have watched 30 minutes of video, the ring closes and they have completed their Watch activity for the week!
A learner must close both their Visit and Watch rings each week to maintain their Streak.
Where are Streaks being surfaced?
Streaks are surfaced within the Udemy Business web and native app experience.
Can’t see the Streak feature in the Udemy Business native app?
Make sure you have updated the app to the latest version from the Play Store or App Store.
Why did you launch Streaks?
At Udemy, we are always looking for ways to help individuals and organizations learn new skills that will help them reach desired outcomes faster. Streaks have proven to be an effective motivator to keep users engaged.
How often does lecture watching data update?
Currently, lecture watching data updates 3 times per day, so learners will not see their ring closing simultaneously as they learn. This is something we are working toward for future iterations.
Are there associated emails that will go to learners?
Not yet. We are currently experimenting with Streak emails that will encourage learners to log into Udemy to complete their 30 minute ring.
Can admins switch it off?
We are encouraging all customers to keep the Streak feature turned on at this time, as we have seen very positive learner engagement results across global organizations through the experiments we’ve run.
If you would still like to disable the Streak feature, your Customer Success Manager can do that for you.
Feedback is always welcome! So if you have any that you’d like to provide to help us improve the feature, please contact your Customer Success Manager.
Can admins set a time limit for the Streak?
For now, all Watch rings will have a time limit of 30 minutes. The 30-minute time limit has been chosen carefully to accommodate active and passive learners and encourage each of them to learn for an attainable yet significant amount of time in a given week.
What will learners see on desktop and mobile?
Desktop Mobile -
User Categories And Reporting: Activated vs. Deactivated
Read articleThis article discusses the differences between the user categories in Udemy Business accounts, and how they impact admin reporting.
Where admins can view user totals in their Udemy Business account
Admins can see how many users are enrolled in their Udemy Business account, and what category they are assigned to via the User management page and the applicable filters.
User categories and activation
All users: this includes every user who has joined your account at some juncture and includes both activated and deactivated users.
Licensed users (or License allocated): these are activated users who currently hold a license and have joined their Udemy Business account. Users are activated if they have logged in or authenticated via Single Sign On (SSO) at least once to activate that license.
Users who have not activated their license are not included in any insights and reporting.
- Learn more about what defines an active user so their learning is captured in Insights and reporting.
No license: Users provisioned through SCIM by your SSO provider will be created in your Udemy Business account, but will not take up a license, and will not be activated, until they access their account by authenticating via your SSO provider. When users are provisioned through SCIM, but have not accessed their Udemy Business account via SSO, they will display in the All users page with a No license status.
Pending invitations: This includes people who have been invited to your Udemy Business account, but they have yet to claim their license and become an activated user.
- Learn more about inviting users to your Udemy Business account and how to resend pending invitations.
Deactivated users: These are users who have had their licenses removed and can no longer access the Udemy Business portal. Deactivated users retain all data relating to their learning, however, and can be reactivated at any time by the admin.
Deactivated users who have their Personally Identifiable Information (PII) removed
Deactivated users can have their Personally Identifiable Information (PII) permanently removed for General Data Protection Regulation (GDPR) compliance, or a similar purpose.
Once a user’s PII data has been deleted they become anonymized users and all references to them in Udemy Business are labeled with “Anonymized User”. Please note that deleting a user’s PII is irreversible.
-
Data Export Reports: FAQ
Read articleThis article answers some of the most frequently asked questions regarding data export reports, including what information is featured in several columns.
General questions
- Can Udemy integrate with business intelligence tools like Power BI, Tableau, or others?
- Do reports include the course progress of unenrolled users?
- How can a learner’s certificate of completion have a date/timestamp that is different from the completion date/timestamp entry for that course in admin reports?
- What information is provided in the User Groups Column?
- When is data updated? And what timezone are the data exports in?
User Activity and User Course Activity report questions
- In the User course activity report, why are the“Date Enrolled”, "Date Started" and “Date Last Accessed” fields blank?
- How is the Course Duration column calculated in the User Course Activity Report?
- What does the First Date Complete column of the User Course Activity report indicate?
- What information is included in the Minutes Video Consumed Column of User Activity and User Course Activity Reports?
- What does the Practice Activities Completed column indicate in the Legacy User Activity Reports?
- Discrepancy between the User Activity Dashboard and the User Course Activity Report?
User Progress report questions
Can Udemy integrate with business intelligence tools like Power BI, Tableau, or others?
Yes, you can leverage Udemy Business' APIs to sync Course, Learning Path, and Reporting Insights to business intelligence tools. Please work with your Customer Success Representative to discuss how to call our Udemy Business APIs from your BI systems.
Do reports include the course progress of unenrolled users?
If a user unenrolls from a course, or their enrollment is transferred from another account, including an account at the Udemy marketplace, some activity data will be reflected in the User Course Activity report.
Many of the report fields, however, are dependent on the original enrollment record and will therefore have no data if a learner unenrolls. Specifically, unenrolling can affect data such as “% Marked Completed”, “Date Enrolled” and “Date Completed” in the User Course Activity report.
If you have any questions regarding this please contact us.
How can a learner’s certificate of completion have a date/timestamp that is different from the completion date/timestamp entry for that course in admin reports?
The certificates of completion that learners receive are localized to the timezone of the IP address of the learner's device at the time the course is completed. The admin reports, however, are in standard UTC format. Therefore the date/timestamps may be different, but they will always equate to the same date and time.
For example, a learner located in San Francisco, California, U.S.A. completes a course at 9:00pm / 21:00 Pacific Standard time on the 25th of February. When we convert to UTC standard format, it would equate to 5:00am / 05:00 on the 26th of February. So, that is the date/timestamp that would be listed in the data reports.
What information is provided in the User Groups Column?
Data Export Reports feature a User Groups column which displays all groups that a user is part of. Admins and group admins are able to easily see group membership details when exporting user reports, including 'all users' within a group. Groups are not present in the Reporting API, but customers can use our User API to get group data. In addition, when exporting reports, the list of groups is scrollable for easier selection.
When is data updated? And what timezone are the data exports in?
User Activity and User Course Activity report questions
In the User course activity report, why are the“Date Enrolled”, "Date Started" and “Date Last Accessed” fields blank?
If the user enrolls in the course and unenrolls shortly afterward (i.e. before the next data processing occurs), these fields may be blank.
How is the Course Duration column calculated in the User Course Activity Report?
The course duration column in the user course activity report indicates how many minutes of video content the course includes. As a result, practice test courses may have a 0 or a small number listed in the course duration column, since practice tests typically feature little to no video content.
What does the First Date Complete column of the User Course Activity report indicate?
User Course Activity Reports feature a First Date Completed column, which records the date the course was first completed by the learner. As a result, if the instructor adds new lectures or content, the date and time stamp won't be lost. If the learner completes the extra content it will be recorded as "Date Completed". The column is present in both the CSV and the Reporting API.
What information is included in the Minutes Video Consumed Column of User Activity and User Course Activity Reports?
The Minutes Video Consumed column in the User Course Activity and User Activity reports
- Include rewatches
- Do not include any parts of a lecture that are skipped
- Do not take into account video playback speed.
Examples:
Rewatches: If a user watched 1 hour of the course on Monday, and then on Tuesday, they watched the same 1 hour once again. In this case, the user spent two hours learning on Udemy Business that week, and this would be reflected in both reports.
Playback Speed: If the user watched 2 hours of content in 1 hour, by viewing the content at 2x the speed, the report would reflect they spent 2 hours viewing the course.
Skipped Parts of a Lecture: if a user starts watching a 10 minute lecture and after 1 minute, they skip to the end of the lecture, we will only report the actual time they spent on the lecture, in this case about 1 minute. The lecture will however be marked as complete.
The Minutes Video Consumed column only includes time that users spent watching video lectures, and not time they spent reviewing lectures that do not include videos. Lectures that do not include videos, however, still count towards course completion. For example, a User Activity Report could indicate that a user has completed four lectures, but there is no time recorded in the Minutes Video Consumed column, if those four lectures were not video lectures.
What does the Practice Activities Completed column indicate in the Legacy User Activity Reports?
The No. of Practice Activities Completed Successfully column in the user activity reports indicates how many practice activities the user has completed successfully. Practice activities include quizzes, coding exercises, and practice tests. (If the practice activity was started but not completed or was completed unsuccessfully it will not be included in this count.)
If there is a row in the User Activity Report with 0 minutes consumed and 0 practice activities completed, this indicates that the user started but did not complete one or more practice activities. Or that they started and completed one or more practice activities unsuccessfully.
Discrepancy between the User Activity Dashboard and the User Course Activity Report?
The User Activity Dashboard and Course Activity Report in Udemy Business serve different purposes and use distinct data sources and timeframes, leading to variations in metrics. The User Activity Dashboard shows near real-time activity for users who have started watching lectures or attempting practice tests, with metrics localized to the user’s time zone. In contrast, the Course Activity Report includes all user activities, including those who have just enrolled, with timeframes aligned to Pacific Standard Time (PST) days.
Learn more about the User Activity Dashboard:
User Progress report questions
Which specific result is posted in the Final Results (Column N) for the Quizzes column of User Progress Reports?
The Final Result (if Quiz) column (column N) of the User Progress Reports includes the score(s) a user recorded completing a quiz. For example, if a user takes a quiz twice and receives 80% on their first try, and then receives 90% on their second and final attempt, then the User Progress Report will contain two rows. Each row will include the score the user recorded for that respective attempt. Please note that there is no limit to how many times a user can retake a quiz.
-
How to Access And Review The Group Membership Log
Read articleThe Group Membership Log includes extensive information about what actions a group has completed and what employees have been added or removed.
Admins can access the Group Membership log of every group. Group admins, however, can only access the Group Membership Log for the groups that they are group admins for.
For more information on how to create user groups, please click here.
How to access the group membership log
The Group Membership Log can be accessed by doing the following:
- From the Manage dropdown menu at the top, select Manage Users
- On the left hand side of the page, click on Manage Groups
- Click the ellipses to the right of the group name. Or, after selecting a specific group, click on the ellipses beside the Invite new users button.
- Select Group Membership Log
What information does the Group Membership Log include?
The log reports on:
- Date: Date action was completed
- Name: Name of employee that was added or removed
- Email: Email of employee that was added or removed
- Action: Action performed
- Group: Group that log is reporting on
- By: The method in which the user was added/removed from the group - i.e. SSO data, CSV upload, name of admin/group admin, etc.
Note: The Group Membership log includes data from 23 March 2018 onwards.
-
Insights and Reporting for Courses no Longer in The Udemy Business Collection
Read articleThis article discusses how updates to the Udemy Business course collection may impact Insights and Reporting for admins and group admins.
If a course is no longer available in the Udemy Business collection, is prior learning data deleted from admin dashboards and reports?
All learning data is retained, even if a course is no longer available in the Udemy Business collection. Admins are able to view more detailed information from the Course Insights dashboard, or on individual learner’s profile pages.
The minutes consumed and other activity on these courses will also still be recorded via admin Insights and Reporting.
-
Verifying Offline Course Viewing in Insights and Reporting
Read articleThe Udemy Business mobile apps provide learners the ability to save courses and lectures for offline viewing so they can learn on the go, even if they need to be disconnected from the internet.
This article outlines how organizations can ensure offline course viewing is reflected in their reporting.
How to verify offline course viewing
In order for any offline consumption to be reflected in admin Insights and Reporting, learners must take the following actions:
- Bring their mobile device back online by connecting to wifi or cellular data.
- Open up the Udemy Business app again once the device is online to allow their progress to sync.
Once learners have completed the above steps, their offline course consumption will be reflected in reports and dashboards after the next data refresh.
-
When is Data Updated for Insights and Reporting?
Read articleThis article discusses how frequently Udemy Business insights and reporting data are updated.
- Learn about what reports and dashboards are available.
Frequently asked questions
- How frequently are dashboards and reports updated?
- How can I tell how fresh the data is?
- What timezone are the data exports in?
How frequently are dashboards and reports updated?
For the majority of Udemy Business accounts, the Path Insights, Ratings & Reviews, and Course Insights dashboards, along with Data Export reports, are updated one to four times per day.
The User Activity dashboard and data are updated every few minutes (Note: for some organizations this data is updated one to four times per day).
Please note: Updates for these dashboards and reports may not occur at the same time as the prior day. For example, a report can be updated on a Monday at 0:01 AM and then can be updated Tuesday at 23:59 PM, updating at least once within the day.
How can I tell how fresh the data is?
The date and time up to which data is included is indicated by a data freshness notice in the top right of each dashboard. The timestamp is localized based on your computer’s local settings.
What timezone are the data exports in?
All datetime stamps within Udemy Business data export reports are localized into a Coordinated Universal Time (UTC) format. The localized time is based on the admin’s local computer timezone setting that exported the report.
Please note: The time frame filters on the data exports reports page are based on the UTC -8 time zone (Pacific Standard Time). Depending on your location, and what dates you are selecting, you may need to update the filter accordingly to source the required data.
For example, admins in the UTC+9 time zone (i.e., Japanese Standard Time) wishing to retrieve data for their organization’s learners that occurred on 08/01, would need to select 07/31.
-
What Defines an ‘Active’ User in Udemy Business
Read articleThis article explains what actions learners must take in their Udemy Business account in order to be considered ‘active’, so that their learning is captured in Insights and Reporting for admins and groups admins to review.
Learner engagement in Udemy Business: What activity will be recorded
The following actions are considered activity in Udemy Business and will be recorded within Insights and reporting for admins and group admins:
- Enrollment of a course (either self-enrolled or assigned)
- Progress through a video lecture (in chunks of 15 seconds)
- Completion of a lecture
- Attempt of a practice activity
- Completion of a practice activity
- Completion of a course
- Reviewing/rating a course
So long as a user has taken one of the above actions during the selected time frame, they are considered active and will be included in data export reports.
What is recorded in User activity dashboard and exports
When viewing the User activity dashboard the number of active users is counted as a percentage of the total number of users who were licensed in the account during the time range selected. This includes any users that joined (visited for the first time) before the end of the time range. It may also include deactivated users, if they were deactivated after the start of the time range. By calculating it this way, we ensure that all activity that occurred during the time range is included in the calculations.
- The Active User Base pie chart that is located under the User Activity dashboard, includes users who have been active in their Udemy Business account by taking at least one of the actions listed above in the selected timeframe. The number of active users shown under the Active User Base pie chart should match the count of users shown in the User Activity report.
- The User Activity Report (active users), which can be downloaded from the User Activity dashboard, includes any user who was active in their account during the selected time frame. Any users that are currently deactivated at the time of export will be marked deactivated in the report.
- The User Activity Report (All Users), which can also be downloaded from the User Activity dashboard, includes all users in the account, regardless of if they were active during the selected time range. This enables you to identify users that have not been active so that you can take steps to re-engage them in learning.
Activated versus deactivated users
Learn more about the difference between activated and deactivated users and how it impacts admin reporting.
-
What Insights and Reporting are Available in Udemy Business?
Read articleThis article outlines what dashboards and reporting features are available in your account’s Insights and reporting, which you can use to understand how people in your company are learning. You’re able to view information for your entire organization or select specific groups to understand learning trends.
How to access Insights and reporting
1. Click on the Manage menu in the top right of the screen.
2. On the Admin Overview page, select Insights and Reporting. You can also find it from the menu on the left-hand side.
The available Insights and reporting options
From the menu on the left-hand side of the Insights and reporting page, you’ll find the following options, depending on your Udemy Business plan:
Available for Team and Enterprise plans
The following features are available for Team and Enterprise plan account administrators.
User Adoption Funnel: This dashboard will allow you to see how many and which users in your organization have adopted the Udemy Learning account and have started using it. Learn more about the User Adoption Funnel.
User Activity: This dashboard will help you understand more about user activity within your Udemy Learning account. Learn more about the User Activity dashboard.
Ratings and Reviews Admin Dashboard: Through the ratings and review dashboard you can see how your users have rated courses they’ve taken in Udemy Business, and any reviews they’ve left on the course. Learn more about the Ratings and Reviews Admin dashboard.
Available for Enterprise plan
The following features are only available for Enterprise plan account administrators.
Learner Check-in and Learner Feedback (Enterprise plan only): To empower our Udemy Business admins with actionable insights to optimize their learning programs, the Learner Check-in feature helps admin better understand employee sentiment towards Udemy Business. Learn more about the Learner Check-in feature.
Skill Insights (Enterprise plan only): This dashboard will show you the skills your employees are investing time in learning, and provides a clear picture of time spent learning per category, subcategory and topic. Learn more about the Skill Insights dashboard.
Data Export Reports (Enterprise plan only): There are multiple reports you can download to export data and create your own customized reports inside another tool. These reports are also available for download from the other dashboards where relevant. Learn how to generate and download Data Export Reports.
- User activity report (active users): Get real-time information at the user level, such as time spent watching lectures (available for data after 1st July 2022).
- User activity report (all users): Get real-time information at the user level, such as time spent watching lectures (available for data after 1st July 2022).
- User activity report: Get information at the user level (e.g. how many courses has each user enrolled in, learning time per user, etc). View your top learners across your company or by a specific group. Note: This is a legacy report that does not provide real-time information
- User progress report: Get information at the lecture level. This is our most granular report and you'll see quiz results for example. This report will include any lectures or quizzes that were either started or completed within the time range selected (or across all time if none is selected).
- User skills activity report: Get information at the user level, which provides detailed skills activity per user, including minutes consumed for specific topics and what categories they are learning.
Course Insights (Enterprise plan only): This dashboard will help you to understand more about what users are learning within the Udemy Learning account. Learn more about the Course Insights dashboard.
Path Insights (Enterprise plan only): this dashboard provides details on users enrolled in a learning path, their progress and if they were assigned or self-enrolled. Learn more about the Path Insights page.
Pro Insights (Enterprise with Pro plan only): the Pro insights option allows you to review employee activity within labs and assessments, via the applicable report. Learn more about Pro insights. Note that this is only available to organizations that have Udemy Business Pro for their learners.
When is data updated for insights and reporting?
Learn when data is updated in your account’s Insights and reporting.
Reporting - General
-
Practice Tests: How Activity And Time is Tracked
Read article -
What is a Beta Assessment?
Read article -
Admin Overview: Team Plan
Read article -
Admin Overview: Enterprise Plan
Read article -
Viewing Learner’s Badge Data Within Your Udemy Business Account
Read article -
Streaks: Frequently Asked Questions
Read article -
User Categories And Reporting: Activated vs. Deactivated
Read article -
Data Export Reports: FAQ
Read article -
How to Access And Review The Group Membership Log
Read article -
Insights and Reporting for Courses no Longer in The Udemy Business Collection
Read article -
Verifying Offline Course Viewing in Insights and Reporting
Read article -
When is Data Updated for Insights and Reporting?
Read article -
What Defines an ‘Active’ User in Udemy Business
Read article -
What Insights and Reporting are Available in Udemy Business?
Read article