2025.03.11
Last updated
Was this helpful?
Last updated
Was this helpful?
Release notes were designed to give an overview of new, enhanced, & fixed items released to our customers. This release includes the following pipelines.
New items represent new features/functionality that have been added to ScholarRx applications.
The new 'Manage Assignments' feature, which is still currently part of the Qmax Management application, is now being integrated into the Faculty Portal since the Qmax Management application will eventually be retired. The ‘Manage Assignments’ feature provides instructors with the ability to create custom tests to assign and assess students’ performance.
Note: The original test creation feature in the Qmax Management application will continue to function until further notice. Tests created in the original Qmax Management application will appear in the new ‘Manage Assignments’ experience, and vice versa. Should you decide to disable beta, all work done in the new ‘Manage Assignments’ application will still be accessible in the existing Qmax Management application.
🛑 The ‘Faculty’ role is required to access this feature & the ‘Beta’ toggle must be on.
To access the ‘Manage Assignments’ page, perform the following steps.
Login to the Faculty application at: https://faculty-portal.scholarrx.com. The ‘Faculty’ dashboard is displayed.
Click on your profile icon and enable the ‘Beta Features’ option. When enabled, the application will require an update.
Click the ‘Proceed’ button to update the application. The ‘Manage Assignments’ page is displayed.
Click on the ‘Manage Assignments’ menu option. If you have not created any assignments, the following image is displayed; otherwise, existing assignments are displayed.
[No assignments view – empty state screen]
[Existing assignments view]
When there are existing tests on the ‘Manage Assignments’ page, they are displayed on three different tabs, when applicable.
Published. This tab displays all tests that have been published and have not been manually closed by an instructor. The default sort is based on the due date that is the furthest away, unless there are tests with no due dates, then those display first.
Drafts. This tab displays all tests that have been created but not yet published.
Closed. This tab displays all tests that have been closed by an instructor.
The following table describes the items on this page and each of the tabs.
Filter option
Filter. The tests on this page can be filtered by:
Name
‘Last Updated’ date
Search field
Search field. Enter any part of an assignment name to search for a specific assignment.
Note: When doing a search, it is performed across all three tabs.
Published tab
Test Name. Displays the test name.
Test Type. Displays the test type. Options include:
Timed
Tutor
Untimed
Assignment Dates. Displays the start and end dates for the test.
Note: When viewing tests that were created in the Qmax Management application, you may notice that the assignment dates display as ‘not yet published’. This is because the Qmax Management application did not require start and end dates or times.
Questions. Displays the total number of questions on the test.
Student Progress. Displays a percentage that represents the number of students who have completed the test divided by the total number of students who have been assigned to the test.
Three vertical dots. Displays options you can perform on the test, based on the test’s state. Options include:
Copy link. When clicked, a link to the test is copied to the clip board so you can share it with other users in your organization who are assigned to the test. If someone outside of your organization, or someone who has not been assigned to the test receives the link and tries to access the test, an error page will display instead.
Unpublish. Only a future-dated test can be ‘unpublished’. When clicked, this option unpublishes the test so it can be modified or deleted if no longer needed.
Close Assignment. When clicked, the test is closed and can no longer be accessed by students. Tests can only be closed when one of the following conditions is met:
All students have submitted the test.
The test’s end date & time have been reached. When there is no end date, all students must submit the test before the ‘close’ option is presented.
Last Updated. Displays the date on which the test definition was last updated.
Draft tab
Test Name. Displays the test name.
Assignment Dates. Displays the start and end dates for the test.
Note: When viewing tests that were created in the Qmax Management application, you may notice that the assignment dates display as ‘not yet published’. This is because the Qmax Management application did not require start and end dates or times.
Test Type. Displays the test mode. Options include:
Timed
Tutor
Untimed
Questions. Displays the total number of questions on the test.
.
Student Progress. Displays a percentage that represents the number of students who have completed the test divided by the total number of students who have been assigned to the test
Three vertical dots. When clicked on a test in draft mode, this provides a method to delete test.
⚠️Use with caution. Once a test is deleted, it cannot be undone.
Closed tab
Test Name. Displays the test name.
Assignment Dates. Displays the start and end dates for the test.
Note: When viewing tests that were created in the Qmax Management application, you may notice that the assignment dates display as ‘not yet published’. This is because the Qmax Management application did not require start and end dates or times.
Test Type. Displays the test mode. Options include:
Timed
Tutor
Untimed
Questions. Displays the total number of questions on the test.
.
Student Progress. Displays a percentage that represents the number of students who have completed the test divided by the total number of students who have been assigned to the test
Click the ‘Get Started Now’ button from the empty state screen or, if you have existing assignments, click the ‘Create Assignment’ button from the ‘Manage Assignments’ page. The test creation wizard is displayed.
The following table describes the items on the test wizard page.
Discard and Exit button
When clicked, this button will exit the test wizard and discard the progress on the test creation without saving it.
Question Assistant option
The Question Assistant provides a method to use TAI (teaching with AI) to search for questions in the ScholarRx question banks to be utilized on a test. There are several methods you can use to search for questions.
Upload a file. Click the paper click icon to upload a file. The ScholarRx question banks will be searched to find supporting questions based on the content of your document.
Enter a term, topic, or describe your ideal assessment, then click the AI icon.
Find questions in specific banks by using the ‘#‘ symbol. Options include: Qmax1, Qmax2, or Organization (if your organization has created any questions using the Qmax Create application).
Create a test based on specific topics by using the ‘@’ symbol. For example, ‘@Purine salvage deficiencies’.
Search suggestions
Select one of the search suggestions displayed at the bottom of the page to get a quick start.
High-Yield Topic Explorer option
When clicked, the ‘High-Yield Topic Explorer’ displays a tree of topics based on specific areas of interest.
To create a test with the Question Assistant, perform the following steps.
From the ‘Manage Assignments’ page, click the ‘Create Assignment’ button. The test wizard is displayed.
Click the ‘Question Assistant’ button at the top, then enter a term, topic, or description in the text box, then click the purple arrow icon.
Question results are displayed. When a specific number of questions is not requested, the top three questions are returned when available.
The following table describes the layout of the questions on this page.
Plus sign (above all question results)
When clicked, this selects all questions to be added to the test.
Plus sign (next to individual questions)
When clicked, this selects the individual question to be added to the test.
Question text
Displays the text of the question for review purposes.
Drop-down arrow (next to individual questions)
Provides a method to expand the question to view the question, distractors, correct answer, & high-yield summary.
Colored dots (beneath individual questions)
Defines the question difficulty. This replaces the PVal number in the existing Qmax Management application.
Options include:
· Easy (green dot) if greater than 80% of students have answered correctly
· Medium (yellow dot) if between 61% and 80% of students have answered correctly
Hard (red dot) if less than 61% of students have answered correctly
Yellow warning indicator
Topic
Displays the topic assigned to the question.
Discipline
Displays the discipline assigned to the question.
Organ System
Displays the organ system assigned to the question.
ID
Displays the question ID.
Bank (displayed beneath the question ID)
Identifies the question bank to which the question is associated. Options include:
· Qmax1
· Qmax2
Organization (when applicable)
Clipboard icon (displayed to the right of all question results and only after questions are selected)
Displays the total number of selected.
Select the desired questions by clicking on the plus symbol next to each question or click the plus sign above the question results to select all questions.
If you want to add additional questions to the test, click on one of the ‘related search’ options or enter new text in the ‘Ask about a related topic or follow-up’ text box. The additional question results are displayed beneath the original question result set. Continue searching for and selecting the desired questions from the search results, then click the ‘Continue’ button at the top to proceed with the test creation process. The ‘Arrange Your Questions’ page is displayed.
Click on the double horizontal lines to the left of each question to drag the question into the desired order, then click the ‘Continue’ button. The ‘Configure Assignment’ page is displayed.
The following table describes the items on this page.
Assignment Name (required)
Enter a name for the assignment. This is the name that will display for students on their ‘My Tests’ page, as well as in the email notification they’ll receive 48 hours before the test start date, when a start date is configured. If a start date is not configured, the email notification is sent immediately.
Assignment Description (optional)
When a test assignment description is defined, it will display on the assignment details page.
Assignment Type (required)
Select the desired test type. Options include:
Tutor. Tutor mode allows students to see explanations after each answer response. Because of this, the test is graded based on the students’ first answer response.
Timed. The test must be completed in a defined time. The default test time is based on the number of questions x 1.5 minutes per question; unless the option in the ‘Average Time Per Question’ drop-down is modified and/or the student is given additional time accommodations by their instructor. The test grade is based on the students’ last answer response. Students will not see feedback until the test is completed.
Untimed. The test has no time limitation and is graded based on the students’ last answer response. Students will not see feedback until the test is completed.
Number of questions. Beneath the ‘Average Time Per Question’ drop-down, the total number of questions on the test is displayed. This serves as a reminder to the instructor for how many questions were selected for the test.
Assign to Students and Groups (required)
This section provides a method for instructors to assign the test to individual students or a student group. Enter a student name or student group to perform a search, then select the desired students and/or student group(s). A mix of individual students and student groups can be selected.
Assignment Dates (required)
Note: In the original test creation experience in the Qmax Management application, the start/end dates and times are not required fields.
Start Date. Enter a start date for the test. Students will not see the test on their ‘My Tests’ page until the start date/time has been reached.
An email notification is sent 48 hours in advance of the test’s start date and is based on the instructor’s time zone.
A system notification is displayed on the student’s dashboard on the test’s start date.
Start Time. Enter a start time for the test.
Due Date. Enter a due date for the test. Even when the test’s due date and due time have been reached, the test will remain accessible to the student until the instructor manually closes the test.
Due Time. Enter a due time for the test. Even when the test’s due date and due time have been reached, the test will remain in a published state and be accessible to students until the instructor manually closes the test.
Allow Retakes
When enabled, students can retake the test an unlimited number of times; however, only the first attempt is recorded as the actual score.
‘Discard and Exit’ button
When clicked, you will exit the test creation process, and the test will not be saved.
‘Previous’ button
When clicked, the ‘Previous’ button returns you to the prior screen.
‘Save Options’ button
Save as Draft. When clicked, the assignment is saved as a draft and can still be modified. The assignment is displayed on the ‘Manage Assignments’ page on the ‘Drafts’ tab until it is published, deleted, or closed.
Publish Assignment. When clicked, the assignment will be published and can no longer be modified.
Email. An email notification is sent 48 hours before the test’s start date. When no start date is defined, the email notification is sent as soon as the test is published.
System Notification. A system notification displays on the student’s dashboard.
Complete the fields on the form according to the above table, then click the ‘Save Options’ button.
When the ‘Save as Draft’ option is selected, the test is saved and is displayed on the ‘Manage Assignments’ page on the ‘Drafts’ tab. When the ‘Publish Assignment’ option is selected, the test is saved and published and is displayed on the ‘Manage Assignments’ page on the ‘Published’ tab.
To create a test using the High-Yield topic explorer, perform the following steps.
From the ‘Manage Assignments’ page, click the ‘High-Yield Topic Explorer’ button. The high-yield topics tree is displayed.
Select the desired topics, then click the ‘Continue’ button.
The ‘Related Questions’ page is displayed with the most applicable question results based on the selected topics.
The following table provides a description of the items on this page.
‘Discard and Exit’
When clicked, you will exit the test creation process, and the test will not be saved.
‘Previous’ button
When clicked, the ‘Previous’ button returns you to the prior screen.
‘Continue’ button
When clicked, the ‘continue’ button progresses you to the next screen.
Search field
The search field provides a method to search the question stem and question lead-in for keywords. This makes it easier to find questions to include on the test based on keywords.
Topic
Provides you with a method to filter question results by topic.
Discipline
Provides you with a method to filter question results by discipline.
Organ System
Provides you with a method to filter question results by organ system.
Not Used Since (date picker)
Provides you with a method to filter question results by a specific ‘not used since date’, when applicable.
Hide Correct Answers setting
When enabled, this option prevents instructors from seeing the correct answer when questions are expanded.
‘Plus’ symbol (above all questions)
When clicked, all questions will be added to the test.
‘Plus’ symbol (next to individual questions)
When clicked, the selected question will be added to the test.
Drop-down arrow (displayed on the right side of individual questions)
When clicked, the question is expanded and displays the question’s:
Stem
Lead-in
Distractors
High-yield summary
Colored dot (beneath individual questions)
Defines the question difficulty. Options include:
Green dot – easy
Yellow dot – medium
Red dot – hard
Topic (displayed beneath the question stem)
Displays the topic associated with the question.
Discipline (displayed beneath the question stem)
Displays the discipline associated with the question.
Organ System (displayed beneath the question stem)
Displays the organ system associated with the question.
ID (displayed beneath the question stem)
Displays the question ID. This ID aids in identifying the question when viewing test results and/or analytics.
Question Bank (displayed beneath the question stem)
Identifies the question bank to which the question belongs. Options include:
Qmax1
Qmax2
Organization (when applicable)
Yellow warning indicator
Displays when a question has already been used on another test. When clicked, a modal displays and shows you which test(s) the question has been used on and provides a method to view the test (highlighted in yellow).
Question counter (displayed to the right of all question results and only after questions are selected)
Displays the total number of selected questions.
Select the desired questions, then click the ‘Continue’ button. The ‘Arrange Your Questions’ page is displayed.
Click the double horizontal lines next to a question to drag the question into the desired order, then click the ‘Continue’ button. The ‘Configure Assignment’ page is displayed.
Complete the fields on this page the same way as if you used the ‘Question Assistant’ option (above), then click the ‘Save Options’ button to save the test as a draft or publish it.
The ‘Assignment Analysis’ page provides instructors with a method to view students’ performance on an assignment. From the ‘Manage Assignments’ page, instructors can view the ‘Assignment Analysis’ page from two different tabs:
Published tab
Closed tab
Note: Both tabs provide the same view and analytics.
To access the ‘Assignment Analysis’ page for a specific assignment, perform the following steps.
From the ‘Manage Assignments’ page, from either the ‘Published’ or ‘Closed’ tabs, click on the test name. The ‘Assignment Analysis’ page is displayed. The ‘Assignment Analysis’ page (below) is displayed in multiple images, so they are easier to view.
[Performance by Student section]
[Performance by Question section]
The following table describes the items on the ‘Assignment Analysis’ page.
Test Name
Displays the name of the test being viewed.
Download Results
Results can be downloaded to an MS Excel file and includes data on two different tabs:
Student Results tab
Student name
Student email
Status of test (Not Started, In Progress, or Completed)
Test start time
Test end time
Total numbers of correct answers
Total number of incorrect answers
Test score (percentage)
Completion % (correct + incorrect / total)
Question Results tab
Question ID
Topic
Organ System
Discipline
Dificulty
Correct Count
Incorrect Count
Unanswered Count
Performance % (correct / incorrect)
Test Type
Displays the test type (mode). Options include:
Timed
Tutor
Untimed
Start Date
Displays the start date and time of the test; defined when the test was created.
Note: If the test was originally created in the Qmax Management application where start and end dates & times were not required, this field may be blank.
Due Date
Displays the due date and time of the test; defined when the test was created.
Note: If the test was originally created in the Qmax Management application where start and end dates & times were not required, this field may be blank.
Time Per Question
Displays the ‘average time per question’ that was defined during the test creation process.
Search field
Search for students by entering first or last name, or email.
Performance by Students Section
Student Name
Displays the names of the students who were assigned to the test.
Status
Displays the status of the test (Not Started, In Progress, or Completed)
Submission Date
Displays the date on which the test was completed (submitted) by the student.
Performance
Displays the performance based on the status of the test.
Not Started. No performance data.
In Progress. Displays the number of questions answered.
Completed. Displays the number of correct vs. incorrect questions.
Attempts
Displays the number of test attempts taken by the student.
Note: When a student has multiple attempts on a test, all attempts are displayed for the instructor to view; however, only the score for the first attempt is recorded beneath the performance column.
🛑 In the existing Qmax Management application on the test’s ‘Results’ tab, only the students’ first attempt is displayed. On the test’s ‘Analysis’ tab, only the answers from the first attempt are included in the number of correct, incorrect, & unanswered question totals.
3- dot menu
Clicking the menu allows you to ‘view student details’, displaying the same information as the ‘Activity by Student’ page:
Student name
Class
Predicted Score. This field only displays a score when more than 200 questions are answered by the student within a 15-day period.
Activity by date for:
Qmax Questions
Flash Facts
Express Videos
Bricks
Filter options
Performance by Question Section
Sort Order
The default sort order is based on the order of the questions on the test defined during the test creation process. Additional sort options include:
Most Difficult
Least Difficult
Question
Displays the stem of the question.
Correct
Displays the number of students who answered the question correctly.
Incorrect
Displays the number of students who answered the question incorrectly.
Unanswered
Displays the number of students who didn’t answer the question.
Answered Correctly
This percentage represents the overall percentage of students who answered the question correctly and is calculated by the total number of students who answered the question correctly / total number of students who answered.
Drop-down arrow
Expands the question to expose the question stem, lead-in, distractors, and high-yield summary.
When expanded, a percentage is displayed next to each distractor to indicate the percentage of students who selected each answer.
Topic
Displays the topic associated with the question.
Organ System
Displays the organ system associated with the question.
Discipline
Displays the discipline associated with the question.
ID
Displays the ID of the question.
Students can retake their self-created tests as unlimited number of times. For faculty-created tests, the retake option must be enabled during the test creation process. When enabled, students can retake faculty-created tests multiple times; if not, they can only attempt the faculty-assigned test one time.
To retake a self-created test, or a faculty-assigned test when the ‘Allow Retakes’ option has been enabled, perform the following steps.
As a student who is logged in to the USMLE-Rx application, click on the menu, then click the ‘My Tests’ option. The test summary page is displayed.
Beneath the ‘My Tests’ section, click the three-dot menu next to the desired test, then click the ‘Retake Test’ option.
Complete the test and click the ‘End Test’ button. The ‘Test Analysis’ page is displayed.
Students can view detailed test statistics on their test retakes. Viewing test statistics on test retakes offers benefits for students. By analyzing performance data, students can identify specific areas where they need improvement, allowing them to focus their study efforts more effectively. This insight helps them understand their strengths and weaknesses, leading to more targeted and efficient learning. Additionally, seeing their progress over multiple attempts can boost their confidence and motivation, as they can track their improvement over time. Access to detailed test statistics empowers students to take control of their learning journey, fostering a deeper understanding of the material and enhancing their overall academic performance.
There are multiple ways to view statistics on test attempts.
From the ‘My Tests’ page, click on the three-dot menu next to the desired test name, then click the ‘View Statistics’ option to view the statistics for the last test attempt.
You can also click the three-dot menu and select the ‘Review Test’ option to get back to the ‘Test Analysis’ page where you will see a drop-down menu of all test attempts.
Finally, from the USMLE-Rx application (student’s view), multiple test attempts are recorded and displayed beneath the test name. Click the drop-down arrow to expand the row to see all test attempts, then click on the ‘Review Attempt’ option within the attempt box to view statistics related to that specific test.
The following table describes the items associated within the individual test attempt boxes.
Attempt #
Displays each test attempt, with the oldest attempt displaying first, followed by subsequent attempts.
Percentage (score)
Displays the score of the completed attempt. The score is calculated by the total number of questions / total number of questions correctly answered questions.
Note: Unanswered questions are counted as incorrect.
Date
Displays the date on which the test attempt was completed.
Review Attempt
When clicked, the student is redirected to the test review page for that specific attempt where they can view their test details.
View Statistics
When clicked, the student is redirected to the ‘Test Analysis’ page for that specific test attempt where they can view detailed test analytics. From this page, students can view test analysis data for all attempts by clicking on the drop-down menu and selecting the different test attempts.
Creating questions from a ScholarRx Brick using AI is an innovative approach that leverages advanced technology to enhance the educational content experience. By utilizing AI, educators can efficiently generate high-quality, relevant questions that align with the content of the ScholarRx Brick. This process not only saves time but also ensures that the questions are tailored to the specific learning objectives and topics covered in the Brick. The AI-driven question generation tool can analyze the content, identify key concepts, and create a variety of question types, including Basic Recall, Short Clinical, Extended Clinical.
🛑 The ‘Faculty Qmax Author’ role is required for this feature.
To generate questions from a Brick, perform the following steps.
Open the Brick Exchange https://exchange.scholarrx.com and search for the desired Brick.
Click the three-dots next to the Brick, then click on the ‘Generate Questions’ option. The ‘Generate Questions’ modal is displayed.
The following table describes the items on this modal.
Question Style options
Basic Recall. This question style is a simple recall and comprehension question without clinical scenarios. No vignette or clinical context is included. When this style is selected, a question stem is not created, but the question can still be saved; however, a stem must be written before the question can be published.
Short Clinical. This question style offers brief clinical scenarios (30 words or less) following NBME style, testing application of knowledge through single or multi-step problems.
Extended Clinical. This question style offers comprehensive clinical vignettes (50+ words) matching USMLE-style format, featuring multi-step problem-solving scenarios.
‘No Thanks’ button
When clicked, the ‘Generate Questions’ modal is closed, and no questions are generated.
‘Generate Questions’ button
When clicked, questions are generated and the user is redirected to the Qmax Create application where they can perform additional tasks on their questions, select the desired questions to save them, or discard questions that are no longer needed.
Select the question style, then click the ‘Generate Questions’ button. A progress modal is displayed.
A redirect to the Qmax Create application occurs and the ‘Generated Questions’ page is displayed with the question results.
The following table describes the items on this page.
‘Select all’ checkbox (above all question results)
When enabled, all question results are selected.
0/? Selected
Displays the number of selected questions out of the total number of question results.
‘Select’ checkbox (next to individual questions)
When enabled next to a question, the individual question is selected.
Copy icon
When clicked, the question is copied to the clipboard.
Regenerate icon
When clicked, the question will be regenerated based on the additional instructions provided.
Delete icon
When clicked, the question is deleted from the results.
Output rating buttons
The question can be rated for accuracy by clicking the thumbs up or thumbs down button and providing feedback, if desired.
Discard and Exit
Save and Exit
When clicked, the ‘Save Generated Questions’ modal is displayed.
Select the desired questions, then click the ‘Save and Exit’ button. The ‘Save Generated Questions’ modal is displayed.
Click ‘Yes, Save’ to save the selected questions, or click the ‘Cancel’ button to return to the ‘Generated Questions’ page. When the questions are saved, you are redirected to the ‘My Questions’ page in the Qmax Create application where your saved questions are displayed.
Note: Newly created questions are identified by an orange line displayed to the left of the question.
Customers who have the ‘Cohort Manager’ role and who are assigned to manage an onboarding group, can now download a report to show who has successfully completed the onboarding process. The report contains the following information:
Full name
Email address
Class
Last login date
Activation date
Other onboarding group assignments
[For illustration purposes]
A menu option for the Qmax Create application has been added to the 9-dot menu. This option only displays when the logged in user has the Faculty Qmax Author role. The 9-dot menu is displayed in the following applications:
Bricks Create
Brick Exchange
Faculty Portal
USMLE-Rx
In the Qmax Management application, a menu option for Qmax Create has been added to the ‘Other Tools’ section.
The ‘Stats & Analytics’ application dashboard has been renamed to 'Faculty'. The ‘Faculty’ application is now a comprehensive platform for onboarding, managing user groups, test creation and test assessment, and reporting for our institutional customers.
In the Qmax Management application, the menu item still displays as ‘Stats and Analytics’ and will be updated in a future release.
Per our customers’ request, we have added the ability to filter by ‘Accommodation’ on the ‘Organization Roster’ page.
Displays when a question has already been used on another test. When clicked, a modal displays and shows you which test(s) the question has been used on and provides a method to view the test (highlighted in yellow).
When clicked, all questions will be discarded and you will be redirected to the ‘My Questions’ page in the Qmax Create application.
