This feature is available for Enterprise and White Label Plans only
This feature is used together with the Session and Speaker Approval Process. Please ensure to read and understand both processes.
The Session Reviewer Approval Process
The Reviewer Application Approval feature allows you to accept reviewers who will help you evaluate session proposals. If you have a lot of session proposals, this feature will help you stay organized by assigning people to review the sessions. Once reviewed, you can take a look at their ratings and comments to decide whether a proposal will be denied or approved. This guide will walk you through how to enable the application process and set up a review workflow, making it easy for reviewers to evaluate the proposed sessions.
How Does It Work?
Once the reviewer application approval feature is enabled, an "Apply as Reviewer" section will appear on the event’s landing page. When they click the "Apply" button, they will be asked to enter their information.
You will receive the request in the admin console wherein you can accept or reject them as a reviewer. When you approve them as a reviewer, you can start assigning sessions to them.
After a session is assigned, they will receive an email on how to access to "Review Portal" where they can evaluate the session proposals you assign to them.
When reviewers send in their evaluation, you can assess whether the session should be part of your event on not based on the reviewer's feedback.
Enable the Reviewer Application Approval Feature
Go to Registration > Registration Approval
Select the Reviewer tab
Enable the toggle for Enable Reviewer Application Approval
After enabling it, you should see the Reviewer section on the landing page's right side of the About tab.
Customize the Reviewers Section on the Landing Page
You can customize the label, description and button text of the Reviewers section on the landing page.
Go to Event Design > Event Website > Edit Website
Scroll down to find the text boxes to enter new text
Click the Apply button to change the text
Notes:
Title "Apply as Reviewer" has a 50 character limit
Description has a 150 character limit
Button has a 50 character limit and the button color cannot be changed
Customize the Questions
In the Approvals menu, go to Form under Reviewer to add and customize the questions to be asked depending on the information you need from them.
Customize Emails
After submitting their application, they will get an email confirming that their request has been received. Whenever you change the status of their application to approved, denied or waitlisted, they will get another email to let them know about the change.
You can edit the subject and body of these emails, and disable the automatic sending if you don't want them to receive the emails in the Post Registration Emails section in the Settings tab.
Introductory Page
You can add introductory page that applicants will see before they enter all the information. You can customize the banner image, title and description on that page. This will be the page the applicants see when they click the button from the landing. You can enable this feature under the Customization section in Settings.
Apply as a Reviewer
When applicants click the button from the landing page they will see the introductory page (if enabled). The next step is to enter the reviewer's information, and at the end they will see the confirmation page. They will also get the application request confirmation email if it's enabled.
Review Applicants
Go to the Applicants tab in the Reviewer Approval feature in the admin console. Once an application is submitted it will appear in this tab. Click an item to see the details.
Approve Applicants
The status of a new applicant will be Pending. Click the dropdown menu in the Status column to change it from Pending to Waitlisted, Denied, or Approved. They will receive an email for the status change if the emails are enabled.
Approved Reviewers
When you approve a reviewer, they will be added to the Reviewers tab and will also receive a approval email if you have the automatic emails turned on. In your email it's best to let them know that they will receive another email when a session is assigned to them.
Manually Add Reviewers
In the Reviewers tab, you can manually add reviews without going through the application process. Just click the + Add Reviewer button. While adding a reviewer, you can also assign sessions.
Assign Sessions to Reviewers
Once they are approved as reviewers, you can start assigning sessions to them. You can assign the reviewer to multiple sessions, or assign a session to multiple reviewers. We suggest turning on the Invitation Email so that they can receive this once a session is assigned to them.
Option 1: Assign the Reviewer to Sessions
Go to Reviewer > Reviewers tab
Open the reviewer's profile
Go the Assigned Submissions tab, then click Assign
Select the sessions
Click Save
Option 2: Assign the Session to Reviewers
Go to Session > Submissions tab
Open the session proposal
Go to the Reviewers tab on the right panel
Click the dropdown field to see the list of approved reviewers
Click Assign
Review Sessions in the Review Portal
Once a session is assigned to a reviewer, they will receive an automated invitation email with a button to Open the Review Portal where they can start evaluating session proposals.
The Review Portal will show all the sessions assigned to them. They can see the session title, description, and the Review Form questions. After submitting their evaluation, reviewers can still go back and change their answers.
Reviewers can click the Can’t Review button if they need to recuse themselves from evaluating a session assigned to them. This will automatically remove them as a reviewer of the session when they Confirm Recusal.
Check the Reviews
When all reviewers have submitted their evaluation for a session, the session status will automatically change to Review Complete. This makes it easier for you to see which session proposals you can start assessing as an admin. You can look at the Review Status to see how many evaluations are submitted.
To see the evaluations, you can open the session proposal and check the Reviews tab from the left side panel. Note that if the question is a numeric rating, it will show a chart, but for other questions, you'll need to view the full review or download it.
After careful analysis, you can decide to approve or deny the reviewed session.
Note: Admins are not notified when reviews are submitted.
Customize the Review Form Questions
As a default the review questions are numerical ratings for Event Fit, Topic, Creativeness and Trendiness. You can use these questions or come up with your own.
In the Approvals menu, go to Session
Select the Review Processes tab
Open the Default Process
Select the Review Form tab
Click + Add question, select the question type and add the question
Click Save
Custom Review Process
You can create multiple review processes wherein each process may have different sets of review form questions depending on the answers given in the session proposal.
For example, in the default review form, there are 4 questions, but you want to add an extra question for reviewers if in the session proposal, they selected "Customer Support" as topic. You want to know from reviewers if this session can be an opener for the event.
To apply this condition, you'll need to create Review Process with that specific criterion.
Notes:
Routing to a custom review process will only work if the session proposal question is a dropdown question or multiple-choice question.
Make sure these questions are already created before you create the review process.
Create a Custom Review Process
Go to Session > Review Processes and click +Create Process
In the Configuration tab, enter a name for the review process
In the Select field drop-down, choose the dropdown or multiple choice question asked in the session proposal
Select the value that will route the session proposal to this process
Add your questions for this process in the Review Form tab
Click Save
When a session proposal is submitted and they match the criterion of a Review Process, the questions that the reviewer will see for this session will be the questions particularly for that Review Process.
When a session proposal does not match any custom Review Process, then the Default Review Process will be assigned to that session.
You can take a look at the total under Matched Submissions to know how many sessions are assigned to the process.
Other Applications Settings
Search - search for a request by applicant name or email
Filter - filter requests by status
Edit Column - select which columns to show in the list of applicants
Download - download all requests which includes columns for their answers and the request status
Open Request - open the request to see the details
Send status email - resend the status email to the requestor
Download Request - download the individual request information
Delete - delete the request
Other Reviewer Settings
Edit - edit the reviewer's information and session assignments
Resend invitation - resend the invite email with the button to redirect to the Review Portal
Copy magic link - copy the magic link that can be shared to reviewer so they are automatically logged in to Review Portal
Delete - delete the reviewer