Contact Us
Contact:
Froslid Jones, Karen
Assistant Provost, Institutional Research and Assessment
Leonard, Room 1st floor on a map
Institutional Rsch / Assessmt 4400 Massachusetts Avenue NW Washington, DC 20016-8059 United StatesStudent Evaluation of Teaching Faculty & Staff Resources and FAQs
OIRA administers all SET surveys and provides standard reports. Faculty can adjust the timing and add custom personalized questions to their surveys. Instructors may follow AU recommended actions to ensure high student response rates. Please see our Faculty and Staff FAQs below. If you have further questions, email the SET team at Faculty_SET@american.edu.
LOGGING IN
How do I log in to Blue?
There are several ways to access Blue. Click on the link in your Blue invitation or reminder emails to access each action directly. You may also navigate to your Blue account at set.american.edu. Additionally, Blue may be accessed through Canvas in the Student Evaluation of Teaching tool. Click here to find out how to access SET activities and reports through Canvas.
To log in, you must always enter your AU username without "@american.edu." If your credentials are still not working and you are able to access other parts of the AU website, such as MyAU, or Canvas, please contact the SET office at Faculty_SET@american.edu.
SET ADMINISTRATION
When does my SET survey open and close? Can those dates be changed?
By default, SET surveys are scheduled according to the number of days between the first and last class meeting date. Survey schedules may be altered from the default dates and times through the Subject Management (SM) action for instructors, within Blue.
The SM action allows for a SET survey open days to be shortened, lengthened, or readjusted altogether. Instructors may customize the time of day the survey opens or closes. Instructors may wish to adjust the timing of their SET survey dates to open the survey at the start of a class session for in-class completion. Instructors may also wish to extend the survey if the response rate is low, or if a student requests an extension. Determine your default SET survey dates and length using the SET survey administration logic found here.
Follow these instructions to update the SET survey dates at any point in the survey life cycle.
By default, most SET surveys will close on the last reading day of the semester, one day before final exams begin. Instructors may extend the window for their SET surveys; however, surveys must be closed before final grades are submitted.
What are the questions on my SET survey? Can these be changed?
The SET survey consists of 12 closed-ended common instructor and course specific questions, and two open-ended instructor questions. Please click here to preview the 14 common SET questions. These questions cannot be modified.
Instructors have the option to add their own questions to the SET survey through an action called Personalized Questions. No more than five closed-ended questions may be added to a survey. Please add any personalized questions up to two days before the default survey open date. All closed-ended questions have the same answer scale: 1 – strongly disagree, 2, 3, 4, 5 – strongly agree, and N/A.
Departments and programs may also add closed-ended questions to the survey.
You may preview the SET survey for your course, including reviewing any department/program or personalized (if added) questions on the survey.
The results of closed-ended questions are made available to the AU community, while results for personalized questions and open-ended questions are available only to the faculty member.
To learn more about adding department or program questions, please contact OIRA.
I have cross-listed courses. If I add questions or change the timing on one section, does that apply to the other cross-listed section(s)?
No – all cross-listed course sections are treated as individual sections in Blue. All changes or updates must be completed for each course section individually.
My course is team taught. How is my SET impacted by this status?
Team taught courses will have a set of instructor questions for each instructor assigned to the course section for individual feedback. Each instructor may add their own Personalized Questions to the survey. Surveys include only one set of course questions, with the results shared among those instructors teaching the course.
The survey timing adjustment tools are available for all instructors of a course section. If a default survey open and close date need adjusted, only one instructor should complete the action.
I want to change the timing of my survey or add personalized questions. When can I do that? Why can't I see the actions?
SET actions in Subject Management are available approximately 14 days prior to the default SET survey start date, and up to the last day of final exams.
Question Personalization is available approximately 14 days prior to the default SET survey start date and up to two days BEFORE the default survey start date.
Personalized questions added or edited while a survey is open and responses are recorded will remove the responses to questions already collected. Students can reaccess an open survey to reanswer those questions.
If no SET activities are present in your Blue account, no activities are open at that time.
What do the dates on my actions mean? They don't match the end date of the survey.
The dates associated with your Subject Management and Personalized Questions activities are the end date of that specific action for you. SET survey dates that apply to students are found on your Subject Management dashboard by clicking the Subject Management icon found next to "My Home" in your Blue account.
Following are locations of the specific activity close date.
Subject Management
Question Personalization
In legacy landing page
My survey dates are fine, and I do not want to add personalized questions. Do I need to do anything?
No! If you are satisfied with your SET survey(s) as they are, you do not need to do anything. However, if you would like to stop reminder emails from Blue for the current term, navigate to set.american.edu to Subject Management. In the course section card, click the box next to, "I have finished all my tasks, please stop sending me reminders."
Why don't I have a survey for my course?
AU recognizes some types of courses, such as internships and student teaching, don't fit the traditional teaching model SETs are designed to address. Those courses do not receive a survey. In addition, a course section must have at least six students to receive a survey. Course sections that meet concurrently will receive a SET survey if combined enrollment is six or more. Coming soon: SET exempt course list.
SETS AND STUDENTS
How do students access their surveys? How do they know when their surveys are available?
Students receive an automated invitation email from Blue with a personal link to their SET survey. In the email, they are encouraged to complete the survey and are given information about confidentiality and how SET data is used. Alternately, students may access any open SET surveys at the url: set.american.edu or if applicable, through the Student Evaluation of Teaching tool available within Canvas. Canvas offers Instructors access to their SET actions in addition to reports.
Click here to find Canvas instructions for students.
Click here to find Canvas instructions for faculty.
Please communicate your individual expectations to students and consider taking time (15 to 20 minutes) during class meeting time for completion. Studies show response rates are higher overall for instructors who dedicate time in class for SET surveys.
Students receive their email from Blue shortly after the survey opens, but not immediately. If the time of the SET survey is adjusted to open during a specific class meeting, it is possible some or all students will receive the email after the designated SET completion window during the class. During class time, please direct them to set.american.edu or Canvas as outlined in the first paragraph above.
Some instructors offer students incentives for completing their SET surveys. If proof of survey completion is necessary, please direct students to their Blue dashboard at set.american.edu to take a screenshot of the course entry with the completed indicator engaged. The indicator is available in their accounts for 15 days after the survey close date.
If you chose to adjust your survey timing, it is advised students complete the survey during the last few class meetings, and not during finals week. Please refer to these instructions on how to alter the survey open and close dates and times. The Subject Management task is available 14 days before the default survey open date.
Are SET results confidential or anonymous? How do I answer student questions about who has access to SET results?
- SET results are confidential, but not anonymous.
- Public facing SET reports include summarized student responses.
- Private Instructor-Course reports include the same data as the public-facing reports, with student open-ended comments and personalized question results included.
- Students may be identifiable if they include personal information in the open-ended comment section.
What should I do if a student asks me to reopen a closed survey?
Instructors, and only instructors, have the discretion to extend their survey. Adjusting the timing of the survey close date / time may be completed on the Subject Management page. How long to extend your survey is a personal choice, however surveys must be closed before final grades are submitted and cannot extend beyond the last day of finals. Use the directions for the Subject Management activity here to extend your survey.
How do I know if my students are completing the SET survey? How can I view my response rate?
Checking response rates throughout the life of the survey allows you to determine if additional communication with students regarding SETs is warranted. This is especially important if your survey is open a limited number of days or hours.
From the Blue legacy page, click on the 
icon to access course cards.
If you wish to check or update the timing of the survey, please click on “Manage….” in each course card where adjustments are desired.
Alternatively, the MyAU portal has a continuously updated Response Rate Report for each term. All course sections scheduled to receive a SET survey are listed and response rates are updated throughout the semester.
My students aren’t completing their surveys, what can I do?
Survey feedback is most effective when the response rate is high. As a learning community, diverse student voices reflecting on academic experiences are instrumental to understanding if university, professional, and student goals are met. While students receive an automated email when the survey opens, in-class administration helps increase response rates and provides space for mindful feedback.
Students have a lot of distractions. It is highly encouraged to provide class time prior to finals for SET survey completion. Research confirms response rates increase with dedicated time in-class for SETs.
A SET in-class administration why and how presentation may be found here.
You may also wish to share this video resource with students prior to SET survey completion. Produced by UC Merced, in 3 minutes students and instructors discuss the importance of SETs and best practices for completion.
Coming soon: Additional resources for raising response rates.
SET REPORTING
What SET reports are published each term, and what do I do with them?
Standard SET reports are published at the end of each semester, after final grades are submitted. SET survey results are confidential. Results of closed-ended questions are made available to the AU community, while results for personalized questions and open-ended questions are available only to the faculty member. Please visit set.american.edu to view private Instructor-Course reports including student comments.
The SET office publishes a variety of reports summarizing SET responses to all questions presented.
Standard Semester Reports
Instructor-Course SET Report Public – This report summarizes a minimum of six responses and includes results for all closed-ended SET common questions. If you see your course report has an inactive link on the MyAU portal and the right side of the window says, "Not met," fewer than six students responded to the survey.
Instructor-Course SET Report Private – This report summarizes results for all closed-ended SET common questions, includes student comments, and the addition of Personalized and/or Department questions if included in the survey. This report generates with a minimum of one reponse.
Department Report – This report summarizes common questions by Department. No minimum response threshold is applied.
Instructor Semester Summary Report (FT only) - This report aggregates response data by the term, then broken out by course section. All common question responses are reported. Cross-listed course results are reported together. The response threshold for this report is six at the report, course and question level.
Administrative Reports:
Department Instructor Detail Report (FT only) - This report includes Department results for the two core SET questions highlighted above, "The professor required high levels of performance," and "I would recommend this professor to other students," and corresponding results by instructor in aggregate for the term. Report statistics match those on standard semester reports (see image above). Created exclusively for annual Merit reviews, these reports are published each semester.
Reappointment, Tenure, and Promotion SET report (FT only, multi-year reports) These reports are used exclusively for job actions and are not produced by Blue. These reports are unique, reporting across multiple semesters.
Report statistics are illustrated here:
What is the difference between public and private reports?
Public Instructor-Course and Department reports are published on the MyAU portal. These reports summarize the results of the common-closed ended questions. View a typical public Instructor-Course report here.
Private reports can be found on the Blue dashboard at set.american.edu. They include the common-closed ended questions, but also open-ended student comments, instructor personalized questions, and department questions if applicable. View a typical private Instructor-Course report here.
When will I see my reports? Why is my report missing?
Both the public and private Instructor-Course reports will be released within three weeks after the final grades are due. An email will alert faculty when the private SET report is available. All other standard SET reports will be distributed according to the schedule outlined below.
You will receive an email from Blue once the private reports are available with a live link to the specific report. All standard SET reports are available after final grades are due and may be found in the following locations:
|
|
Administrative SET reports |
||
|---|---|---|---|
|
|
|
|
|
Provided directly to Faculty Coordinators or school-specific equivalent |
|||
Still not able to find your report? Please contact the SET office at Faculty_SET@american.edu.
COMING SPRING 2024:
OIRAs current practice is to release all Instructor-Course reports after the end of the term. In the interest of providing instructors the opportunity for a timely review of SET data, SET Instructor-Course reports, both public and private, will be available three weeks after the end date of the specific course section.
How are SET results used?
At AU, SET data is analyzed and used in a variety of ways. The SET office reports to AU administration following guidelines codified by the Faculty Senate for merit, reappointment, promotion, and tenure decisions. SET data is used by students as they determine which courses to register for. Departments and schools also use SET data to find areas of celebration or refinement. Most importantly, instructors use their SET data to reflect on their practice and make instructional decisions. SET result analysis support for instructional improvement may be found through CTRL, found here.