ASU Introduces Augmented Reality (AR) Programs for Science Courses

Developed for use with the Microsoft HoloLens 2 augmented reality/mixed reality headset, the new AR apps are being piloted using over 30 new headsets in sections of ASU’s freshman-level Principles of Biology course and junior-level Organic Chemistry course.

Dr. Paul Swets “These are both high-impact courses,” said Dr. Paul Swets, dean of the College of Science and Engineering. “There are a lot of students in these courses, and they are taken relatively early in critical degree programs. They are also high hurdles. There is more student attrition in these courses, and we are hoping the headsets and AR programs make it easier for students to learn and succeed.”

Several ASU faculty led by Dr. Greg Krukonis, associate professor of biology, and Dr. Saravanan Ramasamy, associate professor of chemistry, worked to adapt the chosen courses and integrate the new AR technology. The HoloLens 2 headsets feature fully articulated hand tracking, voice command capability, eye tracking, spatial mapping, a large field of view and mixed reality capture. Combined with the new AR apps and others available on the market, they allow ASU students to view and manipulate objects virtually, including:

• DNA, RNA and protein structures
• Human anatomy models
• Chemical compounds and bonding
• Atomic and cell structures

“The 3D imagery and interactive qualities of the headsets and programs are really impressive and also pivotal in helping students understand different scientific principles,” Swets said. “Being able to manipulate structures and compounds digitally and in real time is critical to modern students, who are digital learners and expect digital engagement.”

(L-R) Dr. Saravanan Ramasamy and Dr. Greg Krukonis demonstrating the HoloLens 2 headsets in the ASU President's Office Certain sections of the Principles of Biology and Organic Chemistry courses will use the headsets and AR apps, and some will not, giving the project leaders a good baseline for gauging their effectiveness, with student passing and retention rates as the primary criteria.

“There are not many schools implementing these types of headsets and the augmented reality programs,” Swets said. “We believe it will attract more students, be an enticement for students to learn more and spend more time on their studies, and also be an inducement for them to remain in these academic programs.”

The project is being funded through ASU’s five-year Hispanic Serving Institution-STEM Grant from the U.S. Department of Education. Groove Jones was chosen to partner on the project after an extensive review of creative technology companies. Its other clients range from institutions of higher education, like the University of Tennessee, and professional sports franchises, like the NHL’s Dallas Stars, to national agencies, like the American Heart Association, and major national brands, like 3M, Keebler, Target and Salesforce.

Trevor Backlin “We at Groove Jones are thrilled to partner with Angelo State University’s Chemistry and Biology departments to bring immersive, augmented reality experiences into the classroom,” said Trevor Backlin, senior executive. “This collaboration represents a unique opportunity to transform student engagement and learning outcomes by allowing students to interact with complex scientific concepts in 3D. This is also just the beginning; as the potential of this technology continues to grow and improve, we look forward to exploring new ways to enhance learning experiences. Through this innovative approach, we hope to support ASU in fostering a deeper understanding and passion for science among students, ultimately driving positive educational results.”

The collaborative project is also prominently displayed on the Groove Jones website.

ASU project leaders will track the status and results for the two pilot courses over the next two years to determine the project’s success and sustainability.

“Obviously, we are all hoping that these new teaching technologies will bring positive results, and that we will effectively engage more students,” Swets said. “That could certainly mean that we need to introduce the headsets and programs to additional courses in the future.”

Expanding the use of HoloLens 2 headsets into other courses could also open up possibilities to involve ASU computer science students and faculty in developing the new AR apps to go with them. ASU also retains proprietary and licensing rights for the new biology and chemistry apps.