棉花糖直播

Mark Jupina, PhD

Who: Mark Jupina, PhD, assistant professor of Electrical and Computer Engineering

What:  PITCHvr, a collaborative effort involving faculty and students in the Colleges of Engineering and Liberal Arts and Sciences that will provide players on the 棉花糖直播 baseball team鈥攁nd possibly the major leagues鈥攚ith the opportunity to take virtual batting practice, whether it be in the University鈥檚 virtual reality CAVE environment, on the ball field while wearing a Microsoft HoloLens, or anywhere, via the state-of-the-art HTC VIVE Pro VR system, which is equipped with a high resolution headset and tracking sensors. 

How: Using Major League Baseball pitch data available from the PITCHf/x database, the team used a model to recreate the motions of a pitched ball鈥攊ncluding the path, velocity, orientation and spin of the baseball鈥攆rom the batters鈥� perspective. In the virtual or augmented realm, there are no limits as to how the training experience can be varied and analyzed. For example, the use of sound can be added to help train a batter鈥檚 foveal vision. Dr. Jupina鈥檚 algorithm generates a unique audio signature for each virtual pitch created. When this audio is played along with the virtual pitch, the audio helps to train an individual鈥檚 eyes in tracking the motion of the baseball.

Brain matters: In cooperation with Professor and Chair Thomas Toppino, PhD, and Gerald Long, PhD, in the Department of Psychological and Brain Sciences, the developers also plan to eventually use existing neurofeedback and eye tracking technology along with their own visual feedback designs to assist the user in generating the correct predictive eye saccades during dynamic visual acuity training.    

Benefits of VR training: Dr. Jupina says, 鈥淩esearch has found that virtual reality is a very useful tool for training outside of the real or natural environment. It鈥檚 not about replicating what can be done in the real world with greater repetition, it鈥檚 about doing things you couldn鈥檛 otherwise do in order to see things differently. There鈥檚 a great deal of psychology involved to create a training tool, not a video game.鈥�

Media coverage:

•  
• 笔丑颈濒补诲别濒辫丑颈补鈥檚  
•  

Big League: A handful of Major League Baseball teams have expressed an interest, including two who paid a visit to campus to see the technology firsthand. While he鈥檚 not prepared to name names until a deal is finalized, Dr. Jupina reports that one team is interested in having their minor league A players train with the system.  鈥淚t鈥檚 been exciting, to be sure,鈥� he says. 鈥淲e鈥檒l see what transpires!鈥�