CV Versi LN

CURRICULUM VITAEJeremy R. Cooperstock

Contents

Background 2Personal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2Education . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2Awards and Distinctions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2

Work Experience 3Academic Experience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3Industrial and Consulting Experience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4

Research 5Publications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5Non-refereed Contributions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15Public Awareness . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16Supervision . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 24Active Collaborations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30Funding Awarded . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 31

Teaching 35Courses Taught . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35Undergraduate Supervision . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36

Service 38University Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38Professional Activities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 39

CURRICULUM VITAEJeremy R. Cooperstock

Background

Personal

Nationality Canadian

Languages English, French and Hebrew

Address Department of Electrical and Computer EngineeringMcGill University3480 University Street, Montreal, QC, H3A 2A7, Canada

Telephone (514) 398-5992

email [email protected]

Education

Ph.D. Electrical and Computer Engineering, University of Toronto, 1996.Thesis: “Reactive Environments and Augmented Media Spaces.”(Nominated for NSERC Doctoral Dissertation Award)Advisors: Prof. K.C. Smith and Prof. W. Buxton

M.Sc. Computer Science, University of Toronto, 1992.Thesis: “Neural Network Operated Vision-Guided Mobile Robot Armfor Docking and Reaching.”Advisor: Prof. E. Milios.

B.Ap.Sc. Electrical Engineering, Computer Engineering Option, University ofBritish Columbia, 1990 (Honours)

Awards and Distinctions

2009 Nominee, NSERC Brockhouse Canada Prize for Interdisciplinary Re-search in Science and Engineering Award

2005 ACM/IEEE Supercomputing, International Conference for High Per-formance Computing, Networking, Storage and Analysis, Award forMost Innovative Use of New Technology

2001 Audio Engineering Society Distinction Award2000 ExCESS award for Best Technological Innovator, ECE department,

McGill University1999 Petro-Canada Young Innovator Award1996 Departmental Selection for NSERC Doctoral Dissertation Award, Uni-

versity of Toronto1995 Information Technology Research Center of Ontario (now CITO), In-

novation Award for Increasing Awareness in Leading Edge Technology

2

WORK EXPERIENCE

Work Experience

Academic Experience

May–June2009

Bang & Olufsen, DenmarkVisiting Professor, World Opera Project

Jan 2009 –present

Bielefeld University, GermanyVirtual Member, Center of Excellence Cognitive Interaction Technology(CITEC)

June 2003 –present

McGill University, Montreal, QCAssociate Professor, Electrical and Computer Engineering.Supervising 5 research associates, 4 post-doctoral fellows, 4 Ph.D. stu-dents, 3 M.Eng. students

Sep. 2004 –Aug. 2005

Universite de Paris VI, Paris FranceInvited Professor, Laboratoire des Instruments et Systemes d’Ile-de-France

Apr. 2000 –present

McGill University, Montreal, QCAssociate Member, Faculty of Music, Department of Theory.Founding member of the Centre for Interdisciplinary Research in MusicMedia and Technology. Actively participated in preparation of the CFIand VRQ grant applications that brought in a total $8.7M. Developedtechnology for use in distance music teaching trials. Advised the facultyon networks issues for the new Music building. Served on three thesiscommittees.

Nov. 1997 –May 2003

McGill University, Montreal, QCAssistant Professor, Electrical and Computer Engineering.Supervised 6 M.Eng. students and 3 research staff. Instructed courses inhuman-computer interaction, artificial intelligence, operating systems,and supervised the computer architecture laboratory. Conducted origi-nal research in the areas of high-bandwidth communication, augmentedreality, and intelligent environments. Developed the technology behindthe “Intelligent Classrooms” and maintained these rooms since their de-ployment. Served on nine thesis committees and numerous departmentand university committees.

3

Industrial and Consulting Experience WORK EXPERIENCE

Industrial and Consulting Experience

May – Nov.2007

Boucher HarperAnalysis and expert testimony in intellectual property case (software-related)

Feb. – Oct.2004

Crawford Adjusters CanadaAnalysis of artifacts in high definition video

May 2002 –Nov. 2003

Solicitor General of CanadaMedia streaming configuration and user interface design.

May 2001 National Research CouncilInstructor of short course in Soft Computing, Institut des MateriauxIndustriels.

Jan. – Sep.1999

Audio Engineering SocietyTechnical leader of a demonstration of multichannel and multimediaaudio distribution, sponsored by the Audio Engineering Society’s Tech-nical Committee for Network Audio Systems

Jan. – Aug.1999

Ontario Science CenterScientific Director of Timescape Millenium Exhibit

July 1998 NortelInstructor of short course in videoconferencing systems for the NortelInternational SL-1 User’s Association (ISLUA), Long Beach

Sep. 1996 –Oct. 1997

Sony Computer Science LaboratoryVisiting Researcher at the Sony Computer Science Laboratory, Tokyo,Japan.Developed speech-interface controlled VCR with visual tape databasefunctionality. Wrote two patent applications, one filed. Supervised aresearch intern.

June – Aug.1990

Fibronics ResearchVisiting Researcher at the Fibronics Advanced Research Center, Haifa,Israel.Developed and tested an FDDI-to-token ring bridge, reverse engineer-ing the control protocol used for a LAN manager.

May – Aug.1989

IBM T.J. Watson Research CenterResearch Intern at the IBM T.J. Watson Research Center, YorktownHeights, NY.Developed a VLIW architecture simulator.

4

RESEARCH

Research

Publications

Note that in the following listings, authors whose names are underlined were under my supervisionat the time of writing.

Book Chapters

B1 Wozniewski, M. Settel, Z., and Cooperstock, J.R. (2011, to appear). Sonic Interaction viaSpatial Arrangement in Mixed Reality Environments. Sonic Interaction Design, K. Franinovicand S. Serafin, eds. MIT Press.

B2 Cooperstock, J.R. (2008). Human-Computer Interaction. Chapter in Wiley Encyclopedia ofComputer Science and Engineering, ISBN 978-0-471-38393-2, Benjamin W. Wah, ed., Vol. 3,1529-1542.

Journal Articles

J1 Blum, J., Olmos, A., Sun, H. and Cooperstock, J.R. (in review: TOMCCAP-2010-0144) End-User Viewpoint Control of Live Video from a Medical Camera Array. ACM Transactions onMultimedia

J2 Giordano, B.L, Visell, Y., Yao, H.-Y., Hayward, V., Cooperstock, J.R., and McAdams, S.(in review: MS 10-09611). Audiohaptic identification of ground materials while walking.Acoustical Society of America.

J3 Olmos, A., Bouillot, N., Knight, T., Mabire, N. and Cooperstock, J.R. (in review) Open Or-chestra: a high-fidelity orchestra simulator, Computer Music Journal.

J4 Qi, Z. and Cooperstock, J.R. (in review: TIP-06954-2010). Towards Dynamic Image MosaicGeneration With Robustness to Parallax. IEEE Transactions on Image Processing.

J5 Dansereau, D., Brock, N., and Cooperstock, J.R. (in review: MM-003442). A Particle Filterfor Predicting an Orchestral Conductor’s Baton Movements. IEEE Transactions on Multime-dia

J6 Pelletier, S. and Cooperstock, J.R. (in review: TIP-06592-2010). Preconditioning for Edge-Preserving Image Super-Resolution, IEEE Transactions on Image Processing.

J7 To, L., Thompson, B., Blum, J.R., Maehara, G., Hess, R., and Cooperstock, J.R. (in review:TNSRE-2010-00139) A game platform for treatment of amblyopia, IEEE Transactions onNeural Systems and Rehabilitation Engineering

J8 Benovoy, M., Salimpoor, V.N., Longo, G., Zatorre, R.J., and Cooperstock, J.R. (in review:TAFFC-2010-07-0053). Pleasurable Affective State Recognition Using Non-Linear FeatureTransformation, IEEE Transactions on Affective Computing

5

Publications RESEARCH

J9 Bouillot, N. and Cooperstock, J.R. (in review: TOMCCAP-2010-0134) Quality of Experience-Based Evaluation of Distributed Mobile Audio Applications. ACM Transactions on Multime-dia

J10 Benovoy, M., Cooperstock, J.R., Xiao, Q., and Levine, M. (in review: TIP-06385-2010), Real-Time Multiple Video Face Recognition Using Adaptive Probe Update, IEEE Transactions onImage Processing.

J11 Cooperstock, J.R. (2011). Multimodal Telepresence Systems: Supporting Demanding Col-laborative Human Activities, IEEE Signal Processing Magazine, special issue on ImmersiveCommunications, 28(1), 77-86.

J12 Pellerin, R., Bouillot, N., Pietkiewicz, T., Wozniewski, M., Settel, Z., Gressier-Soudan E., andCooperstock, J.R. (2010). SoundPark: Exploring Ubiquitous Computing through a MixedReality Multi-player Game Experiment, Studia Informatica Universalis, 8(3), Hermann, 21pages.

J13 Bouillot, N., Cohen, E., Cooperstock, J.R., Floros, A., Fonseca, N., Foss, R., Goodman, M.,Grant, J., Gross, K., Harris, S., Harshbarger, B., Heyraud, J., Jonsson, L., Narus, J., Page, M.,Snook, T., Tanaka, A., Trieger, J. Zanghieri, U. (2009). AES White Paper AESTD1003V1:Best Practices in Network Audio, Jeremy R. Cooperstock, ed., Audio Engineering Society57(9), September, 729-741.

J14 Visell, Y., Law, A. and Cooperstock, J.R. (2009). Touch Is Everywhere: Floor Surfaces asAmbient Haptic Interfaces, IEEE Transactions on Haptics, 2(3), July–September, 148–159.

J15 Salimpoor, V., Benovoy, M., Longo, G., Cooperstock, J.R., and Zatorre, R.J. (2009). TheRewarding Aspects of Music Listening are Related to Degree of Emotional Arousal, PLoSONE, 4(10): e7487, June, doi:10.1371/journal.pone.0007487.

J16 Sun, W. and Cooperstock, J.R. (2006). Don’t Count Your Pixels Until They’re Calibrated:An Empirical Evaluation of Factors Influencing Camera Calibration Accuracy, Machine Visionand Applications Journal, 17(1), 51–67, February.

J17 Woszczyk, W., Cooperstock, J., Roston, J., Martens, W. (2005). Shake, Rattle, and Roll:Getting Immersed in Multisensory, Interactive Music via Broadband Networks, Audio Engi-neering Society, 53(4), April, 336–344.

J18 Yin, J. and Cooperstock, J.R. (2004). Color Correction Methods with Applications to DigitalProjection Environments. Winter School of Computer Graphics, 12, No. 3, 499–506.

J19 Winer, L. and Cooperstock, J.R. (2002). The “Intelligent Classroom”: Changing teaching andlearning with an evolving technological environment. Computers and Education, 38, 253–266.

J20 Xu, A., Woszczyk, W., Settel, Z., Pennycook, B., Rowe, R., Galanter, P., Bary, J., Martin,G., Corey, J., and Cooperstock, J.R. (2000). Real-Time Streaming of Multichannel AudioData over Internet. Audio Engineering Society, 48(7/8), July-August, 627–641.

6


J21 Cooperstock, J.R., Fels, S.S., Buxton, W. and Smith, K.C. (1997). Reactive Environments:Throwing Away Your Keyboard and Mouse. Communications of the ACM, 40(9), 65–73.

J22 Cooperstock, J.R. and Milios, E. (1993). Self-supervised learning for docking and targetreaching. Robotics and Autonomous Systems, 11, 243–260.

Refereed Conference Publications

C1 Dorado, I.G. and Cooperstock, J.R. (in review: paper 688) Automatic multi-projector cali-bration with an uncalibrated camera, CVPR.

C2 Olmos, A., Lachapelle, K., and Cooperstock, J.R. (2010) Multiple Angle Viewer for RemoteMedical Training. Second ACM International Workshop on Multimedia Technologies for Dis-tance Leaning, October 25-29, Florence, Italy.

C3 Ellaway, R., Cooperstock, J.R., and Spencer, B. (2010) Simulation Integration for HealthcareEducation, Training and Assessment. Fifth International Conference on Digital InformationManagement, July 5-8, Thunder Bay, ON.

C4 Rajalingham, R., Visell, Y. and Cooperstock, J.R. (2010) Probabilistic Tracking of PedestrianMovements via In-Floor Force Sensing. Seventh Canadian Conference on Computer and RobotVision, May 31-June 2, Ottawa, ON.

C5 Benovoy, M. and Cooperstock, J.R. (2010) Psychophysiological signal analysis and classifica-tion. CHI 2010 Brain Body and Bytes Workshop, April 10-15, Atlanta, GA.

C6 Visell, Y. and Cooperstock, J.R. (2010). Optimized Design of a Vibrotactile Device via aRigid Surface. IEEE Haptics Symposium, March 25-26, Waltham, MA. Best Paper Award

C7 Visell, Y., Law, A., Ip, J., Smith, S. and Cooperstock, J.R. (2010). Interaction Capture inImmersive Virtual Environments via an Intelligent Floor Surface, IEEE Virtual Reality, March20-24, Waltham, MA.

C8 Visell, Y., Smith, S., Law, A., Rajalingham, R. and Cooperstock, J.R. (2010). Contact Sens-ing and Interaction Techniques for a Distributed, Multimodal Floor Display, IEEE 3D UserInterfaces, March 20-21, Waltham, MA.

C9 Olmos, A, Brule, M., Bouillot, N., Benovoy, M., Blum, J., Sun, H., Lund, N.W., and Coop-erstock, J.R. (2009). Exploring the role of latency and orchestra placement on the networkedperformance of a distributed opera, 12th Annual International Workshop on Presence, LosAngeles, Nov. 11–13.

C10 Bouillot, N., Brule, M., and Cooperstock, J.R. (2009). Performance metrics for network au-dio systems: Methodology and a preliminary comparison. Audio Engineering Society 127thConvention, New York, Oct. 9–12.

C11 Anlauff, J., Hermann, T., Grosshauser, T., and Cooperstock, J.R. (2009). Modular tacTilesfor Sonic Interactions with Smart Environments, Haptic and Audio Interaction Design, Dres-den, Germany, September 10–11.

7


C12 Berard, F., Ip, J., Benovoy, M., El-Shimy, D., Blum, J. and Cooperstock, J.R. (2009). DidMinority Report Get it Wrong? Superiority of the Mouse over 3D Input Devices for a 3DPlacement Task, IFIP TC13 Conference in Human-Computer Interaction (INTERACT), Up-psala, Sweden, August 24–28.

C13 Settel, Z., Wozniewski, M., Bouillot, N. and Cooperstock, J.R. (2009). Audio Graffiti: Alocation based audio-tagging and remixing environment, International Computer Music Con-ference, Montreal, Aug. 16–21.

C14 Law, A., Ip, J., Peck, B. Visell, Y., Kry, P., and Cooperstock, J.R. (2009). Multimodal floorfor immersive environments, ACM SIGGRAPH Emerging Technologies, New Orleans, August3–7.

C15 Pellerin, R., Bouillot, N., Pietkiewicz, T., Wozniewski, M., Settel, Z., Gressier-Soudan E., andCooperstock, J.R. (2009). SoundPark: Exploring Ubiquitous Computing through a Mixed Re-ality Multi-player Game Experiment, 9e Conference Internationale sur Les Nouvelles Tech-nologies de la Repartition (NOTERE), Montreal, June 29–July 3.

C16 Pellerin, R., Bouillot, N., Pietkiewicz, T., Wozniewski, M., Settel, Z., Gressier-Soudan E.,and Cooperstock, J.R. (2009). SoundPark: Towards Highly Collaborative Game Supportin a Ubiquitous Computing Architecture, 9th IFIP International Conference on DistributedApplications and Interoperable Systems, Lisbon, Portugal, June 9–12.

C17 Bouillot, N. and Cooperstock, J.R. (2009) Challenges and Performance of High-Fidelity Au-dio Streaming for Interactive Performances, New Interfaces for Musical Expression (NIME),Pittsburgh, June 4–6.

C18 Visell, Y., Law, A.W., and Cooperstock, J.R. (2009). Toward Iconic Vibrotactile InformationDisplay Using Floor Surfaces, Third Joint Eurohaptics Conference and Symposium on HapticInterfaces for Virtual Environment and Teleoperator Systems, Salt Lake City, UT, March18–20.

C19 El-Shimy, D., Marentakis, G., and Cooperstock, J.R. (2009) Multimodal Feedback in 3DTarget Acquisition, IEEE 3D User Interfaces, Lafayette, Louisiana, March 14–15.

C20 Ellaway, R.H., Topps, D., Lachapelle, K., and Cooperstock, J.R. (2009) Integrating Simu-lation Devices and Systems. Medicine Meets Virtual Reality (MMVR) Medical EducationConference, Long Beach, Jan. 19–22.

C21 Wang, G., Mercier, L, Collins, D.L, and Cooperstock, J.R. (2009). A Comparative Study ofMonoscopic and Stereoscopic Display for a Probe-Positioning Task. Medicine Meets VirtualReality (MMVR) Medical Education Conference, Long Beach, Jan. 19–22.

C22 Cooperstock, J.R. and Wang, G. (2009). Stereoscopic Display Technologies, Interaction Paradigms,and Rendering Approaches for Neurosurgical Visualization. Stereoscopic Displays and Appli-cations, San Jose, Jan. 18–22.

8


C23 Qi, Z. and Cooperstock, J.R. (2008). Depth-based Image Mosaicing for Both Static andDynamic Scenes. International Conference on Pattern Recognition (ICPR), Tampa, Dec.8–11.

C24 Law, A.W., Peck, B.V., Visell, Y., Kry, P., and Cooperstock, J.R. (2008) A Multi-modalFloor-space for Experiencing Material Deformation Underfoot in Virtual Reality. IEEE In-ternational Workshop on Haptic Audio Visual Environments and Games, Ottawa, October18–19.

C25 Benovoy, M., Zadel, M., Absar, R., Wozniewski, M., and Cooperstock, J.R. (2008). Towardsimmersive multimodal gameplay. GAMEON-NA, Montreal, Aug. 13–15.

C26 Pelletier, S. and Cooperstock, J.R. (2008). Fast image restoration with the Huber-Markovprior model, International Conference on Image Processing, San Diego, Oct. 12–15.

C27 Cupellini, E., Rizzuti, C., Bilotta, E., Pantano, P., Wozniewski, M., and Cooperstock, J.R.(2008). Exploring Musical Mappings and Generating Accompaniment with Chaotic Systems,International Computer Music Conference, Belfast, Aug. 24–29.

C28 Giordano, B.L, McAdams, S., Visell, Y., Cooperstock, J.R., Yao, H.-Y., and Hayward, V.(2008). Non-visual identification of walking grounds. Acoustics’08, Paris, June 29–July 4.

C29 Salimpoor V.N., Benovoy M., Longo G., Cooperstock J.R., and Zatorre R.J. (2008). Mu-sic and the Reward System: Characterizing Intensely Pleasurable Responses to Music, TheNeurosciences and Music – III, Montreal, June 26–28.

C30 Visell, Y., Giordano, B., Cooperstock, J.R., Franinovic, K., Law, A., McAdams, S., Jathal, K.,and Fontana, F. (2008). A Vibrotactile Device for Display of Virtual Ground Materials inWalking, EuroHaptics, Madrid, Spain, June 11–13.

C31 Bouillot, N., Wozniewski, M., Settel, Z., and Cooperstock, J.R. (2008). A Mobile WirelessPlatform for Augmented Instruments, New Interfaces for Musical Expression (NIME), June5–7, Genova, Italy.

C32 Wozniewski, M., Bouillot, N., Settel, Z., and Cooperstock, J.R. (2008). Large-Scale MobileAudio Environments for Collaborative Musical Interaction, New Interfaces for Musical Ex-pression (NIME), June 5–7, Genova, Italy.

C33 Wozniewski, M., Bouillot, N., Settel, Z., and Cooperstock, J.R. (2008). An Augmented Real-ity Framework for Wireless Mobile Performance, Mobile Music Workshop, May 13–15, Vienna,Austria.

C34 Benovoy, M., Deitcher, J., and Cooperstock, J.R. (2008). Biosignals Analysis and its Appli-cation in a Performance Setting: Towards the development of an Emotional-Imaging Genera-tor, IEEE International Conference on Bio-Inspired Systems and Signal Processing (BIOSIG-NALS), Jan. 28–31, Madeira, Portugal.

9


C35 Visell, Y., Cooperstock, J.R., and Franinovic, K. (2007). Toward an Architectural Platformfor Audio-Haptic Simulation in Walking. Enactive Interfaces (ENACTIVE’07), Nov. 19–25,Grenoble, France.

C36 Visell, Y. and Cooperstock, J.R. (2007). Enabling Gestural Interaction by Means of TrackingDynamical Systems Models and Assistive Feedback. IEEE Systems, Man and Cybernetics,Montreal, Oct. 7–10.

C37 Qi, Z. and Cooperstock, J.R. (2007). Automated Change Detection in an Undersea Environ-ment using a Statistical Background Model. Oceans ’07, Vancouver, Sept. 29–Oct. 4.

C38 Pelletier, S. and Cooperstock, J.R. (2007). Fast super-resolution for rational magnificationfactors. International Conference on Image Processing (ICIP), San Antonio, TX, Sept. 16–19.

C39 Qi, Z. and Cooperstock, J.R. (2007). Overcoming Parallax and Sampling Density Issuesin Image Mosaicing of Non-Planar Scenes. British Machine Vision Conference (BMVC),Warwick, Sept. 10–13.

C40 Cooperstock, J.R., Wozniewski, M., Settel, Z. (2007). Towards mobile spatial audio for dis-tributed musical systems and multi-user virtual environments. Spatial Audio for Mobile De-vices, Workshop in conjunction with International Conference on Human Interaction withMobile Devices and Services (MobileHCI), Singapore, Sept. 9.

C41 Wozniewski, M., Settel, Z. Cooperstock, J.R. (2007). AudioScape: A Pure Data library formanagement of virtual environments and spatial audio. PureData Convention, Montreal,Aug. 21–26.

C42 Audet, S. and Cooperstock, J.R. (2007). Shadow Removal in Front Projection Environmentsusing Object Tracking, IEEE Projector-Camera Systems (ProCams), Minneapolis, June 18.

C43 Visell, Y. and Cooperstock, J.R. (2007). Modeling and Continuous Sonification of Affordancesfor Gesture-Based Interfaces. International Conference on Auditory Display, Montreal, June26–29.

C44 Wozniewski, M., Settel, Z. and Cooperstock, J.R. (2007). User-specific audio rendering andsteerable sound for distributed virtual environments. International Conference on AuditoryDisplay, Montreal, June 26–29.

C45 Kinoe, Y. and Cooperstock, J.R. (2007). Peripheral Telecommunications: Supporting Dis-tributed Awareness and Seamless Transitions to the Foreground. International ConferenceOn Smart homes and health Telematics, Nara, Japan, June 21–23.

C46 Arseneau, S. and Cooperstock, J.R. (2006). An Improved Representation of Junctions throughAsymmetric Tensor Diffusion. International Symposium on Visual Computing, Lake Tahoe,Nevada, Nov. 6–8.

C47 Wozniewski, M., Settel, Z. and Cooperstock, J.R. (2006). A Paradigm for Physical Interactionwith Sound in 3-D Audio Space. International Computer Music Conference, New Orleans,Nov. 6–11.

10


C48 Wozniewski, M., Settel, Z. and Cooperstock, J.R. (2006). A Spatial Interface for Audio andMusic Production. International Conference on Digital Audio Effects (DAFx), Montreal,Sept. 18–20.

C49 Pelletier, S. and Cooperstock, J.R. (2006). Preconditioning for temporal video superresolu-tion. British Machine Vision Conference (BMVC), Edinburgh, Sept. 4–7.

C50 Arseneau, S. and Cooperstock, J.R. (2006). An Asymmetrical Diffusion Framework for Junc-tion Analysis. British Machine Vision Conference (BMVC), Edinburgh, Sept. 4–7.

C51 Qi, Z. and Cooperstock, J.R. (2006). Wide-Baseline Image Mosaicing for Indoor Environ-ments, International Conference on Pattern Recognition (ICPR), Hong Kong, Aug. 20–24.

C52 Cayouette, F. and Cooperstock, J.R. (2006). Generic Real-Time Tracking Method on Semi-Dynamic Scenes. International Conference on Pattern Recognition (ICPR), Hong Kong, pp.711-714, Aug. 20–24.

C53 Rudzicz, F. (2006). Clavius: Bi-Directional Parsing for Generic Multimodal Interaction. JointConference of the International Committee on Computational Linguistics and the Associationfor Computational Linguistics (COLING/ACL-06 SRW), Sydney, Australia, July 17–21.

C54 Wozniewski, M., Settel, Z. and Cooperstock, J.R. (2006). A framework for immersive spatialaudio performance. New Interfaces for Musical Expression (NIME), Paris, June 5–7.

C55 Rudzicz, F. (2006). Put a Grammar Here: Bi-Directional Parsing in Multimodal Interac-tion. ACM Conference on Human Factors in Computing Systems (CHI) Work-in-progress,Montreal, April 22–27.

C56 Cooperstock, J.R. (2005). Interacting in Shared Reality. HCI International, Conference onHuman-Computer Interaction, Las Vegas, July 22–27.

C57 Yin, J. and Cooperstock, J.R. (2005) A New Photo Consistency Test for Voxel Coloring.Canadian Conference on Computer and Robot Vision, Victoria, May 9–11.

C58 Pelletier, S., Spackman, S. and Cooperstock, J.R. (2005). High-Resolution Video Synthesisfrom Mixed-Resolution Video Based on the Estimate-and-Correct Method. IEEE Workshopon Applications of Computer Vision (WACV), Breckenridge, January 5–7.

C59 Sun, W. and Cooperstock, J.R. (2005). Requirements for Camera Calibration: Must AccuracyCome with a High Price? IEEE Workshop on Applications of Computer Vision (WACV),Breckenridge, January 5–7.

C60 Boussemart, Y., Rioux, F., Rudzicz, F., Wozniewski, M. and Cooperstock, J.R. (2004). AFramework for Collaborative 3D Visualization and Manipulation in an Immersive Space usingan Untethered Bimanual Gestural Interface. ACM Virtual Reality Software and Technology,Hong Kong, November 10–12.

C61 Woszczyk, W., Cooperstock, J., Roston, J., Martens, W. (2004) Environment for immersivemulti-sensory communication of music using broadband networks. 23rd TonmeistertagungVDT International Audio Convention, Leipzig, November 5–8.

11


C62 Aube, F. and Shield, R. (2004). Modeling the Effect of Leadership on Crowd Flow Dynamics.International Conference on Cellular Automata for Research and Industry. Amsterdam, Oc-tober 25–27 (also appears in Lecture Notes in Computer Science, Springer-Verlag Heidlerberg,ISSN: 0302-9743, 601–611).

C63 Rioux, F., Rudzicz, F., and Wozniewski, M. (2004). The Modellers’ Apprentice – The Tool-glass Metaphor in an Immersive Environment. British HCI Group Annual Conference. Leeds,September 6–10.

C64 Usher, J., Cooperstock, J.R., and Woszczyk, W. (2004) A multi-filter approach to acousticecho cancellation for teleconferencing. 75th Meeting of the Acoustical Society of America, NewYork, May 24–28.

C65 Hilario, M. and Cooperstock, J.R. (2004). Occlusion Detection for Front-Projected InteractiveDisplays. Pervasive Computing Vienna, April 21–23 (also appears in Advances in PervasiveComputing, Austrian Computer Society, ISBN 3-85403-176-9).

C66 Yin, J. and Cooperstock, J.R. (2004). Improving Depth Maps by Nonlinear Diffusion. 12thInternational Conference on Computer Graphics, Visualization and Computer Vision, Plzen,February, pp. 305–311.

C67 Cooperstock, J.R. (2003). Intelligent Classrooms need Intelligent Interfaces: How to Build aHigh-Tech Teaching Environment that Teachers can use? American Society for EngineeringEducation, Nashville, June.

C68 Cohen, E., Cooperstock, J.R., Kyriakakis, C. (2002). The Challenges of Archiving NetworkedBased Multimedia Performances. Acoustical Society of America, Cancun, December.

C69 Yao, J. and Cooperstock, J.R. (2002). Arm Gesture Detection in a Classroom Environment.IEEE Workshop on Applications of Computer Vision (WACV), Orlando, December.

C70 Arseneau, S. and Cooperstock, J.R. (2002). Automated Feature Registration for RobustTracking Methods, IEEE International Conference on Pattern Recognition, Quebec City, Au-gust.

C71 Cooperstock, J.R. and Spackman, S. (2001). The Recording Studio that Spanned a Conti-nent. IEEE International Conference on Web Delivering of Music (WEDELMUSIC), Flo-rence, November, pp. 161–167.

C72 Arseneau, S., Sun, W., Zhao, C., and Cooperstock, J.R. (2000). Inter-layer Learning TowardsEmergent Cooperative Behavior. American Association of Artificial Intelligence 17th AnnualConference, Austin, Texas, pp. 3–8.

C73 Hochstein, L., Lerner, S., Clark, J.J and Cooperstock, J.R. (2000). Soccer-Swarm: A Graph-ical Framework for Soccer-Player Design. International Symposium on Robotics. Montreal,QC, pp. 108–113.

12


C74 Xu, A. and Cooperstock, J.R. (2000). Real Time Streaming of Multi-Channel Audio throughInternet. 108th Audio Engineering Society Convention, Paris, France. [14 pages in CD-ROMProceedings]

C75 Blatter, J. Cooperstock, J.R., and Harris, R. (1999). Designing Tools, Designing LearningOpportunities: Issues in Developing a CSCL System for the Technical Communication Class-room. Computer Supported Cooperative Learning, Stanford, CA, December.

C76 Arseneau, S. and Cooperstock, J.R. (1999). Presenter Tracking in a Classroom Environment.IEEE Industrial Electronics (IECON’99), Session on Cooperative Environments, Vol. 1, pp.145–148.

C77 Arseneau, S. and Cooperstock, J.R. (1999). Real-Time Image Segmentation for Action Recog-nition. IEEE Pacific Rim Conference on Communications, Computers and Signal Processing(PACRIM’99), Victoria, B.C., Canada, pp. 86–89.

C78 Cooperstock, J.R. (1997). Rethinking the Remote Control. HCI International, Conferenceon Human-Computer Interaction, San Francisco, pp. 116.

C79 Cooperstock, J.R. (1997). From the Flashing 12:00 to a Usable Machine: Applying UbiCompto the VCR. ACM Conference on Human Factors in Computing Systems (CHI), Atlanta, pp.281–282.

C80 Yamaashi, K, Cooperstock, J.R., Narine, T., and Buxton, W. (1996). Beating the Limitationsof Camera-Monitor Mediated Telepresence with Extra Eyes. ACM Conference on HumanFactors in Computing Systems (CHI), Vancouver, pp. 50–57.

C81 Cooperstock, J.R. and Kotsopoulos, S. (1996). Why Use a Fishing Line When You Have aNet? An Adaptive Multicast Data Distribution Protocol. USENIX. San Diego, pp. 343–352.

C82 Tsotsos, J.K., Dickinson, S., Jenkin, M., Milios, E., Jepson, A., Down, B., Amdur, E., Steven-son, S., Black, M., Metaxas, D., Cooperstock, J., Culhane, S., Nuflo, F., Verghese, G., Wai,W., Wilkes, D., and Ye, Y. (1995). The PLAYBOT Project. IJCAI Workshop on AI Appli-cations for Disabled People, Montreal.

C83 Cooperstock, J.R., Tanikoshi, K., Beirne, G., Narine, T., and Buxton, W. (1995). Evolutionof a Reactive Environment. ACM Human Factors in Computing Systems (CHI), Denver, pp.170–177.

C84 Cooperstock, J.R. (1995). Making the User Interface Disappear: The Reactive Room. IBMCenter for Advanced Studies (CASCON), Toronto, pp. 241–250.

C85 Gujar, A., Daya, S., Cooperstock, J.R., Tanikoshi, K., and Buxton, W. (1995). Talking YourWay Around a Conference: A speech interface for remote equipment control, IBM Center forAdvanced Studies (CASCON), Toronto, pp. 289.

C86 Cooperstock, J.R., Tanikoshi, K., and Buxton, W. (1995). Turning Your Video Monitor intoa Virtual Window. IEEE Pacific Rim Conference on Communications, Computers, Visual-ization and Signal Processing (PACRIM), Victoria, May 17–19.

13


C87 Cooperstock, J.R. and Kotsopoulos, S. (1995). Exploiting Group Communications for Re-liable High Volume Data Distribution. IEEE Pacific Rim Conference on Communications,Computers, Visualization and Signal Processing (PACRIM), Victoria, May 17–19.

C88 Chou, A., Cooperstock, J.R., El-Yaniv, R., Klugerman, M., and Leighton, T. (1995). TheStatistical Adversary Allows Optimal Money-Making Trading Strategies. ACM-SIAM Sym-posium on Discrete Algorithms (SODA), pp. 467–476.

C89 Cooperstock, J.R. and Milios, E. (1993). An Efficiently Trainable Neural Network BasedVision-Guided Robot Arm. IEEE Robotics and Automation, Atlanta, Vol. 2, pp. 738–743.

C90 Cooperstock, J.R. and Milios, E. (1993). Self-Supervised Learning for Docking and TargetReaching. Intelligent Autonomous Systems, Pittsburgh, pp. 582–591.

C91 Cooperstock, J.R. and Milios, E. (1992). Adaptive Neural Networks for Vision-Guided Posi-tion Control of a Robot Arm. IEEE Intelligent Control, Glasgow, pp. 397–403.

C92 Cooperstock, J.R. and Milios, E. (1992). Neural Network Control for a Vision-Guided MobileRobot Arm. IASTED Control and Robotics, Vancouver pp. 278–281.

Patents

P1 Floor-based haptic communication system. Cooperstock, J.R., Visell, Y., Law, A., and Frani-novic, K. United States Provisional Patent Application Number US 61/184015 submitted onJune 4, 2009, US Patent Application Number 12/794,045 filed June 4, 2010.

P2 Binocular vision assessment and/or therapy. Cooperstock, J.R., To, L., and Hess, R. UnitedStates Patent Application 12/772,162, filed April 30, 2010.

P3 Remote Sign Language Interpretation. Roston, J., Cooperstock, J.R., MacDougall, J., andSpackman, S., Report of Invention submitted to Office of Technology Transfer, McGill Uni-versity, February 2003; US patent 7395200 subsequently issued to Roston J.

P4 Method and Apparatus for Coding Spatial Data. Cooperstock, J.R., Zhang, Y., and Spackman, S.Provisional patent application filed Dec. 17, 2001 (subsequently abandoned)

P5 High-resolution Video Synthesis. Canadian patent application 2,435,791 filed July 24, 2003.Spackman, S., Pelletier, S., and Cooperstock, J.R. (subsequently abandoned)

P6 A robust person tracking method and system. U.S. Provisional patent application filed Sept.20, 2000. Cooperstock, J.R. and Arseneau, S.

P7 Universal Remote Control. (Orientation-sensitive control with speech recognition). Patentapplication submitted by Sony Corp., Japan. Cooperstock, J.R.

P8 Pixel Count-Sensitive PDA Tool Mechanism with Cut/Paste and/or Copy/Paste Function.P09-022797. Patent filed in Japan by Sony Corp., Japan. Feb. 5, 1997. Cooperstock, J.R.

14

Non-refereed Contributions RESEARCH

Other Refereed Contributions

O1 Visell, Y., Millet, G. and Cooperstock, J.R. (2010). Haptic Display via a Vibrating, RigidSurface, Demonstration in IEEE Haptics Symposium, March 25-26, Waltham, MA.

O2 Law, A. Ip, J., Peck, B., Visell, Y., Kry, P. and Cooperstock, J.R. (2009). A MultimodalFloor for Virtual Environments, SIGGRAPH Emerging Technologies, Aug. 3–7.

O3 Salimpoor, V.N., Benovoy, M., Longo, G., Larcher, K., Dagher, A., Cooperstock, J.R., andZatorre, R.J. (2009). The Rewarding Aspects of Music Listening Involve the DopaminergicStriatal Reward Systems of the Brain: An Investigation with [C11]Raclopride PET and fMRI,Poster presentation in 15th Annual Meeting of the Organization for Human Brain Mapping,San Francisco, June, 18–23.

O4 Salimpoor V.N., Benovoy M., Longo G., Cooperstock, J.R., and Zatorre R.J. (2008) Qualify-ing the Chills Response: Differences between Transient and Prolonged Chills in Response toMusic. Auditory Perception, Cognition, and Action Meeting, Chicago.

O5 Wozniewski, M., Settel, Z. and Cooperstock, J.R. (2007). Menagerie Imaginaire. ArtworkPerformance in New Interfaces for Musical Expression (NIME), New York, June 6–10.

O6 Cooperstock, J.R. (2005). Novel Video Encoding Algorithms for Remote Monitoring and Dis-tributed Human-Human Interaction. 8th International Symposium on Artificial Intelligence,Robotics and Automation in Space, Munich, September 5–8.

O7 Cote C., Arseneau, S. and Cooperstock, J.R. (2001). Telepresence with no Strings Attached:An Architecture for a Shared Reality Environment. International Symposium on Mixed Re-ality, Yokohama, March.

O8 Winer, L.R. and Cooperstock, J.R. (2001). The “Intelligent Classroom”: Changing teachingand learning with an evolving technological environment. Computers and Learning, Coventry,UK, April.

O9 Arseneau, S. and Cooperstock, J.R. (2000). Automated Camera Tracking in a Real-WorldEnvironment. Graphics Interface, Montreal.

O10 Saroyan, A., Harris, R., and Cooperstock, J. (2000). Applying pedagogical principles toteaching and learning with technology. Multi-cultural perspectives on the use of technology ineducation, Montreal. http://www.education.mcgill.ca/NAFTA

Non-refereed Contributions

N1 Benovoy, M., Cooperstock, J.R., and Levine, M. (2010) Real-Time Facial Recognition. PhaseII Project Report for Department of National Defence.

N2 Levine, M., Cooperstock, J.R., and Benovoy, M. (2009) An Automatic Real-Time FacialRecognition System. Phase I Project Report for Department of National Defence.

15

http://www.education.mcgill.ca/NAFTA

Public Awareness RESEARCH

N3 Roston, J., Bradley, C., and Cooperstock, J.R. (2007) Underwater Window: High DefinitionVideo on VENUS and NEPTUNE. Oceans 2007, Vancouver, Sept. 29–Oct. 4. (Invited.)

N4 Cooperstock, J.R. (2006). Plus de largeur du bande, s’il vous plaıt. Oral presentation insession on L’interdiscplinarite dans les sciences et technologies de la musique. Associationfrancophone pour le savoir (ACFAS), Montreal, May 17.

N5 Cooperstock, J.R. (2005). Integrating Communication with Interaction: Computer VisionChallenges for Interactive and Intelligent Environments. Workshop on Computer Vision forInteractive and Intelligent Environments (CV4IIE), Lexington, KY, November 17–18. (In-vited.)

N6 Cooperstock, J.R., Roston, J., Woszczyk (2004). Broadband Networked Audio: Entering theEra of Multisensory Data Distribution. 18th International Congress on Acoustics, Kyoto,April 4–9. (Invited.)

N7 Cayouette, F., Sud, D., Patel, K., Sarikaya, D., and Cooperstock, J.R. (2002). McGill Red-dogs RoboCup 2002 Final Report.

N8 Cooperstock, J.R., (2001). Classroom of the Future: Enhancing Education through Aug-mented Reality. HCI International, Conference on Human-Computer Interaction, New Or-leans. (Invited.)

N9 Sud, D., Cayouette, F., Gu, J., and Cooperstock, J.R. (2001). McGill Reddogs RoboCup 2001Final Report.

Public Awareness

Research Demonstrations

D1 Distributed Musical Practice and Performance, I Medici di McGill, Oscar Peterson Hall,Montreal, April 28, 2008.

D2 Wide Screen Window on the World: Life Size HD Videoconferencing. Supercomputing 2005,Bandwidth Challenge, Seattle, November 16, 2005.

D3 Streaming DSD Audio comes to the AES. Audio Engineering Society 117th Convention, SanFrancisco, October 31, 2004.

D4 Cross-continental low-latency ultra-videoconferencing. McGill-Stanford jazz jam, June 13,2002.

D5 Remote master’s class using SDI video and multichannel audio. McGill-National ResearchCouncil session with Pinchas Zukerman, March 25, 2002.

D6 SDI video and multichannel audio. CANARIE’s 7th Advanced Networks Workshop, Toronto,November 28, 2001.

16


D7 Low-latency distributed violin duet in full-frame video. RISQ 2001 Conference, Montreal,November 5, 2001.

The Globe and Mail noted that “Cooperstock’s demonstration was a watershed event forthe elite club of the world’s computer network engineers. No one had ever before been ableto demonstrate that, under the right conditions, it is possible for natural, normal humaninteraction to occur over the Internet.”

D8 The Recording Studio that Spans a Continent. Audio Engineering Society 109th Convention,Los Angeles, September 23, 2000.

The Audio Engineering Society noted that this “Landmark demonstration shows cost effec-tive and high performance transmission systems for high quality 24-bit, 96kHz uncompressedmulitchannel audio are on horizon”

D9 Dolby Digital 5.1 audio with MPEG-2 video around the world. Internet Global Summit INET2000 Conference, Yokohama, July 20, 2000.

CBC Radio noted that “McGill University in Montreal has made Internet history by settingup the first intercontinental netcast of a live concert in surround sound and full-screen video.”

D10 Dolby Digital 5.1 audio with MPEG-2 video. CANARIE’s 5th Advanced Networks Workshop,Toronto, November 29, 1999.

D11 First real-time Multichannel Audio Internet demo. Audio Engineering Society 107th Conven-tion, New York, September 26, 1999.

The Learning Technologies Networked noted that “The performance marked the first real timemultichannel audio Internet transmission, a feat made possible by software developed at McGillUniversity by a team under the leadership of Professor Jeremy Cooperstock.”

Invited Talks

T1 “Around the World in 80 ms.” Panel presentation in Workshop of the Audio EngineeringSociety Convention, San Francisco, November 5, 2010.

T2 “UltraVideo and Virtual Presence: A Video Perspective.” Presentation on Teaching in Dis-tributed Performance, Tromsø, Norway, October 15, 2010.

T3 “Future Interfaces for Audio.” Panel presentation in Workshop of the Audio EngineeringSociety Convention, New York, October 10, 2009.

T4 “World Opera Technologies and Tests”, Danish Sound Technology Network, Aalborg Univer-sity, June 8, 2009.

T5 “This is your brain on Shared Reality: Toward perceptually convincing computed-mediatedenvironments”, Simula Lab, Oslo, May 15, 2009.

T6 “The Montreal World Opera Experiments”. Presentation at the World Opera Symposium,Struer, Denmark, May 12, 2009.

17


T7 “Audio-Visual-Haptic-Tactile: Putting them all together for an engaging immersive experi-ence”. Panel presentation in Workshop of the Audio Engineering Society Convention, Munich,Germany, May 10, 2009.

T8 “New Technologies for Audio over IP”. Panel presentation in Workshop of the Audio Engi-neering Society Convention, Munich, Germany, May 10, 2009.

T9 “This is your brain on Shared Reality: Toward perceptually convincing computed-mediatedenvironments”, Ambient Intelligence Group, CITEC, Bielefeld University, May 6, 2009.

T10 “Distributed and Multimodal Interaction in Virtual and Augmented Reality Environments”,McGill University, School of Physical and Occupational Therapy, November 25, 2008.

T11 “A Platform to Create and Support Ocean Science Virtual Organizations (Oceans 2.0)” and“HSVO Health Services Virtual Organization”, RISQ 2008 Colloquium, Montreal, November14, 2008.

T12 “Shared Reality: Effective Interaction for (Demanding) Distributed Tasks”, University ofVictoria, September 16, 2008.

T13 “The Future of VC: Music Teaching and High Fidelity Video”, Elevate 2008: Reaching NewHeights in Educational Video-conferencing, Banff, August 27–28, 2008.

T14 “Bidirectional video communication for real-time applications”, Institut fur Telematik, Uni-versity of Lubeck, Germany, May 15, 2008.

T15 “Shared Reality: Effective Interaction for (Demanding) Distributed Tasks”, Aalborg Univer-sity, Esbjerg, Denmark, May 14, 2008.

T16 “Distributed Multimodal Interaction”, Bang & Olufsen, Struer, Denmark, May 13, 2008.

T17 “Creating an immersive video space”, International Symposium on The World Opera: Whenthe Opera stage becomes worldwide, Tromsø, Norway, May 9, 2008.

T18 “Distributed Musical Practice and Performance”, Biology and Music Lecture, I Medici diMcGill, April 28, 2008.

T19 “Multimodal Streaming and Distributed Audio Interaction”, High Quality Audio over Net-works (ANET II) Summit, Banff Centre, April 12, 2008.

T20 “Shared Reality: Effective Interaction for (Demanding) Distributed Tasks”, Arts, Media andEngineering, Arizona State University, February 29, 2008

T21 “Music and Games: How Fun Applications Stimulate Core Technologies”, Canadian Univer-sity Software Engineering Conference, January 19, 2008.

T22 “From Videoconferencing to Shared Reality.” Department of Electrical and Computer Engi-neering, University of British Columbia, October 4, 2007.

18


T23 “From Teleoperation to Teleimmersion: Design Challenges for Distributed Interaction”, Cana-dian University Software Engineering Conference, January 19, 2007.

T24 “CANARIE sur UCLP et ROADM, deux technologies qui changent le monde des telecoms”,Round Table panel, RISQ Annual Conference, Quebec City, October 16, 2006.

T25 “La recherche sur en ultra-videoconference”, Panel on “Vitrine technopedagogique sur lavideoconference”, RISQ Annual Conference, Quebec City, October 16, 2006.

T26 “Video Processing Challenges for Intelligent Interactive Environments”, Workshop on Com-puter Vision for Intelligent Interactive Environments”, Lexington, Kentucky, November 17–18,2005.

T27 “Broadband transmission of multimodal content at the Centre for Interdisciplinary Researchin Music Media and Technology (CIRMMT)”, RISQ-CA*net4 Advanced Networking Day,Montreal, October 24, 2005.

T28 “Low-Latency Ultra-Videoconferencing and Shared Reality.” Interfaces Montreal, Rencontredu Genie numerique et des Affaires. Montreal, October 11, 2005.

T29 “Shared Spaces.” Asia-Pacific Advanced Networks (APAN) Conference, Taipei Aug. 22–27,2005.

T30 “Engaging Technolog(ies) for Effective Interaction.” Keynote speaker. World Conference onEducational Multimedia, Hypermedia and Telecommunications, Montreal, June 29, 2005.

T31 “Broadband Distance Education in 2007: Views from the Demand Side.” Invited Panelist.World Conference on Educational Multimedia, Hypermedia and Telecommunications, Mon-treal, June 29, 2005.

T32 “Ultra-Videoconferencing and Intelligent Classrooms.”’ Keynote speaker. Canadian HigherEducation and Information Technology Conference, Montreal, June 28, 2005.

T33 “Engaging Technolog(ies) for Effective Interaction.” Department of Computer Science, He-brew University of Jerusalem, April 19, 2005.

T34 “Engaging Technolog(ies) for Effective Interaction.” Intelligence, Agents, Multimedia Group,University of Southampton, UK, March 7, 2005.

T35 “From Videoconferencing to Shared Reality.” l’Institut de Recherche et Coordination Acous-tique/Musique (IRCAM), Paris, November 25, 2004.

T36 “From Videoconferencing to Shared Reality.” Bell University Laboratories’ Annual Confer-ence, Toronto, November 3, 2004.

T37 “History of Internet Audio Experiments at McGill.” High Quality Audio over Networks(ANET) Summit, Banff Centre, August 20–22, 2004.

T38 “From Videoconferencing to Shared Reality.” Taiyuan University, Taiyuan, China, April 18,2004.

19


T39 “From Videoconferencing to Shared Reality.” Tsighua University, Beijing, China, April 14,2004.

T40 “From Videoconferencing to Shared Reality.” Beijing University, Beijing, China, April 14,2004.

T41 “From Videoconferencing to Shared Reality.” Beihan University, Beijing, China, April 12,2004.

T42 “From Videoconferencing to Shared Reality.” Advanced Telecommunications Research (ATR),Nara, Japan, April 9, 2004.

T43 “From Videoconferencing to Shared Reality.” Dept. of Industrial Engineering, Musashi Insti-tute of Technology, April 5, 2004.

T44 “Advanced Video Applications: Developments in Extreme Video.” Southeastern UniversitiesResearch Association Video Development Initiative (SURA/ViDe) 6th Annual Digital VideoWorkshop. Indianapolis, March 24, 2004.

T45 “High-fidelity telepresence.” Graphics and Geometric Computing Seminar Series, Technion –Israel Institute of Technology, January 1, 2003.

T46 “The Democratic Revolutions – Peer to Peer Meets Open Source: Design, Philosophy, Engi-neering.” Intimate Technologies/Dangerous Zones. Banff New Media Institute, Banff Centre,April 27, 2002.

T47 “The Development of Ultra VC Applications and Technology.” Southeastern UniversitiesResearch Association Video Development Initative (SURA/ViDe) 4th Annual Digital VideoWorkshop. University of Alabama at Birmingham, April 25, 2002.

T48 “The Virtual Studio.” Royal Conservatory of Music, Toronto, February 25, 2002.

T49 “Building a Shared Reality.” Department of Computer Science, University of Toronto, Febru-ary 25, 2002.

T50 “Distributed Concerts and Shared Reality: Just how much streamed data and computationdo we need to support effective interaction?” Department of Computer Science, ClarksonUniversity, November 1, 2001.

T51 “High quality wide-screen SDI video and multichannel audio over CA*net3.” CANARIE’s7th Advanced Networks Workshop, Toronto, November 28, 2001.

T52 “Low-latency comes to videoconferencing: The Freres Jacques duet at a distance.” RISQ2001 Conference, Montreal, November 5, 2001.

T53 Advanced Networking and the Arts: Innovations in Outreach, Collaboration, and Perfor-mance. Panel Discussion at Internet Global Summit INET 2001 Conference, Stockholm, June6, 2001.

20


T54 “The McGill - Calgary Advanced Learnware Network.” CANARIE’s 6th Advanced NetworksWorkshop, Montreal, November 29, 2000.

T55 “Networks and Music Instruction.” Panel Discussion with Pinchas Zukerman and WieslawWoszczyk, CANARIE’s 6th Advanced Networks Workshop, Montreal, November 29, 2000.

T56 “Tools for Distributed VR.” Canadian Working Group on Virtualized Reality Systems, Mon-treal, November 28, 2000.

T57 “Evolution of the Intelligent Classroom.” Multicultural Perspectives on the use of Technologyin Education. Montreal, October 2, 2000.

T58 The Brave New World of Ubiquitous Bandwidth.” Internet Global Summit INET 2000 Con-ference, Yokohama, July 20, 2000.

T59 “Multichannel Audio over the Internet: The Next Phase.” RISQ 2000 Conference, May 31,2000.

T60 “Robotics and Design.” Round Table Panel, Centre Design UQAM, February 9, 2000.

T61 “Multichannel Audio over the Internet.” CANARIE’s 5th Advanced NetworksWorkshop,Toronto, November 29, 1999.

T62 “The Shared Reality Environment.” Department of Electrical and Computer Engineering,Ecole Polytechnique, Montreal, May 28, 1999.

T63 “When Telemedicine feels like Regular Medicine.” Communications and Information Tech-nology Ontario (CITO) Healthcare for the Future:Telemedicine, February 18, 1999.

Media Exposure

M1 Global TV (National), Jan. 29, 2009

M2 Global TV (Montreal), Jan. 27, 2009

M3 CBC Radio, As it Happens, Jan. 27, 2009

M4 National Post, Jan. 27, 2009

M5 Montreal Gazette, Jan. 27, 2009

M6 Montreal Gazette, Feb. 20, 2009

M7 Inside Higher Education, Sept. 3, 2008

M8 CBC Radio (Daybreak), Sept. 3, 2008

M9 CJAD radio, Sept. 2, 2008

M10 Cabling Networing Systems, Jan. 2006

M11 McGill Reporter, Nov. 24, 2005

M12 CTV Quebec, Global News, Dec. 23, 2002

M13 New York Times, Technology Section, Dec. 19, 2002

21


M14 Discovery Channel, Daily Planet, Oct. 30, 2002

M15 CFCF (CTV Quebec) Global News, June 19, 2002

M16 National Post, June 15, 2002

M17 CBC Television, The National, May 3, 2002

M18 McGill Reporter, Learning the Strings, April 11, 2002

M19 Ottawa Citizen, March 29, 2002

M20 Montreal Gazette, March 27, 2002

M21 Globe & Mail, Dec. 1, 2001

M22 Canal Z, La Revanche des Nerdz, Nov. 13, 2001

M23 Montreal Gazette, Nov. 10, 2001

M24 CJAD Radio, The World Today, July 31, 2001

M25 McGill Reporter, April 5, 2001

M26 Globe & Mail Report on Business, Oct. 28, 2000

M27 TQS Double Clic!, Oct. 7, 2000

M28 McGill Reporter, Sept. 21, 2000

M29 UPath.com, Vol 40, 2000

M30 CBC (Montreal) Home Run, Aug. 22, 2000

M31 Montreal Gazette, Aug. 22, 2000

M32 CFCF (CTV Quebec) Pulse News, Aug. 21, 2000

M33 CBC Radio The Arts Report, July 20, 2000

M34 Elle Quebec, June 2000

M35 Journal Le Monde des Affaires, May 2000

M36 Canal Z, Technofolie, May 3, 2000

M37 TQS Double Click, April 29, 2000

M38 McGill Reporter, April 6, 2000

M39 Briefing Digital, April 2000

M40 Interface: La Revue de la Recherche, Vol. 21, No. 2, March-April 2000

M41 American Society of Mechanical Engineers, Mechanical Advantage, Vol 9, No 3, March 2000

M42 Canal Z, La Revanche des Nerdz, Feb. 2000

M43 CFCF (CTV Quebec) Pulse News, Feb. 29, 2000

M44 Canal Vox: CityMag, Jan. 15, 2000

M45 Montreal Mirror, Jan. 6, 2000

M46 Plan Mega: La revue du genie quebecois, Ordre des ingenieurs du Quebec. Vol 1, Jan. 2000

M47 Radio Corporation of Singapore: Science and Technology Watch, Dec. 1999

22


M48 Radio Canada (CBC French) Les Annees lumiere, Nov. 28, 1999

M49 Financial Times Life/Technology, Nov. 25, 1999

M50 CBC Radio: As it Happens, Nov. 22, 1999

M51 Journal de Montreal, Nov. 19, 1999

M52 Le Devoir, Nov. 18, 1999

M53 TVA CyberClub, Nov. 13, 1999

M54 La Presse, Sept. 26, 1999

M55 CJAD Radio, April 11, 1999

M56 Montreal Mirror, April 8, 1999

M57 McGill Reporter, Jan. 14, 1999

M58 High-Tech Shower International, Nov. 26, 1997

M59 CBC Newsworld “Futureworld”, Oct. 5, 1996

M60 Discovery Channel, Sept. 18, 1996

M61 Toronto Star, Sept. 15, 1996

M62 University of Toronto Varsity, Sept. 3, 1996

M63 TV Ontario “Studio Two”, June 26, 1995

23

Supervision RESEARCH

Supervision

Research Professionals

Name Period Tasks Present PositionChen, Guangyi Jan. 2010 –

Jul. 2010research associate under Canarie NEP

Dansereau, Don June 2009 –Jan. 2010

research associate under FQRNT grant Ph.D. student,UNSW, Australia

To, Long Jan. 2009 –present

research associate under NSERC I2I

Blum, Jeff Oct. 2008 –present

research assistant under MSG project

Olmos, Adriana Sept. 2008 –present

user interface engineer under CanarieNEP

Sun, Haijian Sept. 2008 –Oct. 2010

computer engineer under Canarie NEP programmer, Des-jardins

Soukhodolski, I. Oct. 2005 –Dec. 2007

web services programmer under CanarieIIP

consultant

Kiewe, Howard Oct. 2005 –Dec. 2007

user interface developer under CanarieIIP

consultant

Spackman, S. 2000 – 2006 research associate on Canarie and VRQprojects

Quantum Corpora-tion, San Jose

Sarikaya, Deniz 2003 – 2004 research assistant on VRQ projects deceasedSoucy, Gilbert 1999 research associate on CFI project Imaging Special-

ist, 36pix Inc.,Montreal

24


Post-doctoral Fellows

Name Period Tasks (Funding Program) Present PositionPelletier, S. Jan. 2011 –

presentParallax Barrier Display rendering soft-ware optimization (NSERC ENGAGE)

Otis, Martin Jan. 2010 –Dec. 2010

Natural Interactive Walking Asst. Professor,U. Quebec aChicoutimi

Millet, G. Nov. 2009 –present

Natural Interactive Walking

Bouillot, Nicolas Oct. 2009 –present

Open Orchestra (Canarie NEP-2Project)

Pelletier, S. Nov. 2009 –Jun. 2010

Real-time Image-based Rendering (Ca-narie NEP)

(see above)

Darolti, Cristina Jan. – Dec.2009

Real-time Image-based Rendering (Ca-narie NEP)

Patent Examiner,EPO, The Hague

Bouillot, Nicolas 2007 – 2009 Mobile Audio Interaction (NSERC NewMedia Initiative)

(see above)

Wang, Guangyu 2007 –present

Neurosurgical Visualization (NSERCStrategic Grant)

Wang, Yan 2002 – 2003 Channel and spatial view allocation forvideoconferencing (VRQ)

V.P. Marketing,AMH Canada

25


Ph.D. Students

Name Period Thesis title Present PositionGhourchian, N. Jan. 2010 –

presentAffective Evaluation (McGill Engineer-ing Doctoral Award Student)

El-Shimy, D. Jan. 2009 –present

Gestural interaction for complex tasks(NSERC PGSD Scholarship Student)

Benovoy, M. Oct. 2007 –Aug. 2010

Biosignals analysis and pattern recog-nition (NSERC PGSD Scholarship Stu-dent)

transferred to an-other group

Visell, Yon Sept. 2005 –present

Walking on virtual ground: physics,perception, and interface design

Qi, Zhi Jan. 2004 –Dec. 2008

Towards dynamic mosaic generationwith robustness to parallax effects

Assistant Professor(EE), SoutheastUniversity, China

Pelletier, S. Jan. 2003 –Oct. 2009

Acceleration methods for image super-resolution

Yin, Jianfeng Sept. 2000 –Aug. 2008

Toward an Alternative Approach toMulti-Camera Scene Reconstruction

Component designengineer, Intel

Sun, Wei 2002 – 2006 Multi-camera Object Segmentation inDynamically Textured Scenes UsingDisparity Contours

Intel Corporation,Santa Clara

Cayouette, F. 2003 – 2006 (NSERC Scholarship – withdrew fromprogram)

Programmer, Arti-ficial Mind & Move-ment, Montreal

Arseneau, S. 2000 – 2006 Representing Junctions through Asym-metric Tensor Diffusion

Chief Engineer forR&D, Laser Shot,Houston

Additional Ph.D. Supervisory Service

I co-supervised a portion of the thesis work of the following students:

• Grond, F.. (Jul.-Dec. 2010), visiting student from Bielefeld University, Germany

• Zambon, S.. (Jul.-Oct. 2010), visiting student from Verona University, Italy

• Cirio, G. (Jun.-Aug. 2010), visiting student from INRIA-IRISA, France

• Rizutti, C. (Sep.-Oct. 2008), visiting student from Universita della Calabria, Italy

• Bossi, E. (Sep.-Oct. 2008), visiting student from Universita della Calabria, Italy

• Pellerin, R. (Jun.-Sep. 2008), visiting student from Conservatoire Nationale des Arts etMetiers, France

• Cupellini, E. (Jul.-Aug. 2007), visiting student from Universita della Calabria, Italy

• Usher, J. (2003-2004), Ph.D. student, Faculty of Music, McGill University

• Mohammadi, M. (Feb.-Aug. 2004). visiting student from Sharif University, Iran

26


I served as external reviewer of the following theses:

• Alexandre Plouznikoff, Ecole Polytechnique de Montreal (2009)

• Xiaoyong Sun, School of Information Technology and Engineering, University of Ottawa(2007)

• Nicolas Bouillot, Conservatoire Nationale des Arts et Metiers, France (2006)

• Harold Okai-Tettey, Computer Science, Rhodes University, South Africa (2006)

I served on the supervisory and/or examination committees of the following students:

• Andrew Phan, Department of Electrical and Computer Engineering

• Cory McKay, Faculty of Music

• Vanessa Yarmechuk, Faculty of Music

• Dante De Nigris Moreno, Department of Electrical and Computer Engineering

• Mark Zadel, Faculty of Music

• Sean Olive, Faculty of Music

• Marc Boule, Department of Electrical and Computer Engineering

• Charles-Antoine Julien, Grad. School of Library and Information Studies

• Adam Finkelstein, Department of Educational Psychology and Counselling

• Zahir Albadawi, Department of Mechanical Engineering

• Paul Haroun, School of Computer Science

• Jason Corey, Faculty of Music

• Dale Stammen, Faculty of Music

• Carmen Au, Department of Electrical and Computer Engineering

• Jun Ouyang, Department of Electrical and Computer Engineering

• Wei Chu, Department of Electrical and Computer Engineering

• Vincent Levesque, Department of Electrical and Computer Engineering

• Jerome Pasquero, Department of Electrical and Computer Engineering

• Rui Ma, Department of Electrical and Computer Engineering

• Dingrong Yi, Department of Electrical and Computer Engineering

• Ala Qumsieh, Department of Electrical and Computer Engineering

• Harkirat Sahambi, Department of Electrical and Computer Engineering

• Muhua Li, Department of Electrical and Computer Engineering

• Yick Kei Wong, Department of Electrical and Computer Engineering

• Oliver Astley, Department of Electrical and Computer Engineering

• Edouard Antoniou, Department of Electrical and Computer Engineering

• Wei Sun, Department of Electrical and Computer Engineering

27


Masters Students

Name Period Thesis title Present PositionViswanathan, R. Jan. 2010 –

presentGesture Prediction for Video Encoding

Knight, Trevor Jan. 2010 –present

Signal Analysis for Open Orchestra

Li, Weizhong Sept. 2008 –May 2009

(recommended alternative supervision)

Ip, Jessica Sept. 2008 –present

An Augmented Reality Prototype forInteractive Play in a Virtual and Phys-ical Environment

El-Shimy, D. Sept. 2007 –Dec. 2008

Gestural interaction for complex tasks (reclassified asPh.D. student)

Law, A. Sept. 2007 –Sept. 2010

A Vibrotactile Floor for Enabling Inter-action through Virtual Walking Spaces

Applications Engi-neer, Lumerical So-lutions, Vancouver

Benovoy, M. Sept. 2006 –Oct. 2007

Biosignals analysis and its applicationin a performance setting

(reclassified asPh.D. student)

Audet, Samuel 2005-2007 Shadow Removal from Multi-ProjectorDisplays via Three-Dimensional Mod-eling and Object Tracking (NSERCScholarship student)

Ph.D. student,Tokyo Institute ofTechnology, Japan

Wozniewski, M. 2003-2006 A framework for interactive three-dimensional sound and spatial audioprocessing in a virtual environment

research engineerat la Societe desarts technologiques,Montreal

Rudzicz, Frank 2004-2006 CLAVIUS: Understanding LanguageUnderstaing in Multimodal Interaction(FQRNT Scholarship student)

Ph.D. student, Uni-versity of Toronto

Rioux, Francois 2003-2005 Software Framework for Parsing andInterpreting Gestures in a MultimodalVirtual Reality Context (NSERC Schol-arship student)

Ph.D. student,Laval University

Chan, Siu-Chi 2002-2005 Hand and Fingertip Tracking for Ges-ture Recognition

Software Developer,IBM Toronto Soft-ware Laboratory

Hilario, Nadia 2002-2005 Occlusion Detecion in Front Projec-tion Environments based on Camera-Projector Calibration (FCAR Scholar-ship student)

Software Developer,CAE

Perez, Michael 2002-2005 A Study of Multimodal Human-Computer Interaction for a PublicKiosk System

Programmer, Medi-cal Industry

Sud, Daniel 2002-2005 Design of a Multi-Projector DisplaySystem

Programmer, Arti-ficial Mind & Move-ment, Montreal

28


Masters Students (cont.)

Name Period Thesis title Present PositionBoussemart, Y. 2002-2005 Design and Implementation of Frame-

work for Immersive Environments in aShared Context

Ph.D. student, MIT

Pelletier, S. 2001-2003 High-Resolution Video Synthesis fromMixed-Resolution Video Based on theEstimate-and-Correct Method

(see above)

Gu, Jinhua 2000-2002 A distributed software architecture forthe Shared Reality Environment.

Assistant VP, Ra-dian Asset Assur-ance Inc., NY

Yao, Jie 2000-2002 Human Arm Gesture Detection andRecognition in a Classroom Environ-ment.

Ph.D. student,Concordia Univer-sity

Zhang, Yuan 2000-2002 An efficient coding method for spatialdata: the rotating, hierarchical, over-lapping representation.

Ph.D. student, Uni-versity of Delaware

Doutriaux, S. 1998-1999 (withdrew in 1999 to launch start-up company)Arseneau, S. 1998-2000 Robust Image Segmentation Towards

an Action Recognition Algorithm.(see above)

Xu, Aoxiang 1998-2000 A High-Performance Audiovisual Com-munication System.

Software engineer,Lumenera Corpora-tion, Ottawa

Additional Masters Supervisory Service

I co-supervised a portion of the thesis work of the following students:

• Mabire, N. (Apr-Sep. 2010). visiting student from Supelec, Metz, France

• Brule, M. (Feb.-Aug. 2009). visiting student from Universite de Louis Pasteur, Strasbourg,France

• Anlauff, J. (Dec. 2008-Mar. 2009). visiting student from Bielefeld University, Germany

• Delattre, G. (Apr.-Aug. 2007). visiting student from Universite Paris VI, France

I served on the supervisory and/or examination committees of the following students:

• Anne-Marie Burns, Faculty of Music, McGill University

• Frank Riggi, Electrical and Computer Engineering, McGill University

• Eric Benzacar, Electrical and Computer Engineering, McGill University

• Oles Protsiym, Faculty of Music, McGill University

29

Active Collaborations RESEARCH

Active Collaborations

Name Affiliation Project DatesHess, Robert Dept. of Ophthalmology,

McGillamblyopia treatment device 2009–present

Thompson, Ben Dept. of Optometry and Vi-sion Science, Auckland

amblyopia treatment device 2009–present

Levine, Martin Dept. of Electrical and Com-puter Engineering, McGill

video-based facial recogni-tion

2009–present

Berard, Francois Laboratoire d’Informatiquede Grenoble

evaluation of 3D input de-vices

2008–present

Giordano, Bruno Faculty of Music, McGill perception of ground sur-faces

2007–present

Marentakis, G. Faculty of Music, McGill feedback influences in targetacquistion

2007–present

McAdams, Stephen Faculty of Music, McGill Perception and EmotionRecognition

2007–present

Sha, Xin-Wei Dept. of Computer Science,Concordia University

Virtual Presence and Perfor-mance

2005–present

Roston, John Instructional Media Ser-vices, McGill

Open Orchestra 2002–present

Woszczyk, Wieslaw Faculty of Music, McGill Open Orchestra 2000–presentSettel, Zack Societe des Arts Tech-

nologiquesIn-Situ Audio Services 2000–present

30

Funding Awarded RESEARCH

Funding Awarded

Individual Research Grants and Contracts

Date Agency Amount Title/Description2011 NSERC $25,000 Improved Parallax Barrier Autostereoscopic Display Soft-

ware Engage Grants Program (SPI) with Industrial Parnter,Holoptick Technologies Inc.

2010 Google $50,000 A Spatialized Audio Map System for Mobile Blind Users. GoogleResearch Awards.

2010 Honda $30,000 Facial Expression Recognition for Machines. Honda ResearchInstitute.

2010 UVic $8,000 NEPTUNE Pleora streamer. University of Victoria software li-cense

2008-2011

MDEIE $367,195 Natural Interactive Walking. Support for International Re-search and Innovation Initiatives, Ministere du Developpementeconomique, de l’Innovation et de l’Exportation; for Canadianparticipation in EU FP-7 program with partners in France, Italy,and Denmark.

2007-2010

MDEIE $15,000 Un environment virtual pour la creation de musique et de sona partir de systemes chaotiques. Support for International Re-search and Innovation Initiatives, Ministere du Developpementeconomique, de l’Innovation et de l’Exportation.

2006-2009

NSERC $317,785 A pervasive multi-user augmented space for mobile immersiveinteraction with sound and music. New Media Initative STPGP337999-06. (matching funding for artist collaborator receivedfrom Canada Council for the Arts)

2006-2011

NSERC $100,000 Enhanced video for shared reality environments. Discoverygrant.

2004-2006

NSERC $136,600 Soundscape performance works via interactive environment forimmersive audiovisual scene generation. (matching funding forartist collaborator received from Canada Council for the Arts)New Media Initative NMIPJ 307934-04.

2002-2006

NSERC $100,000 Shared Reality Interaction over High Bandwidth Connectivity.Discovery grant.

2000 LUB $100,000 Distributed Visualization Environment. Laboratoire universi-taire Bell Equipment Grant.

31


Individual Research Grants and Contracts (cont.)

Date Agency Amount Title/Description1999-2000

Petro-Canada

$20,500 Interactive Web Tools for Critique of Presentation Skills andEvaluation of Student Learning. Young Innovator Award.

1999-2002

FCAR $45,000 Augmenting an Electronic Classroom for Improved Instructor-Student Interaction. New Researchers Award.

1999 FCAR $15,700 Augmenting an Electronic Classroom for Improved Instructor-Student Interaction. Equipment Grant.

1999 AES $25,000 Multichannel audio over Internet. Audio Engineering Society.1999 OSC $15,000 Timespace Exhibit. Ontario Science Center contract.1999 Mgmt. $10,000 Intelligent Classroom tools. McGill Faculty of Management.1998-2002

NSERC $76,000 Reactive Hospital Environment. Discovery research grant.

1998 FGSR $20,000 McGill Graduate Studies and Research Development Fund

32


Team Research Grants and Contracts (percentages refer to my portion)


NSERC $49,815(90%)

∗Novel Portable Treatment Device for Lazy Eye Idea to Innova-tion (I2I) Booster (Phase Ib) (with R. Hess)

2009-2011

MSG $200,000(80%)

∗Location-Based Spatialized Audio Interaction for the Blind andVisually Impaired Programme Appui au passage a la societe del’information (Support for the transition to an information soci-ety program), Ministere des Services gouvernementaux (MSG)(with M. Wozniewski and Z. Settel)

2010-2014

CHRP $327,000(?%)

Computational and statistical tools for image guided neuro-surgery of brain tumours NSERC Collaborative Health ResearchProjects (with L. Collins and 7 others)

2009-2010

CCSIP $48,000(4%)

∗Digitally Merged Environments California-Canada StrategicInitiatives Program (with S. Brown, UCSD and 20 co-applicants)

2009-2011

Canarie $927,648(40%)

Open Orchestra Network-Enabled Platforms 2 (with J. Rostonand W. Woszczyk)

2010-2014

NCE $23,000,000(2%)

GRAND: Graphics, Animation and New Media Networks ofCentres of Excellence (With K. Booth and 49 others)

2009 DND $47,500 Video-Based Facial Recognition - Algorithm and DemonstrationDepartment of National Defence Contract (with M. Levine)

2008-2009

NSERC $120,250(90%)

∗Novel Portable Treatment Device for Lazy Eye Idea to Innova-tion (I2I) (with R. Hess)

2008-2010

Canarie $323,365(30%)

NEPTUNE: A Platform to Create and Support Ocean Sci-ence Virtual Organizations Network-Enabled Platforms (withB. Pirenne and J. Roston)

2008-2010

Canarie $2M (18%) Health Services Virtual Organization Network-Enabled Plat-forms (with R. Ellaway and 8 others)

2008-2010

NSERC $196,000(50%)

∗3-D Visualization and gestural interaction with multimodal neu-rological data Strategic Projects (with 5 others)

2006-2009

FQRNT $146,550(50%)

∗Unites agenceables: Reseau d’Environnements Immersifs pourCollaboration a Distance Recherche en equipes (with X.-W. Sha)

2005-2006

Canarie $825,000(50%)

Undersea Window - High Definition Video Online Intelligent In-frastructure Program. (with J. Roston)

2005-2006

SAT $1,276,000(1%)

TOT2: Nouveau Territoires de la Creation-Diffusion en ReseauHeritage Canada New Media Research. (M. Savoie, PI)

2004-2006

Canarie $568,971(33%)

Shared Spaces – High Definition Ultra-Videoconferencing Ad-vanced Applications Program. (with J. Roston)

2003-2004

SAT $792,082(1%)

TOT1: Nouveau Territoires de la Creation-Diffusion en ReseauHeritage Canada New Media Research. (M. Savoie, PI)

2002-2005

IRIS $573,000(25%)

∗Parallel Distributed Camera Arrays for Intelligent Environ-ments (with J. Clark, S. Fels, R. Vertegaal)

33


Team Research Grants and Contracts (cont.)


VRQ $2,180,000(20%)

Real-time Communication Of High-res. Multi-sensory Contentvia Broadband Networks. (with W. Woszczyk and others)

2001-2002

Canarie $391,000(30%)

Remote Video Sign-Language Interpreting. Advanced Network-ing Apps. Services & Technologies. (with J. Roston and others)

2000-2002

Canarie $808,000(35%)

McGill Advanced Learnware Project. Advanced Networking Ap-plications Services and Technologies. (with B. Pennycook)

2000-2003

LUB $150,000(50%)

∗Distributed Shared Visualization Environment. Laboratoireuniversitaire Bell. (with B. Ozell)

2000-2001

RoyalBank

$2,000(80%)

∗Improving Teaching through an Interactive Critiquing System.Teaching Improvement Fund Award. (with R. Harris and J.Blatter)

1999-2002

CFI $400,000(50%)

†The Shared Reality Environment. New Opportunities Award.(with J. Clark)

1999-2000

RoyalBank

$10,000(80%)

∗Interactive Web Tools for Critique of Presentation Skills andEvaluation of Student Learning. TIF (with R. Harris)

∗Indicates grants on which I am project leader. †Grant on which I am co-investigator.

Centre Research Grants


FQRSC/FQRNT

$1,800,000 Regroupement Strategique: Centre Interdisciplinaire deRecherche en Musique, Medias et Technologie. (with S.McAdams and 23 others)

2007-2009

NSERC $57,630 Major Resources Support: Centre for Interdisciplinary Researchin Music Media and Technology (CIRMMT). (with S. McAdamsand 8 others)

2006-2012

FQRNT $1,530,000 Regroupement Strategique pour l’Etude des EnvironnementsPARTages Intelligents repartis (REPARTI). (with D. Lauren-deau and 23 others) $100,000 per annum allocated to CIM.

2002-2005

FCAR $720,000 Regroupement Strategique: Reseau Quebecois de Recherche enRealite Artificiellle Distribuee (QUERRAnet). (with F. Ferrie,R. Bergevin, P. Cohen, and others)

2001 CFI $6,500,000 Major Facilities Award: Centre for Integrated Research in MusicMedia and Technology. (with W. Woszczyk and 11 others)

2000-2002

FCAR $113,500 Centre de Recherches. (with F. Ferrie and 17 others)

2000 NSERC $275,000 Information Systems in Support of Intelligent Machine Re-search. (with F. Ferrie and 17 others)

34

TEACHING

Teaching

Courses Taught

Course title and number Description Semester

ECSE-526BArtificial Intelligence

Graduate level course in artificial intelli-gence with emphasis on machine learningand autonomous agents

Winter 1998–present

∗ECSE-683Topics in Vision andRobotics†

Graduate level laboratory course forRoboCup projects

Fall 2000Fall 2002

∗ECSE-424BHuman-ComputerInteraction

Undergraduate course in human-computer interaction with emphasis onnew interface paradigms

Winter 2000–present

ECSE-487A/CComputer ArchitectureLaboratory

Undergraduate laboratory course Fall 1999–present, Sum-mer 2000–2002

ECSE-427AOperating Systems

Undergraduate course (core for Com-puter Engineering students)

Fall 1998

CSC-270Introduction to Modellingand Optimization

Computer Science undergraduate course,University of Toronto

1993–1994

CEE 1714YDigital Systems andComputers

Continuing Engineering Educationcourse for the Association of ProfessionalEngineers of Ontario

1993–1994

CSC-228File Structures and DataManagement

Computer Science undergraduate course,University of Toronto

1992–1995

COSC-3411File Structures and DataManagement

Computer Science undergraduate course,York University 1992

∗Indicates new course that I created.†Note that in 2003, this course is being offered under the designation of ECSE-688 RecentAdvances in Electrical Engineering.

35

Undergraduate Supervision TEACHING

Undergraduate Supervision

Honors Undergraduate Projects (2 semesters)

Name Year Research topicWaraich, Shahjahan 2010 Natural Interactive WalkingLin, Nan 2008 Location sensing for mobile apps.Wang, Letao 2007 Interactive AgentCharlebois, Pierre-Olivier 2004–2005 Sound Objects in a SoundscapeMyer, Sam 2003 Automated Music TranscriptionEl-Refaei, Sameh 1998–1999 Shared Reality simulator

Undergraduate Projects (2 semesters)

Savchenko, Eugene 2010 3D interaction

Undergraduate Projects (1 semester)

Name YearHimmelman, Tristan 2009Ephraim, Theo 2009Peck, Benjamin† 2008Mankarios, Daniel 2007Konstantinidis, Alex 2007Pufahl, David 2005Zhu, Ming-Zhang 2005Chan, Keng Chi 2005Phan, Andrew 2004Saifee, Ali-Akber 2004Shield, Robert 2004Aube, Francois 2004Rudzicz, Frank 2003Sarikaya, Deniz 2002Vallianatos, K. 2002Hassaine, Sofiane 2002Wyse, Marisa 2001

Name YearBancroft, David 2001Glass, Emily 2001Asselin, Ramy 2001Sud, Daniel 2001Gapakov, Timofei 2001Rosenblatt, Avi 2001Pekofsky, Gregory 2001Kitisa, Anousack 2000Vial, Thibaut 2000Bernier, Martin 2000Agha, Khurram Z. 2000Bhattacharya S. 2000Lavery, William 2000Yeung, Jason 2000Liao, Yuan Mei 1999Yee, Amy 1999Pereira, David 1999Ciambella, Gary 1999Kassouf, Nadim 1999

Name YearLee, Garvin, 1999Li, (Shao-Gi) Chris 1999El-Sharif, Osama 1999Nasereddin, Hazem 1999Virdi, Gurpratap 1999Shah, Ali 1999Djihanian, Sylvie 1999Moussaoui, Khaled 1999Dib Youssef 1999Tam, H. 1999Gagnon, Gabriel 1999Tjhin, P. 1999Luong, Mai 1999Lau, Sau 1999Tsai, Wanti 1999Lerner, Sorin∗ 1999Hochstein, Lorin∗ 1999Pollack, Jonathan 1998Nguyen, Bau 1998

∗Co-supervised with James Clark†Co-supervised with Paul Kry

36

Undergraduate Supervision TEACHING

Undergraduate Internships

Name Year ProjectTomiyoshi, Marcio 2011 (ELAP Scholarship Student) Open OrchestraBeniak, Stephane 2010 (NSERC Student) Natural Interactive WalkingSalenikovich, Stepan 2010 Natural Interactive WalkingChaw, Gary 2010 Natural Interactive WalkingRedel, Josh 2010 Health Services Virtual OrganizationSmith, Severin 2009-10 Natural Interactive WalkingRajalingham, Rishi 2009 (NSERC Student) Natural Interactive WalkingRener, Farid 2009 (SURE Student) Natural Interactive WalkingBae, Sung 2009 Optical Tracking for Audio GraffitiJathal, Kunal 2007 Analysis of haptic and auditory perception in hu-

man walkingLin, Nan∗ 2006 (NSERC Student) Interactive navigational control

of a robotic wheelchairReiter, Philippe 2005 (VP USRA Student) Distributed Video Rendering

for the SREAriane Chan-You 2003 Region-of-Interest Control and Selective Band-

width AllocationAriane Chan-You 2002 Data Reduction for Audiovisual Transport Qual-

ity EvaluationGupta, Greeshma 2000 (NSERC Student) Automated PowerPoint con-

version & PAQ systemCote, Christian 2000 (NSERC Student) Video perspective transforma-

tion with CAVE libraryAyatizadeh, Negah 2000 Network communication daemonsSwartz, Tanya 2000 Speech-based TV-tuner interfaceCohen, Ouri 2000 Classroom 2000 access controlYeong, Jason Aw 1999 (Work Study) C2000 Previously Asked Questions

(PAQ) systemAgha, Khurram Zubair 1999 (Work Study) URL access tracking for Classroom

2000Lim, Weoi Peng 1999 (Work Study) Graffiti boardAgha, Haroon Ali 1999 (Work Study) Classroom 2000 mini-presentation

coach systemKlinger, Zamir 2000 (NSERC Student) Automated Door AttendantHooshangi, Sara 2000 (NSERC Student) Computer interfaces for elec-

tronic classroomLiao, Yuan Mei 1999 Electronic Classroom control interfacesLuo, Jiexin 1999 PowerPoint C2000 interface and image librariesZhao, Changpeng 1998-99 Seamless PowerPoint upload for Classroom 2000Lakdawalla, Azeem 1998-99 Real-time conjugate-gradient based headtracking

∗Co-supervised with Joelle Pineau

37

SERVICE

Service

University Service

Department Committees

2005-ongoing Scholarships Committee2002 Ad hoc Committee on computing infrastructure for ECE/SOCS2000-2009 College Liason2001-2004 Information Technologies & Undergraduate Lab2000-2002 Curriculum Committee2000 Software Engineering subcommittee2000-ongoing Undergraduate Committee (Undergraduate Student Advisor)

Other University Committees

2009-ongoing Member, CIRMMT Executive Committee2007-ongoing Co-chair, Multimodal Immersive Systems research axis, CIRMMT2006-2008 Member, CIRMMT Board of Directors2006 Advisory Committee for Dean of Music2004 Tomlinson University Science Teaching Project adjudication2003-2004 Royal Bank Teaching and Learning Innovation Fund adjudication2003 Groupe de travail sur les normes et standards de la formation en ligne. Conference

des recteurs et des principaux des universites du Quebec (CREPUQ), McGill Uni-versity Representative

2002-2003 SC-IST Workgroup on Research Computing2000-2003 SC-IST Workgroup on Classroom Design1999-2004 Engineering Committee on Teaching and Learning1999 SC-IST McGill Machine Project1998 Workgroup on Educational Technology

Fundraising Activities

2002 RoboCup demonstration at McCord museum for Dean’s Circle2002 Corporate fundraising for McGill RoboCup team2001-2002 Intelligent Classroom promotion with the Engineering Class of ’50; helped raise

$274,0002001 Trottier Building research promotion

Other Activities

2007-2010 Promotion of Academic Integrity (see www.degradingmcgill.ca)2001-2002 Design of new Intelligent Classroom systems for ENGMC 3041999-2002 Maintenance of the Intelligent Classrooms, training other faculty in use of the

technology1999 Curriculum development of three new courses in software engineering

38

www.degradingmcgill.ca

Professional Activities SERVICE

Professional Activities

Academic and Educational Committees

2010 Participant, NSF/CCC Workshop on Ultra-Large Scale Interaction2010 Voting Member, IEEE Communication Society Multimedia Communications Tech-

nical Committee (IEEE MMTC)2009 Organizer and Chair, AES Workshop on Network Technologies for Audio over IP2005-2006 Organizer, AES Tutorial and Workshop on Human Factors in Audio2004 Founder, AES Technical Committee for Human Factors in Audio Systems2003 Organizer, Workshop on LAN Delivery of Audio for AES2002-2003 Comite Scientifique de Robofolies, Centre Science de Montreal2001 Local Events Organizer, Autonomous Agents Conference, Montreal2001-2009 Chair, AES Technical Committee for Network Audio Systems2000-2004 Scientific Organizer, RoboCup Junior, Montreal2000-2001 Organizing Committee, Robofesta International Robot Games Festival, Japan1999-2000 Member and Webmaster, Canadian Virtualized Reality Working Group1998 Co-organizer, AAAI Symposium on Intelligent Environments

Grant Review

2009 Mathematics of Information Technology and Complex Systems (MITACS)2009 NSERC Strategic Networks (Site Visit Chair)2008 Peer review, NSERC Collaborative Research and Development Grants2008 Peer review, CFI (Canada Foundation for Innovation)2007-2009 Peer review, NSERC Discovery Grants2007-2008 NSERC Industrial Research Chair (Site Visit)2007-2009 Research Grants Council, Hong Kong2005 NSERC Steacie Memorial Fellowship2005-2008 Panel member, NSERC/Canada Council, New Media Initiative2002 Panel member, NSERC/Canada Council, New Media Initiative2001-2004 Peer review, NSERC Discovery Grants2001 Peer review, FCAR/CFI (Canada Foundation for Innovation)

39

Professional Activities SERVICE

Editorial Service

2010 IEEE Transactions on Affective Computing2010 IEEE Transactions on Robotics2010 IEEE Signal Processing Magazine2010 IEEE Transactions on Haptics2008 EURASIP Advances in Signal Processing2008 EURASIP Image and Video Processing2008 Audio Engineering Society (associate editor)2007 IEEE Transactions on Systems, Man, and Cybernetics2006 International Journal of Human-Computer Interaction2006 Springer Virtual Reality2005 Elsevier: Computers and Education2005 Elsevier: Image and Vision Computing2004 IEEE Pervasive Computing2000, 2003 Wiley Journal of Robotic Systems1999 ACM Transactions on Computer-Human Interaction1999 IEEE Transactions on Robotics and Automation1998 IEEE Personal Communications

Program Committees

2011 VRIC Workshop on Haptics for Telepresence, Teleoperation and CollaborativeEnvironments

2010 Graphics Interface2009 IEEE Haptics Symposium2009 International Computer Music Conference2009 Stereoscopic Displays and Applications2008 ACM SIGCHI conference2008 Immersive Medical Telepresence2006 International Conference on Digital Audio Effects2006, 2007 IEEE Workshop on Projector-Camera Systems (part of CVPR)2005-2009 Canadian Conference on Computer and Robot Vision2004, 2009 Graphics Interface2003, 2006 Audio Engineering Society2003 New Interfaces for Musical Expression2002 RoboCup International Symposium2002 IEEE International Conference on Robotics and Automation2001 ACM UbiComp2001 IEEE International Conference on Computer Vision

Other Academic Service

2008 Tenure Portfolio evaluation, York University

40

CV Versi LN

Documents

Transcript of CV Versi LN