Job Summary:

Please note that this posting is an unpaid co-op position with Waterloo Reality Labs, a member of the Sedra Student Design Centre in the Faculty of Engineering. Students are still eligible to receive their full co-op credit.

Waterloo Reality Labs is a student design team at the University of Waterloo that specializes in XR (extended reality) and spatial computing. Our team offers students hands-on experience with cutting-edge VR (virtual reality) and AR (augmented reality) technologies, as well as experimental spatial experiences. Currently, the team is researching and developing…

A wide FOV headset prototype designed from scratch: built for a fraction of the price of commercial headsets New optical systems for use in virtual and augmented reality headsets Custom electronics and hardware components for headsets and their peripherals Software systems, including elements of a spatial operating system + ambitious new machine learning systems for commercial headset use

We encourage highly interested students from all engineering disciplines to join us!

About This Position:

Reality Labs is seeking a Software Engineering Co-op student to join the Universal Gestures subteam. The Universal Gestures project aims to develop a new machine learning model that extends Meta’s SDK for Unity, and is able to recognize hand poses without the use of transforms, in a flexible and accessible manner. The project is also exploring the development of a software package that can transcribe a user’s movements into text, in real-time and securely on device.

Job Responsibilities:

Work alongside 10-20 Software Team members to develop the Universal Gestures project in Unity and PyTorch Develop new features and functionality for Unity package and machine learning models in PyTorch Create documentation for Universal Gestures repository

Required Skills:

Proficiency in one or more modern programming languages (Python, C#, C++, etc.) Familiarity with the Unity Engine and writing modular, well-structured programs in C# Familiarity with PyTorch and NumPy libraries, or other machine learning libraries for Python Strong interest in virtual and augmented reality systems

Nice to Haves: You have a demonstrated interest in making games in Unity, Godot, or other modern engines You have experience developing models in PyTorch for binary and multi-class classification, or other supervised learning techniques

Additional Location Info:

Full remote work is possible if student has access to a Meta Quest headset. Otherwise, Reality Labs provides headsets for use on-campus in Waterloo.