Software Engineer, Biomedical Data Science
Software Engineer (SWE) - SOAR WebApp Iteration II
We are seeking a part-time, remote SWE to develop a web application that can provide surgeons with AI-powered learning and feedback resources to accelerate the training of surgical students and improve outcomes for both student and expert surgeons. We want this application to have two main components:
- Video library indexing any given set of surgical videos (maybe hundreds or thousands) to allow retrieval of user-specified case conditions and good or bad examples, and (already completed- might need some more enhancements.
- Functionality for a user to submit a video and receive AI-based analytics and feedback.
The role would primarily focus on #1 (the video library) first with the idea that later on this would integrate with #2. Overall, the SWE would own the web application implementation containing at least component #1, working closely with a Product Manager who will communicate a clinical and AI vision.
The role would require ~10-15 hrs of work per week and last until ~Oct 15th, with the opportunity for extension dependent on project needs.
Preferred technical competencies:
- AWS cloud integration
- ML algorithm integration to UI
- React front-end UI/UX development
- Familiarity with APIs from labeling companies (like Labelbox)
The new features we are looking to add for Phase 1.0 of the project but are not limited to are listed below:
- Upload a new surgical video, enabling the ML algorithm to detect features and present a fully processed video to users.
- Optimize the video processing time.
- Display a processing icon in the "My Videos" section while the algorithm processes the video.
- Design surgical Meta Competencies.
- Add annotation capabilities to the video player, allowing users to highlight while performing a demo.
- Implement search and filter options by features and metadata.
- Enable comments on specific sections of surgical videos, which can be displayed to others and saved on the cloud.
- Scrub surgical videos for HIPAA information and splice out-of-body scenes.
- Refine functionalities related to the "surgical errors" feature: Show both errors as highlights if a video contains two or more instances of the same filtered error; Add error mitigation as a filter; Add total time and count for TipOOV errors.