The project aims to enhance Polar Notes, an iOS mobile AI note-taking application designed to assist students and teachers by converting lecture audio into comprehensive notes. The app leverages SwiftUI for its user interface, which is already well-organized and labeled. The primary goal is to complete the frontend development in SwiftUI and establish a robust backend pipeline. This pipeline will utilize the Apple Speech Framework and Whisper to transcribe audio into text, which will then be processed by ChatGPT for summarization, study guides, and quizzes. The project addresses the challenge of accurately transcribing audio in various noise environments, ensuring that the app is reliable and effective in real-world educational settings.

The deliverables for this project include a fully functional frontend developed in SwiftUI, seamlessly integrated with a backend pipeline. This pipeline will transcribe audio using the Apple Speech Framework and Whisper, and subsequently process the text with ChatGPT. The final product should be capable of handling diverse audio environments, providing accurate and useful notes for students and teachers.