AI Algorithm Testing

Project scope
Categories
Data analysis Data modelling Machine learning Artificial intelligence Data scienceSkills
taxonomy machine learning user research behavioral analytics quality assurance collaborative filtering metadata recommender systems restaurant operationThe objective of this project is to support the quality assurance and evaluation of a personalized restaurant recommendation system. The student will focus on testing, validating, and analyzing the accuracy of tag-based metadata and recommendation outputs. Rather than altering any core algorithms, the student will conduct structured audits and evaluations to help identify mismatches, anomalies, or inconsistencies in how restaurants are categorized and recommended. This work is crucial in helping improve data hygiene and tagging consistency, supporting future product reliability without impacting live systems or core ML infrastructure.
Expected Outcomes:
- Audit and evaluate the application of a provided tag taxonomy across a dataset of restaurants
- Conduct simulation-based evaluations of search results using predefined queries and metrics (e.g. tag alignment score, diversity checklists)
- Identify mismatches between intended tag use (e.g. “Romantic” or “Work-Friendly”) and actual recommendations returned
- Recommend refinements to tagging conventions or query interpretation logic
Expected Deliverables:
- A tag audit report flagging inconsistent, missing, or misapplied tags, including category-level summaries
- A spreadsheet (
evaluation_results.csv
) of test queries and observed system outputs, annotated with scoring insights - 3–5 documented case studies of user scenarios with commentary on recommendation quality and diversity
- A short presentation or written brief summarizing findings and proposing next-step improvements
Providing specialized, in-depth knowledge and general industry insights for a comprehensive understanding.
Sharing knowledge in specific technical skills, techniques, methodologies required for the project.
Direct involvement in project tasks, offering guidance, and demonstrating techniques.
Providing access to necessary tools, software, and resources required for project completion.
Scheduled check-ins to discuss progress, address challenges, and provide feedback.
About the company
Headquartered in Toronto, Ontario, Roam X is a Canadian food discovery app that helps users find restaurants based on vibe, mood and occasion. Whether you’re planning a cozy date night, a solo lunch, or a night out with friends, Roam X curates dining experiences that match how you feel. We are proud to be a minority-led business, federally recognized in Canada as BIPOC-owned, and committed to inclusive hiring practices as an equal opportunity employer.
Basée à Toronto, en Ontario, Roam X est une application canadienne de découverte de restaurants qui aide les utilisateurs à trouver des établissements en fonction de l’ambiance, de l’humeur et de l’occasion. Que vous planifiiez un rendez-vous romantique, un déjeuner en solo ou une soirée entre amis, Roam X propose des expériences culinaires qui correspondent à ce que vous ressentez. Nous sommes fiers d’être une entreprise dirigée par des personnes issues de minorités, reconnue au niveau fédéral au Canada comme appartenant à un propriétaire BIPOC, et engagée envers des pratiques d’embauche inclusives en tant qu’employeur garantissant l’égalité des chances.
Portals
-
Vancouver, British Columbia, Canada