AI Algorithm Testing

Open
Roam X
Toronto, Ontario, Canada
Employer
Project
Academic experience or paid work
60 hours of work total
Learner
Canada
Intermediate level

Project scope

Categories
Data analysis Data modelling Machine learning Artificial intelligence Data science
Skills
taxonomy machine learning user research behavioral analytics quality assurance collaborative filtering metadata recommender systems restaurant operation
Details

The objective of this project is to support the quality assurance and evaluation of a personalized restaurant recommendation system. The student will focus on testing, validating, and analyzing the accuracy of tag-based metadata and recommendation outputs. Rather than altering any core algorithms, the student will conduct structured audits and evaluations to help identify mismatches, anomalies, or inconsistencies in how restaurants are categorized and recommended. This work is crucial in helping improve data hygiene and tagging consistency, supporting future product reliability without impacting live systems or core ML infrastructure.

Deliverables

Expected Outcomes:

  • Audit and evaluate the application of a provided tag taxonomy across a dataset of restaurants
  • Conduct simulation-based evaluations of search results using predefined queries and metrics (e.g. tag alignment score, diversity checklists)
  • Identify mismatches between intended tag use (e.g. “Romantic” or “Work-Friendly”) and actual recommendations returned
  • Recommend refinements to tagging conventions or query interpretation logic


Expected Deliverables:

  • A tag audit report flagging inconsistent, missing, or misapplied tags, including category-level summaries
  • A spreadsheet (evaluation_results.csv) of test queries and observed system outputs, annotated with scoring insights
  • 3–5 documented case studies of user scenarios with commentary on recommendation quality and diversity
  • A short presentation or written brief summarizing findings and proposing next-step improvements


Mentorship
Domain expertise and knowledge

Providing specialized, in-depth knowledge and general industry insights for a comprehensive understanding.

Skills, knowledge and expertise

Sharing knowledge in specific technical skills, techniques, methodologies required for the project.

Hands-on support

Direct involvement in project tasks, offering guidance, and demonstrating techniques.

Tools and/or resources

Providing access to necessary tools, software, and resources required for project completion.

Regular meetings

Scheduled check-ins to discuss progress, address challenges, and provide feedback.

About the company

Company
Toronto, Ontario, Canada
2 - 10 employees
Entertainment, Food & beverage, Technology
Representation
Minority-Owned BIPOC-Owned Small Business

Headquartered in Toronto, Ontario, Roam X is a Canadian food discovery app that helps users find restaurants based on vibe, mood and occasion. Whether you’re planning a cozy date night, a solo lunch, or a night out with friends, Roam X curates dining experiences that match how you feel. We are proud to be a minority-led business, federally recognized in Canada as BIPOC-owned, and committed to inclusive hiring practices as an equal opportunity employer.

Basée à Toronto, en Ontario, Roam X est une application canadienne de découverte de restaurants qui aide les utilisateurs à trouver des établissements en fonction de l’ambiance, de l’humeur et de l’occasion. Que vous planifiiez un rendez-vous romantique, un déjeuner en solo ou une soirée entre amis, Roam X propose des expériences culinaires qui correspondent à ce que vous ressentez. Nous sommes fiers d’être une entreprise dirigée par des personnes issues de minorités, reconnue au niveau fédéral au Canada comme appartenant à un propriétaire BIPOC, et engagée envers des pratiques d’embauche inclusives en tant qu’employeur garantissant l’égalité des chances.