Assessment of available cloud based products for building a robust archiving solution

ABOUT COMPANY We are active in multiple industries and fields from logistics to data science and analytics. As a freshly founded company who has quickly grown to be active all across Canada and overseas we present a variety of opportunities which students can take part in and experience being in the fast pace and exciting technology arena while gaining knowledge and skills. We value creativity, problem solving and a genuine passion for learning. PROJECT SCOPE Creating efficient data pipelines from our live environments with noSQL, JSON based data structures to an archive solution, ideally based on Microsoft Azure. Deliverable : Assessment of various Azure Solutions for achieving the desired archive and data warehousing solution (Data lake, Gen1 & Gen2, Cosmos DB, etc). If Azure is not familiar, an equivalent cloud solution could be considered but with most of the analytics and data science world moving onto Azure, we prefer to invest in a solution built on top of Azure. This assessment would consider cost, performance and other factors important for a real solution. Data pipelines allowing archive of live data with refresh rate of 12 hours at minimum. Archive solution ideally would be designed and implemented using the best Microsoft Azure solution from all the available products. Archive database, design and ideally implementation.