Mixed Reality HealthCoach Callenge by CSS, MagicLeap and Auto-ID Labs

• Available Mixed Reality Headsets: Devices will be stored at the booth. Please come there to deploy your app on devices. Please be considerate towards other teams and minimize testing time on the hardware, as the devices are shared between all teams of the challenge. Try to use the emulators on your machines as much as you can.
• If you want to use Magic Leap, it is highly recommended, to set up your machine prior to the challenge. Please follow the instructions here: https://creator.magicleap.com/learn/guides/creator-portal . You can get started with the Simulator environment and learn how to use Meshing etc.
• Of course, you can also use your own devices. For example, you can build a mobile application (e.g. ARKit, ARCore) or any other mobile or web-based solution to this challenge.

How can your app support people who have…?

• No idea about healthy nutrition?
• Don’t care about healthy nutrition?
• Increased sedentary behaviour and snacking due to changed lifestyles?
• No motivation to exercise?
• Problems to manage shopping lists in a store?
• No idea what to cook?
• No time available?
• To take purchase decision for a family?
• Just gotten a diagnosis for a chronic disease?
• Some inspiration can be found here:
  • HoloSelecta Video
  • Computer Vision Detection of Products
  • Receipt OCR & Feedback
  • Paper: Neven A.M. ElSayed, Bruce H. Thomas, Kim Marriott, Julia Piantadosi, Ross T. Smith, Situated Analytics: Demonstrating immersive analytical tools with Augmented Reality, Journal of Visual Languages & Computing, Volume 36, 2016, Pages 13-23, ISSN 1045-926X, https://doi.org/10.1016/j.jvlc.2016.07.006.

• Labeled image data of grocery products:
  • https://github.com/tobiagru/HoloselectaDataset/blob/master/README.md
  • e.g. of products from Selecta vending machines or Migros store
• Food Recognition API from Food to Nutrients:
  • http://bite.ai : Send a photo and get back type of food, calories, etc.
• Barcode to Nutrients API
  • Barcode Product API (API endpoint: https://eatfit-service.foodcoa.ch/products/7610200026972), with the last number being the barcode (GTIN) of a product (13 digit number)
• Product Substitute Suggestion API
  • Barcode Substitute Function API (API endpoint: https://eatfit-service.foodcoa.ch/products/better-products/7610046000501/?retailer=migros, with the last number being a barcode (GTIN) and an optional retailer (e.g. migros, coop)
• API access: We will give user credentials at the workshop and the booth. If you would like to have one before HackZurich contact klaus.fuchs@autoidlabs.ch)

• I have never built anything with MagicLeap yet or no experience with mixed reality development. Where do I start?
  • First, using MagicLeap hardware is not required. If you want to start, check out their tutorials here: https://creator.magicleap.com/learn/guides
  • If you want to use HoloLens, ARCore or ARKit, there are plenty of tutorials available as well. 
• I do not have a team yet, can I still join the Mixed Reality HealthCoach challenge?
  • Of course. Ideally, you find team mates via Slack or the matching session. Otherwise, you can also send a mail to Daniel or Klaus, they can help you to shape your idea.
• I do not have any idea yet. Do you have one for me?
  • Feel free to have a chat with us at the booth or ask other hackers via Slack. You can also send a mail to Daniel or Klaus, they can help you to shape your idea.
• Do I have to use the headsets?
  • No, you can build anything, for example smartphone app or web app as well. Be creative & have fun!