Skip to content

Home

Jump to bottom
Dipendra Misra edited this page Nov 5, 2018 · 13 revisions

This Wiki describes how to use the CHALET Version 0.1 release including builds and source code.

Working with the CHALET source code

CHALET is built using Unity3D 5.4.1, a widely used game development platform. A personal version of Unity3D is provided for free on their website. We use three assets that contain various objects (e.g., cups, stove, human):

a) Nekobolt Home Interior Pack V3 available for ~ $30

b) Model of a Man available for free

c) Model of a Woman available for free

We modified these assets to add interaction, including by adding colliders, modifying meshes, and adding scripts for interaction. Once you have purchased the assets above from the Unity3D store, please send us a copy of the receipt to chalet-3d@googlegroups.com, and we will provide you with the modified assets. These include two folders: Complete_Home_Interior_Pack and Humanoid Models, which you will place inside the Assets folder. These assets are under the Unity Asset Store license. We request that you review this license, and assume that you agree to its terms when asking for the assets. Cornell University and CHALET team are not liable for failure to abide by term and conditions for the use of these Assets or the Unity3D platform.

The Unity3D documentation and the forums are a good place to start with Unity3D. Unity3D uses C# programming language and all the programming logic for CHALET is provided using C# scripts. The C# code can be found inside Assets/Scripts. If you are not familiar with C#, Microsoft provides a quick start guide.

Working with the CHALET builds

CHALET builds come in three different types:

  1. WebGL Standalone: These are WebGL builds provided for visualization or crowdsourcing using a browser (such as in Amazon Mechanical Turk (AMT)). Download the CHALET builds and place them inside /src/chalet. You can then view various houses using the test /src/webgl_standalone_test.html using Firefox. You will have to probably use a server to run the file using Google Chrome. Please make sure that your browser provides WebGL.

  2. WebGL Simulator: Coming Soon

  3. Socket Client: Coming Soon

Working with the Text-To-Traj Platform

Text-To-Traj (T3) is a crowdsourcing platform which is designed to use CHALET builds for the purpose of collecting instructions, trajectory and being able to replay the trajectories. It is build in ruby-on-rails and provides extensive support for admin facilities, being able to visualize the data and comes with readymade website. If you are not familiar with Ruby-on-Rails then please see https://rubyonrails.org/. T3 can be hosted on a server and links can be shared on crowdsourcing website. T3 was used to collect the CHAI dataset Misra EMNLP 2018.

Clone this wiki locally