Skip to content

A project where client can send a very large temperature data file to a server using stream processing in NodeJS. The values are aggregated and displayed as a line graph on the client side.

Notifications You must be signed in to change notification settings

samridhim/LargeScaleDataVisualisation

Repository files navigation

Installation and Running Steps

For putting historical data into server and displaying a line chart of values of the same on client side

  1. Extract THERM0001.rar file in the same directory

  2. Go to ServerSide folder and start node.js server by typing cd ServerSide & nodemon (NodeJS should be installed, if it isn't install it using sudo apt-get install nodejs)

  3. Start mongo client by sudo service mongod start and mongo --host localhost, this ensures that mongo is running on localhost and the default port is 3000.

  4. Go to ClientSide folder and run the index.html to begin demo. The file "THERM0001.json" takes some time to get sent. Around 10-15 seconds maximum. After the popup "File Transferred" proceed with the demo.

  5. To view the chart in getchart.html, give any start date and end date between Feb 2015 - Feb 2016 only. The dataset does not have values beyond these two dates.

For real time data simulation and viewing the line chart on client side

  1. Run the simulator.py file & keep it running indefinitely. This will send documents to the server at 10 second intervals.

  2. To view the chart, open up realtime.html file in the ClientSide Folder. The initial chart takes 10 seconds to appear, after that the page is refreshed automatically to update the datapoints.

  3. To stop simulation, stop the execution of simulator.py

Demo Pics

Screenshot of Historical Chart for 13th Feb 2016 to 22nd Feb 2016

drawing

Gif of realtime updates using the simulated real time data

gif

About

A project where client can send a very large temperature data file to a server using stream processing in NodeJS. The values are aggregated and displayed as a line graph on the client side.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published