Skip to content

Self-made and designed data pipeline including preprocess, feature engineering, online database (MariaDB) implementation over SSH-connection, and neural network planning and implementation

Notifications You must be signed in to change notification settings

TuomasKarjalainen/planray

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

39 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Industrial electric trace heating data

Scripts for the self-made data pipeline including data fetch from REST-API, raw data preprocess, feature engineering, online database (MariaDB) implementation over SSH-connection. After data process and feature engineering, the target feature is predicted with two different types of neural networks: fully connected (FC) regression neural network and 2-dimensional convolution NN (2D-CNN).

All scripts have a docstring documentation with a brief description of their purpose and parameters.

pipeline

There is also documentation in Finnish for this, which is not publicly available. The document contains, for example, data analysis and images, further development ideas, architecture description, and analysis of the results of machine learning methods.

Model's Accuracy

  • Testdata: image

  • The model's accuracy for data it hasn't seen before: image

  • The model predicts the power (kWh) of the heating circuit - Y-axis

  • Number of samples - X-axis

  • Mean absolute error (MAE): 0.0672

About

Self-made and designed data pipeline including preprocess, feature engineering, online database (MariaDB) implementation over SSH-connection, and neural network planning and implementation

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages