If you do not want to deploy full Tensorflow serving for production but still want to be able to perform local predictions and save the results, this sample will help you achieve that.
This sample builds on top of Tensorflow sample for implementing Wide & Deep estimator Model. Training part of the code has been adopted from Tensorflow samples on Github. This sample exports Tensorflow estimator trained model to a local directory, loads & runs the saved model and saves the results to a CSV file.
Check out more details on Tensorflow Wide and Deep estimator model
Setup the tensorflow wide & Deep as described in the orginal sample given below
The Census Income Data Set that this sample uses for training is hosted by the UC Irvine Machine Learning Repository. We have provided a script that downloads and cleans the necessary files.
python data_download.py
This will download the files to /tmp/census_data. To change the directory, set the --data_dir flag.
You can run the code locally as follows:
python wide_deep.py
The model is saved to /tmp/census_model by default, which can be changed using the --model_dir flag.
To run the wide or deep-only models, set the --model_type flag to wide or deep. Other flags are configurable as well; see wide_deep.py for details.
The final accuracy should be over 83% with any of the three model types.
Run TensorBoard to inspect the details about the graph and training progression.
tensorboard --logdir=/tmp/census_model
We will add code to export trained model. Add below code snippet right after the training the model and run the training and export.
'''Export Trained Model for Serving'''
wideColumns, DeepColumns = build_model_columns()
feature_columns = DeepColumns
feature_spec = tf.feature_column.make_parse_example_spec(feature_columns)
export_input_fn = tf.estimator.export.build_parsing_serving_input_receiver_fn(feature_spec)
servable_model_dir = "/tmp/census_exported"
servable_model_path = model.export_savedmodel(servable_model_dir, export_input_fn)
print("Done Exporting at Path - %s", servable_model_path )
We are simply reusing build_model_columns() function present in training code to create features and export the model
Once we run the training and export, we should get a confirmation that the model has been exported at a path which looks like /tmp/census_exported/1520271391. The last level would be different for each export so please note it down. we will be using it in the prediction code as mentioned in below section.
wide_deep_predict.py contains code for loading saved model to run on input data census_input.csv and save the results to output CSV file census_output.csv
Configure exported model path in wide_deep_predict.py as exported_path = '/tmp/census_exported/1520271391'
This code loads the exported model, reads input CSV line by line, prepares model input for prediction, runs prediction and writes results in Output CSV file.
Output file contains all input parameters in addition of results of prediction named as Predicted_income_bracket and probability. Note that the first result column has values 0 or 1. Label value given in the training (Positive Label) will be treated as 1, >50K in this case. If required you can write actual label values to CSV by checking the results.