Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Can't upload rmse,mae and other results to openml server #1197

Closed
SharathKumarReddyAlijarla opened this issue Feb 10, 2023 · 1 comment
Closed

Comments

@SharathKumarReddyAlijarla
Copy link

SharathKumarReddyAlijarla commented Feb 10, 2023

Description

Can't upload rmse,mae and other results to openml server

Steps/Code to Reproduce

` root = logging.getLogger()
root.setLevel(logging.INFO)

args = parse_args()
if args.openml_apikey:
    openml.config.apikey = args.openml_apikey
if args.openml_server:
    openml.config.server = args.openml_server
else:
    openml.config.server = 'https://test.openml.org/api/v1/'
clf_pipeline=pipeline()
run = openml.runs.run_model_on_task(clf_pipeline, args.task_id)
score = []
evaluations = run.fold_evaluations['mean_absolute_error'][0]
for key in evaluations:
    score.append(evaluations[key])
mae=np.mean(score)
print(np.mean(score))
print(np.mean(run.get_metric_fn(sklearn.metrics.mean_squared_error)))
print(np.mean(run.get_metric_fn(sklearn.metrics.r2_score)))
logging.info('Task %d - %s; Accuracy: %0.2f' % (args.task_id, task.get_dataset().name, mae))

del_outputdir()
run.to_filesystem(directory= 'myrun')
print(args.upload_result)

if args.upload_result:
    run.publish()
    print(run)
    print('Results Uploaded to Openml and stored in local folder myrun')
else:
    print('Results stored in local folder myrun')`

Expected Results

want to upload mean absolute error value to openml runs. run is uploaded but this values are not uploaded when run.publish() is executed.I am only able to get results locally,

Actual Results

Versions

@LennartPurucker
Copy link
Contributor

Solved in #1209

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants