-
Notifications
You must be signed in to change notification settings - Fork 834
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
chore: rename mmlspark to SynapseML #1204
Conversation
ClassPath.from(getClass.getClassLoader) | ||
.getResources.asScala.toList | ||
.map(ri => className(ri.getResourceName)) | ||
.filter(_.startsWith("com.microsoft.ml")) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
.filter(_.startsWith("com.microsoft.ml")) | |
.filter(_.startsWith("com.microsoft.synapse.ml")) |
In AzureSearchWriter.py:
And there are a bunch of similar places. Just search for "jvm.com.microsoft.ml.spark". |
|class $testClassName(unittest.TestCase): | ||
| def assert_correspondence(self, model, name, num): | ||
| model.write().overwrite().save(join(test_data_dir, name)) | ||
| sc._jvm.com.microsoft.ml.spark.core.utils.ModelEquality.assertEqual( |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Namespace wrong.
|spark = (SparkSession.builder | ||
| .master("local[*]") | ||
| .appName("PysparkTests") | ||
| .config("spark.jars.packages", "com.microsoft.ml.spark:mmlspark:" + __spark_package_version__) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
here.
val p2 = join(tmpDir.toString, "1_m2.model").toString | ||
m1.write.overwrite().save(p1) | ||
m2.write.overwrite().save(p2) | ||
ModelEquality.assertEqual("com.microsoft.ml.spark.cognitive.TextSentiment", p1, p2) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
here.
this match { | ||
case _: Estimator[_] => | ||
val companionModelImport = companionModelClassName | ||
.replaceAllLiterally("com.microsoft.ml.spark", "mmlspark") |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
here.
|
||
test("Verify stage fitting and transforming") { | ||
val exemptions: Set[String] = Set( | ||
"com.microsoft.ml.spark.cognitive.DocumentTranslator", |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
here.
d25f9e2
to
44402cd
Compare
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
1030f72
to
4118207
Compare
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Comment was made before the most recent commit for PR 1204 in repo microsoft/SynapseML |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
a598fa8
to
4232043
Compare
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
c8d2177
to
a0f5f8a
Compare
/azp run |
Azure Pipelines successfully started running 1 pipeline(s). |
No description provided.