Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Producer API v.1.1 #671

Closed
wajda opened this issue May 5, 2020 · 1 comment
Closed

Producer API v.1.1 #671

wajda opened this issue May 5, 2020 · 1 comment

Comments

@wajda
Copy link
Contributor

wajda commented May 5, 2020

Add support for Attribute dependency info.

@wajda wajda added the feature label May 5, 2020
@wajda wajda added this to the 0.6.0 milestone May 5, 2020
@wajda wajda self-assigned this May 5, 2020
wajda added a commit that referenced this issue May 24, 2020
wajda added a commit that referenced this issue May 24, 2020
wajda added a commit that referenced this issue May 24, 2020
wajda added a commit that referenced this issue May 24, 2020
@wajda
Copy link
Contributor Author

wajda commented May 24, 2020

The Producer model is logically split into the operation-level and the attribute-level lineage information.
Attribute-level lineage is represented by the optional "schemas" property:

"schemas": {
  "attributes": [...],
  "functions": [...],
  "constants": [...],
  "mapping": {
    "op1": ["attrID1", "attrID2", ...],
    "op2": ["attrID3", "attrID4", ...]
  }
}

The first three properties (attributes, functions and constants) contain expression definitions of the corresponding type (similar to the "operations" object design).
"mapping" property maps operation IDs to their output schema definitions, i.e. array of attribute IDs that forms the given operation output.
Attributes and functions can refer other expressions as their children. i.e. expressions that the given attribute or function depends on.

wajda added a commit that referenced this issue May 26, 2020
* spline #671 Manifest Producer API v1.1. Deprecate v1

* spline #671 Producer REST: dual DTO version support

* spline #671 Producer REST: + attribute/expression model

* spline #671 Producer REST: Add 'absa' prefix to the MIME type

* spline #671 Rename Attribute.expr to Attribute.expressions

* spline #671 Decouple the Operation level model from the Attribute level model

* spline #671 Extract and erase "rest-api-doc-generator" module from the project

* spline #671 Refine model

* spline #671 Redesign Attribute as Expression

* spline #671 Change OperationLike.Id type from Int to String for consistency with other components.

* spline #671 Swagger doc

* spline #671 Addressing PR comments: Rename AttributeReference to Attribute

* spline #671 Addressing PR comments: Rename Schemas to Expressions
@wajda wajda closed this as completed Nov 27, 2020
@wajda wajda changed the title Producer API v.0.6 Producer API v.1.1 May 18, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Status: Done
Development

No branches or pull requests

1 participant