Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ChatQnA demo yaml files integration between GMC and Oneclick #72

Merged
merged 8 commits into from
Jun 5, 2024

Conversation

zhlsunshine
Copy link
Collaborator

Description

ChatQnA demo yaml files integration between GMC and Oneclick:

  1. Make sure ChatQnA microservices can be deployed successfully in K8s cluster by using Oneclick yaml files
  2. Refactor the GMC yaml files folders, removing template, creating gmcmanager and gmcrouter

Issues

Issue#37

Type of change

List the type of change like below. Please delete options that are not relevant.

  • Bug fix (non-breaking change which fixes an issue)
  • New feature (non-breaking change which adds new functionality)
  • Breaking change (fix or feature that would break existing design and interface)

Dependencies

Oneclick

Tests

Describe the tests that you ran to verify your changes.

Signed-off-by: zhlsunshine <huailong.zhang@intel.com>

remove bin files
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

let's delete the old one and make this chatQnA.yaml, what do you say?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we will need two version: (one for gaudi, and one for xeon). for current one, Let's call it chatQnA-xeon.yaml

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we not put the yaml in GenAIExamples? Or are you thinking of a copy here for completeness. Is it possible instead to give a link to a file in another sub-project so we do not run into the issue of keeping things in sync?

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we will need two version: (one for gaudi, and one for xeon). for current one, Let's call it chatQnA-xeon.yaml

Copy link
Collaborator

@KfreeZ KfreeZ left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

endpoint: /v1/embeddings
- name: TeiEmbedding
internalService:
nameSpace: chatqa
serviceName: tei-embedding-service
serviceName: tei-embedding-svc
config:
no_proxy: ".chatqa.svc.cluster.local"
http_proxy: "insert-your-http-proxy-here"
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

  • we need remove all proxy setting in this sample
  • rename this as chatQnA_xeon.yaml
  • remove old chatQna.yaml
  • remove old gmc_v1alpha3_gmconnector.yaml

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done!

@@ -366,7 +349,10 @@ func (r *GMConnectorReconciler) Reconcile(ctx context.Context, req ctrl.Request)
// get the router config
// r.Log.Info("Reconciling connector graph", "apiVersion", graph.APIVersion, "graph", graph.Name)
fmt.Println("Reconciling connector graph", "apiVersion", graph.APIVersion, "graph", graph.Name)

err := reconcileResource("Configmap", req.NamespacedName.Namespace, "", nil, nil)
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

think we need add logic to select 'Configmap' or 'ConfigmapGaudi' based on current tgi svc setting

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As we discussed, let's keep this and then change them based on the discussion with Oneclick.

Signed-off-by: zhlsunshine <huailong.zhang@intel.com>
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>
Copy link
Collaborator

@mkbhanda mkbhanda left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we not put the yaml in GenAIExamples? Or are you thinking of a copy here for completeness. Is it possible instead to give a link to a file in another sub-project so we do not run into the issue of keeping things in sync?

Signed-off-by: zhlsunshine <huailong.zhang@intel.com>
Signed-off-by: zhlsunshine <huailong.zhang@intel.com>
@zhlsunshine zhlsunshine merged commit 0208998 into opea-project:main Jun 5, 2024
4 checks passed
@zhlsunshine
Copy link
Collaborator Author

Meged and related to #64

@zhlsunshine zhlsunshine deleted the integ branch June 7, 2024 08:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants