Gen AI SDK migration

[takumiohym]

Goal of this update:

• Merge dedicated kernels below into the main environment:
  • gemini_kernel
  • langchain_components_kernel
  • langchain_kernel
• Update Gemini API calls to use the new Gen AI SDK.

Tasks:

• Merge dependencies of 3 dedicated kernels into main requirements.
• Remove the kernel bash files and update related notebooks if necessary.
  • gemini_kernel Remove gemini kernel #564
  • langchain_components_kernel Remove langchain_kernel & update langchain to v0.3 #567
  • langchain_kernel Remove langchain_component_kernel & update langchain to v0.3 #568
• Update notebooks under vertex_genai to use Gen AI SDK
  • gemini_for_multimodal_prompting.ipynb Migrate to Gen AI SDK: gemini_for_multimodal #571
  • gemini_function_calling.ipynb Migrate to Gen AI SDK: function_calling #575
  • gemini_prompt_engineering.ipynb Migrate to Gen AI SDK: gemini_prompt_engineering.ipynb #570
  • gen_ai_evaluation_service.ipynb (skip?)
  • grounding_vertex_agent_builder_with_gemini.ipynb (skip?)
  • retrieval_augmented_generation.ipynb Remove langchain_kernel & update langchain to v0.3 #567
  • semantic_matching_with_gemini.ipynb Migrate to Gen AI SDK: semantic_matching #572
  • semantic_search_with_vector_search.ipynb Migrate to Gen AI SDK: semantic_search #573
  • vertex_llm_tuning_with_gemini.ipynb Migrate to Gen AI SDK: llm_tuning #574
• Test notebooks that use updated dependencies (e.g. google-cloud-aiplatform)

[takumiohym]

Notes on requirements.txt update

• Merged 3 kernels (gemini_kernel, langchain_components_kernel, langchain_kernel)
• Categorized and reordered the dependencies
• Updated langchain libraries to v0.3.
• Added google-genai.
• Added some underlying dependency versions explicitly (e.g. kubernetes, jax, google-api-core, google-cloud-storage) to speed up the installation process by removing the necessity to install multiple versions and check compatibilities.
• Moved saliency from the requirements-without-deps.txt to requirements.txt, as its dependencies don't crush with other libraries.

[review-notebook-app]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB