Skip to main content

Oracle Cloud Infrastructure (OCI)

The LangChain integrations related to Oracle Cloud Infrastructure.

LLMs​

OCI Generative AI​

Oracle Cloud Infrastructure (OCI) Generative AI is a fully managed service that provides a set of state-of-the-art, customizable large language models (LLMs) that cover a wide range of use cases, and which are available through a single API. Using the OCI Generative AI service you can access ready-to-use pretrained models, or create and host your own fine-tuned custom models based on your own data on dedicated AI clusters.

To use, you should have the latest oci python SDK installed.

pip install -U oci

See usage examples.

from langchain_community.llms import OCIGenAI
API Reference:OCIGenAI

OCI Data Science Model Deployment Endpoint​

OCI Data Science is a fully managed and serverless platform for data science teams. Using the OCI Data Science platform you can build, train, and manage machine learning models, and then deploy them as an OCI Model Deployment Endpoint using the OCI Data Science Model Deployment Service.

If you deployed a LLM with the VLLM or TGI framework, you can use the OCIModelDeploymentVLLM or OCIModelDeploymentTGI classes to interact with it.

To use, you should have the latest oracle-ads python SDK installed.

pip install -U oracle-ads

See usage examples.

from langchain_community.llms import OCIModelDeploymentVLLM

from langchain_community.llms import OCIModelDeploymentTGI

Text Embedding Models​

OCI Generative AI​

See usage examples.

from langchain_community.embeddings import OCIGenAIEmbeddings
API Reference:OCIGenAIEmbeddings

Was this page helpful?


You can leave detailed feedback on GitHub.