Skip to main content

Hugging Face

All functionality related to the Hugging Face Platform.

Installation

Most of the Hugging Face integrations are available in the langchain-huggingface package.

pip install langchain-huggingface

Chat models

Models from Hugging Face

We can use the Hugging Face LLM classes or directly use the ChatHuggingFace class.

See a usage example.

from langchain_huggingface import ChatHuggingFace
API Reference:ChatHuggingFace

LLMs

Hugging Face Local Pipelines

Hugging Face models can be run locally through the HuggingFacePipeline class.

See a usage example.

from langchain_huggingface import HuggingFacePipeline
API Reference:HuggingFacePipeline

Embedding Models

HuggingFaceEmbeddings

See a usage example.

from langchain_huggingface import HuggingFaceEmbeddings
API Reference:HuggingFaceEmbeddings

HuggingFaceInstructEmbeddings

See a usage example.

from langchain_community.embeddings import HuggingFaceInstructEmbeddings

HuggingFaceBgeEmbeddings

BGE models on the HuggingFace are the best open-source embedding models. BGE model is created by the Beijing Academy of Artificial Intelligence (BAAI). BAAI is a private non-profit organization engaged in AI research and development.

See a usage example.

from langchain_community.embeddings import HuggingFaceBgeEmbeddings

Hugging Face Text Embeddings Inference (TEI)

Hugging Face Text Embeddings Inference (TEI) is a toolkit for deploying and serving open-source text embeddings and sequence classification models. TEI enables high-performance extraction for the most popular models, including FlagEmbedding, Ember, GTE and E5.

We need to install huggingface-hub python package.

pip install huggingface-hub

See a usage example.

from langchain_community.embeddings import HuggingFaceHubEmbeddings

Document Loaders

Hugging Face dataset

Hugging Face Hub is home to over 75,000 datasets in more than 100 languages that can be used for a broad range of tasks across NLP, Computer Vision, and Audio. They used for a diverse range of tasks such as translation, automatic speech recognition, and image classification.

We need to install datasets python package.

pip install datasets

See a usage example.

from langchain_community.document_loaders.hugging_face_dataset import HuggingFaceDatasetLoader

Tools

Hugging Face Hub Tools

Hugging Face Tools support text I/O and are loaded using the load_huggingface_tool function.

We need to install several python packages.

pip install transformers huggingface_hub

See a usage example.

from langchain.agents import load_huggingface_tool
API Reference:load_huggingface_tool

Was this page helpful?


You can leave detailed feedback on GitHub.