jinaai

/

jina-embeddings-v3

like 1.14k

Follow

Jina AI 1.79k

This PR converts the model to HF format, while keeping all compatibility with trust_remote_code=True. Merging this PR is upto the repo owners 🤗. But this branch can be used in Transformers with revision="refs/pr/137" (Once the below mentioned PR is merged) in all from_pretrained methods in Transformers, which will work without needing to add trust_remote_code=True.

This PR complements this other PR in the transformers library: https://github.com/huggingface/transformers/pull/44251. Which adds Jina-Embeddings-V3 Model to the library.

Hello!

The updated config.json should not have any "auto_map", and it should instead have a "model_type". Otherwise, AutoConfig won't be able to load this nicely without trust_remote_code=True.

• Tom Aarsen

Thanks for the review @tomaarsen . Done, I've made the requested changes.

Thanks for the initiative! I created a new huggingface repo with this PR: https://huggingface.co/jinaai/jina-embeddings-v3-hf