Instructions to use microsoft/codebert-base with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use microsoft/codebert-base with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("feature-extraction", model="microsoft/codebert-base")# Load model directly from transformers import AutoTokenizer, AutoModel tokenizer = AutoTokenizer.from_pretrained("microsoft/codebert-base") model = AutoModel.from_pretrained("microsoft/codebert-base") - Inference
- Notebooks
- Google Colab
- Kaggle
Adding new language.
#6
by cyt28 - opened
I am currently working on a project utilizing the CodeBERT model. I would like to expand its capabilities by adding a new language.
Therefore, I would like to know if there are any methods available to expand the model. I've tried fine tuning the model with new dataset, it shows the warning "Some weights of RobertaModel were not initialized from the model checkpoint...... ".
Any guidance or resources would be greatly appreciated.