huggingface-transformers Examples and Free Source Code

How to know which words are encoded with unknown tokens in HuggingFace BertTokenizer?...

huggingface-transformers huggingface-tokenizers

Llama-2 7B-hf repeats context of question directly from input prompt, cuts off with newlines...

python artificial-intelligence huggingface-transformers large-language-model

Continual pre-training vs. Fine-tuning a language model with MLM...

deep-learning nlp huggingface-transformers bert-language-model pre-trained-model

Deepspeed : AttributeError: 'DummyOptim' object has no attribute 'step'...

python huggingface-transformers large-language-model huggingface-trainer deepspeed

Size mismatch for embed_out.weight: copying a param with shape torch.Size([0]) from checkpoint - Hug...

pytorch huggingface-transformers large-language-model huggingface

How to fix no token found error while downloading hugging face?...

python-3.x pytorch huggingface-transformers

Different embeddings for same sentences with torch transformer...

python pytorch huggingface-transformers bert-language-model

I load a float32 Hugging Face model, cast it to float16, and save it. How can I load it as float16?...

python machine-learning huggingface-transformers huggingface half-precision-float

How to fix the learning-rate for Huggingface´s Trainer?...

machine-learning deep-learning huggingface-transformers huggingface-trainer learning-rate

Alternative to Receptive field in Transformers and what factors impact it...

nlp huggingface-transformers receptive-field

Why aren't my metrics showing in SageMaker (CloudWatch)?...

pytorch huggingface-transformers amazon-sagemaker huggingface amazon-sagemaker-studio

Huggingface - Finetuning in Tensorflow with custom datasets...

tensorflow huggingface-transformers transfer-learning huggingface-tokenizers fine-tuning

Fine-tuning model's classifier layer with new label...

pytorch huggingface-transformers

AutoTokenizer.from_pretrained took forever to load...

python huggingface-transformers huggingface-tokenizers

Error RuntimeError: CUDA error: operation not supported when tried to locate something into CUDA...

python pytorch huggingface-transformers

How to use adapter transformers with a Huggingface Pipeline...

python machine-learning nlp huggingface-transformers adapter-transformers

How can i solve ImportError: Using the `Trainer` with `PyTorch` requires `accelerate>=0.20.1` whe...

python nlp importerror huggingface-transformers huggingface

Embedding of LLM vs custom embeddings...

huggingface-transformers embedding large-language-model huggingface-tokenizers retrieval-augmented-generation

HuggingFace pipeline - Debug prompt...

python nlp huggingface-transformers

Speeding up load time of LLMs...

huggingface-transformers large-language-model quantization

Running out of RAM when finetuning model...

machine-learning pytorch artificial-intelligence huggingface-transformers

How to fix error `OSError: <model> does not appear to have a file named config.json.` when loa...

pytorch nlp huggingface-transformers large-language-model peft

presidio transformers package not available, despite being installed...

python huggingface-transformers pii presidio

AttributeError: 'TrainingArguments' object has no attribute 'model_init_kwargs'...

python nlp huggingface-transformers large-language-model peft

Is it possible to load huggingface model which does not have config.json file?...

python machine-learning computer-vision huggingface-transformers

How to deal with stack expects each tensor to be equal size eror while fine tuning GPT-2 model?...

python tensorflow artificial-intelligence huggingface-transformers gpt-2

Using torchrun with AWS sagemaker estimator on multi-GPU node...

amazon-web-services pytorch huggingface-transformers amazon-sagemaker distributed-computing

What does "permutation invariant" mean in the context of transformers doing language model...

pytorch huggingface-transformers

How to tune LLM to give full length and detailed answers...

python machine-learning huggingface-transformers large-language-model nlp-question-answering

Can I dynamically add or remove LoRA weights in the transformer library like diffusers...

python huggingface-transformers huggingface peft