Questions tagged [fine-tuning]
21 questions
0
votes
0 answers
Count tokens of jsonl file for fine tuning gpt
How can I calculate token of my JSONL file which is created after running openai command in terminal. I do know that when we run command for creating modal it shows stats about taokens usage and pricing but I couldn’t see the stats because the…
mobeen
- 158
- 1
- 10
0
votes
0 answers
What is the correct way to fine-tune OpenAI LLM model using their API?
const port = process.env.PORT || 3080;
app.listen(port, () => {
console.log(`Example app listening on port ${port}`);
});
app.post("/firegpt", async (req, res) => {
const { conversation } = req.body;
…
Thomas Ventura
- 1
- 1
0
votes
0 answers
How to fine-tune an english vision transformer model to other languages
Our team is trying to use a deep learning (vision transformer) model called Deplot. It is a vision transformer model that is capable of converting charts to tables (texts).
The architecture of the model isn't too complex compared to other…
Robin Lee
- 11
- 2
0
votes
0 answers
Error with get_peft_model() and PromptTuningConfig
I am learning how to perform Prompt Tunning and running into a problem.
I am using get_peft_model function to initialize a model for training from 'google/flan-t5-base'
model_name='google/flan-t5-base'
tokenizer =…
David Makovoz
- 1,766
- 2
- 16
- 27
0
votes
0 answers
Extracting text in a structured way not working with Transformer DONUT
I am currently working on fine tuning DONUT transformer (https://huggingface.co/docs/transformers/model_doc/donut) on this task : I want it to extract only the paragraphs of my text document like this :
<> Text of the paragraph <>" .
For this, I…
Anais Despres
- 1
- 1
0
votes
0 answers
How to add Deepspeed Activation Checkpointing to LLM for Fine-Tuning in PyTorch Lightning?
I'm trying to enable activation checkpointing for a T5-3b model to significantly free up GPU memory. However, it's not quite clear how to do the implementation for an LLM. Based on the PTL docs, it's something like this:
from lightning.pytorch…
Riley Hun
- 2,541
- 5
- 31
- 77