Questions tagged [nlg]

Natural Language Generation (NLG) is a field dealing with automatic generation of natural languages.

Natural Language Generation (NLG) is used in systems which communicate in a natural language, such as a program to automatically build a weather report based on weather data.

NLG is often thought as the reverse of sentence parsing in Natural Language Processing (NLP), but it is not, since sentence parsing only deals with the syntactic representation of a language, while NLG deals much deeper than that, touching the semantics (meaning) of language1.

Although similar in nature, NLG is significantly more difficult than NLP, due to the inherent expressiveness of natural language. NLG involves making many choices, e.g. which content to include, what order to say it in, what words and syntactic constructions to use2.

See also the Wikipedia page on Natural Language Generation: http://en.wikipedia.org/wiki/Natural_language_generation

Linked resources:

  1. http://web.science.mq.edu.au/%7Erdale/teaching/esslli/part01.pdf
  2. http://homepages.abdn.ac.uk/k.vdeemter/pages/teaching/NLP/lectures/lec19.prn.pdf
52 questions
1
vote
1 answer

Is the pretrained model selected at random when not specified from transformers

I am trying to implement a QA system using models from huggingface. One thing I do not understand is, when I don't specify which pre-trained model I am using for question-answering, is the model chosen at random? from transformers import pipeline #…
DarknessPlusPlus
  • 543
  • 1
  • 5
  • 18
1
vote
1 answer

Model for measuring grammatical text quality

I generate text via transformer models and I am looking for a way of measuring the grammatical text-quality. Like the text: "Today is a good day. I slept well and got up good in the morning." should be rated higher than: "Yesterday I went into bed…
MichaelJanz
  • 1,775
  • 2
  • 8
  • 23
1
vote
3 answers

NLTK MLE model clarification trigrams and greater

I am learning NLTK and have a question about data preprocessing and the MLE model. Currently I am trying to generate words with the MLE model. The problem is that when I pick an n>=3. My model will produce words completely fine until it gets to a…
arm.u
  • 55
  • 2
  • 7
1
vote
1 answer

How can I build domain specific language models using Open-AI GPT for natural language generation?

I want to build my own language model using Open-AI GPT. How can I build domain specific language models using Open-AI GPT for natural language generation?
Pradeep
  • 21
  • 5
1
vote
1 answer

why is encoder.json not found when running GPT2 small model

good evening, caveat, im not a python or machine learning expert I'm trying to run the small instance of GPT2 , after the hype I wanted to check it out. So far I've downloaded all the prerequisites. Python, regex, tensorflow etc. but when it comes…
1
vote
1 answer

Ask dynamic questions for information acquisition

I am developing a chatbot that asks the user the information that is not there in the database. Consider the database has 40 details for every person: Name, Age, Fav food, Fav Restaurant, Fav city, Reason for Fav City, Four the most liked things in…
hawk
  • 130
  • 1
  • 12
1
vote
1 answer

How to combine two sentences using simplenlg

Given a set of sentence like "John has a cat" and "John has a dog" would to create a sentence like "John has a cat and dog". Can I use simplenlg to create the same.
Rakesh.P
  • 183
  • 1
  • 2
  • 11
1
vote
2 answers

Meaningful sentence generation from words which are classified as per parts of speech

I am working on Natural Language Generation project. I've created bag of words from paragraph,like nouns,verbs,adjectives.etc and I am trying to generate sentence of pattern Subject+verb+object. Example: Noun: Elizabeth, Dog, Eiffel Tower, Bike…
0
votes
0 answers

Time and cost to train Distill GPT-2 model on BookCorpus using AWS EC2

I am trying to calculate the time it would take to train a Distill GPT2 model on BookCorpus dataset using multiple EC2 instances for the purpose of language modeling. What is the method for calculating training time of language models?
Troi
  • 43
  • 2
0
votes
0 answers

I have created an nlg model and trained this is my first time build an nlg model so i do i use this nlg model for chatbot and import it

I have created a nlg moel and reformatted the file using functions it contains 24mb data i have trained it i want to use it for chatbot how do i import it to my other file for chatbot snice this is my first time creating a nlg model Snice I don't…
0
votes
1 answer

dataset to use for question formation from any text

I am trying to create an improved quiz generator that accepts a certain text as an input and forms questions from the sentences. I want to create a machine learning model that splits the sentence into different parts so it is capable of forming…
0
votes
1 answer

'pip install nlg' keeps erroring out with the same error on multiple environments/platforms

can anyone successfully "pip install nlg"? i get the below picture when i do. also below are some excerpts from the error message. note: This error originates from a subprocess, and is likely not a problem with pip. ERROR: Failed building…
Chris B
  • 24
  • 3
0
votes
0 answers

NLG | T5 Paraphrase results are not creative enough

I've tried to use pre-trained model to create paraphrases of sentences, Even after trying to correlate top_p and top_k the result paraphrases were almost the same as the original sentence. I would like to get results that look completely different…
0
votes
0 answers

How to generate question based on information given in question or by combining multiple questions?

I have a dataset of question and I want to generate the questions from the given text. For example, if I have a task like "John paid 1500$ for television set. Television set has 25% discount. Calculate the original price of television set." and I…
Crn
  • 1
0
votes
0 answers

Sentence Negation in NLP

can anyone suggest works done in sentence negation (converting any kind to of sentences to interrogative sentence) in NLP? Please refer papers and steps followed in negating any kind of sentences. also suggest some applications where sentence…
Lopamudra
  • 9
  • 2