7/29/2023 0 Comments Paper io 2 liveBut we also hope that by providing an accessible interface to ChatGPT, we will get valuable user feedback on issues that we are not already aware of. We know that many limitations remain as discussed above and we plan to make regular model updates to improve in such areas. We’re eager to collect user feedback to aid our ongoing work to improve this system. We’re using the Moderation API to warn or block certain types of unsafe content, but we expect it to have some false negatives and positives for now. While we’ve made efforts to make the model refuse inappropriate requests, it will sometimes respond to harmful instructions or exhibit biased behavior.Instead, our current models usually guess what the user intended. Ideally, the model would ask clarifying questions when the user provided an ambiguous query.These issues arise from biases in the training data (trainers prefer longer answers that look more comprehensive) and well-known over-optimization issues. The model is often excessively verbose and overuses certain phrases, such as restating that it’s a language model trained by OpenAI. For example, given one phrasing of a question, the model can claim to not know the answer, but given a slight rephrase, can answer correctly.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |