Fortunately for developers who need to process large amounts of content, OPENAI today launched a batch processing API for developers. Developers can submit a large amount of content at once and get results within 24 hours.
Launching this kind of asynchronous task is also beneficial to OPENAI, that is, it can handle these requests during off-peak periods, which can balance server resources and save costs. Therefore, OPENAI provides a half-price discount for these asynchronous task APIs, and developers only need to pay 50 % fee is sufficient.
For example, when there is a large amount of text, abstracts, translations or images that need to be classified and sorted, asynchronous tasks can be used. The classification and sorting of these contents does not require high timeliness. Developers can submit and wait for OPENAI to give the results. Just process it.
This is a win-win for OPENAI and developers. According to the OPENAI API documentation, in addition to developers getting a half-price discount, they can also get a higher rate, that is, they can submit more requests per minute.
The only requirement is that developers need to transmit through JSONL file format, that is, put all the requests that need to be processed into a JSONL file, and then upload this file to the server using the batch parameter.
OPENAI has listed detailed usage methods in the API document, including creating batch processing, requesting text, retrieval, etc. Developers in need can go to OPENAI to view calling examples:https://platform.openai.com/docs/api-reference/batch
Copyright statement: Thank you for reading. Unless the source website name or link is indicated in the article, it is the original content of Blue Dot.com.When reprinting, please be sure to indicate: Source: bluedot.com, author andFull link to this article,Thank you for understanding.
GIPHY App Key not set. Please check settings