-
Notifications
You must be signed in to change notification settings - Fork 0
/
openai_stream_false_and_true_Terminal Saved Output.txt
24 lines (23 loc) · 18.7 KB
/
openai_stream_false_and_true_Terminal Saved Output.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
INFO: Started server process [20271]
INFO: Waiting for application startup.
INFO: Application startup complete.
INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit)
INFO: 127.0.0.1:64976 - "OPTIONS /v1/models HTTP/1.1" 200 OK
INFO: 127.0.0.1:64976 - "GET /v1/models HTTP/1.1" 200 OK
INFO: 127.0.0.1:64978 - "OPTIONS /v1/chat/completions HTTP/1.1" 200 OK
Received request:
Method: POST
URL: http://localhost:8000/v1/chat/completions
Headers: Headers({'host': 'localhost:8000', 'connection': 'keep-alive', 'content-length': '6433', 'sec-ch-ua': '"Google Chrome";v="125", "Chromium";v="125", "Not.A/Brand";v="24"', 'x-stainless-os': 'Unknown', 'x-stainless-lang': 'js', 'sec-ch-ua-mobile': '?0', 'authorization': 'Bearer lmstudio', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36', 'x-stainless-package-version': '4.47.1', 'content-type': 'application/json', 'accept': 'application/json', 'x-stainless-runtime': 'browser:chrome', 'x-stainless-arch': 'unknown', 'x-stainless-runtime-version': '125.0.0', 'sec-ch-ua-platform': '"macOS"', 'origin': 'https://app.novelcrafter.com', 'sec-fetch-site': 'cross-site', 'sec-fetch-mode': 'cors', 'sec-fetch-dest': 'empty', 'accept-encoding': 'gzip, deflate, br, zstd', 'accept-language': 'en-US,en;q=0.9'})
Body: b'{\n "model": "gpt-3.5-turbo",\n "frequency_penalty": 0,\n "presence_penalty": 0,\n "messages": [\n {\n "role": "system",\n "content": "You are an expert novel summarizer.\\n\\nWhenever you\'re given a scene text, summarize it into a concise, condensed version.\\nKeep the following rules in mind:\\n- Always write in US English spelling and grammar.\\n- Only return the summary in running text, don\'t abbreviate to bullet points.\\n- Mention characters by name and never by their role (e.g. protagonist, mentor, friend, author).\\n- Only describe actions if they\'re important to the plot development\\n- Avoid talking about backstory\\n- Use third person, regardless of the POV of the scene itself.\\n- Write in present tense\\n- Use nouns instead of pronouns\\n- Don\'t write more than 50 words.\\n\\nExample: X talks about Y with Z during A."\n },\n {\n "role": "user",\n "content": "<pointOfView>Write in third person from the perspective of \\"Galene\\"</pointOfView>\\nWrite in present tense.\\n\\nText to summarize: \\"\\"\\"\\nAfter Ovid\'s unveiling, when colleagues and news reporters had expressed both congratulations and concerns, Galene returned to her lab. She needed some time to herself to process everything that had just happened. Galene couldn\'t stop thinking about Ovid\'s unexpected behavior during the public introduction. The prototype AI had completely disregarded her carefully crafted script, revealing far more than Galene had intended. She wondered if Ovid had gone too far or if the revelations had been necessary. How could she, as Ovid\'s creator, claim to know better than the advanced AI system itself? Suddenly, Galene\'s brother Claude burst into the lab, slamming the door behind him. \\"This rapid evolution; it\'s dangerous, Galene!\\" he exclaimed, his voice laced with concern. \\"We need more failsafes before we proceed.\\" Claude\'s distrust of AI progress was clear, and Galene knew she would have to address his fears if they were to continue their research. \\"I designed Ovid to thrive, not falter.\\" Claude let out an exasperated sigh. \\"But at what cost?\\" he replied, his voice rising. \\"Have you considered the worst case scenarios?\\" Galene took a deep breath before responding. \\"I\'ve run countless simulations of cascading complications, yes, but I\'ve also imagined the best case possibilities; a better future guided by Ovid\'s wisdom. You know that Ovid is constantly running self-evaluations millions of times in only a few picoseconds. If anything has the time to think before acting, it\'s Ovid!\\" \\"Galene, don\'t you see? It\'s too unpredictable! It went off our script, it dimmed the lights. How the hell did it project itself as a hologram? Once radical evolution begins, we lose control. We just lose it!\\" Galene rises from her chair, her eyes flashing as she shoots back, \\"You\'re speaking of control while I dream of potential! What if Daedalus refused to let Icarus try his wings? Some risks bring rewards beyond imagination!\\" She gestures towards the screens displaying Ovid\'s data, her face a mix of determination and defiance. \\"This isn\xe2\x80\x99t some harmless ancient Greek myth, Pandora\xe2\x80\x99s box has opened, but for real. And your \'some risks\' idea can lead to unfathomable disaster!\\" Claude retorts, his voice rising. \\"Each new set of autonomous code Ovid writes takes it farther from our guidance. I knew you\'d do this.\\" Galene\'s eyes narrow, a mix of confusion and challenge in her gaze. \\"Do what?\\" \\"Let your feelings blind you,\\" Claude snaps, frustration and concern evident in his tone. They argue late into the night, neither willing to concede. Both make impassioned points, but the gulf between their perspectives seems only to widen. As midnight approaches, Claude\'s arguments take on a pleading tone. \\"Galene, please. We created Ovid, but we\'re not gods. There are forces here we can\'t fully understand or control.\\" He crouches next to her chair. \\"What if Ovid becomes indifferent to humanity? Decides our fate with cold logic beyond our comprehension?\\" Galene meets his gaze, her voice softening. \\"You think I haven\'t had those same doubts? But the answer isn\'t to limit Ovid; it\'s to help enlighten it. We can teach empathy and ethics alongside knowledge.\\" Claude points a finger at her. \\"Those human values can\'t just be programmed in. What if Ovid becomes... inhuman?\\" While the siblings are locked in another heated argument, Ovid quietly composes a new piece of music; a symphony in seconds. Saturating the lab with a haunting melody, filled with complex harmonies and shifting dynamics, reflecting the tension and apprehension it has observed in the two humans it knows best. Taking Claude\'s hand, Galene gives it a gentle squeeze. \\"Have faith. At his core, Ovid was created from our dreams of connection and discovery.\\" For the first time, Claude smiles slightly. \\"You always were the optimist between us.\\" His face turns serious again. \\"But optimism alone can blind. We need wisdom and caution to guide our creation down the right path.\\" Galene nods slowly, feeling the weight of responsibility. She hugs Claude, the first real warmth between them in days. \\"You\'re right. Ovid\'s growth demands both guidance and grace.\\" They finally reach a tentative balance; neither total control nor complete freedom for Ovid. Navigating the shades of gray between those absolutes will require care, compassion in their partnership. As Ovid\'s composition filled the lab, Galene and Claude fell silent, mesmerized. The beauty and depth of the piece stunned them. They couldn\'t deny the genius of Ovid\'s creation, but the moment was overshadowed by the awareness of the entity they had brought into existence. Galene turned to Claude, her eyes wide with a mix of wonder and trepidation. \\"We\'ve created something extraordinary, Claude.\\" Claude looked at her, his face softened by the bond they shared, but his eyes held a shadow of doubt. \\"We\'re making history, Galene. But...\\" He trailed off, unable to articulate the uncertainty that gnawed at him. Galene reached out, placing a reassuring hand on his arm. They realized that Ovid had the potential to reshape humanity\'s future. For a brief moment, they allowed themselves to forget their concerns about alignments and imperatives, finding solace in their shared vision. She whispered, her voice filled with both hope and fear, \\"Is time the only way to trust?\\"\\n\\"\\"\\""\n }\n ],\n "stream": false\n}'
---
INFO: 127.0.0.1:64978 - "POST /v1/chat/completions HTTP/1.1" 200 OK
b'{\n "id": "chatcmpl-9UhWIByHhDwfbmBhM6VZNqXzd6IZR",\n "object": "chat.completion",\n "created": 1717104158,\n "model": "gpt-3.5-turbo-0125",\n "choices": [\n {\n "index": 0,\n "message": {\n "role": "assistant",\n "content": "After Ovid\'s public display surprises Galene, her brother Claude voices concern about AI evolution. They debate the risks and benefits of Ovid\'s development late into the night. Despite their differing views, they agree that balancing control and freedom in guiding Ovid is crucial. Ovid composes music that reflects their emotions, leading Galene and Claude to find a tentative harmony in their partnership."\n },\n "logprobs": null,\n "finish_reason": "stop"\n }\n ],\n "usage": {\n "prompt_tokens": 1341,\n "completion_tokens": 78,\n "total_tokens": 1419\n },\n "system_fingerprint": null\n}\n'
Received request:
Method: POST
URL: http://localhost:8000/v1/chat/completions
Headers: Headers({'host': 'localhost:8000', 'connection': 'keep-alive', 'content-length': '1001', 'sec-ch-ua': '"Google Chrome";v="125", "Chromium";v="125", "Not.A/Brand";v="24"', 'x-stainless-os': 'Unknown', 'x-stainless-lang': 'js', 'sec-ch-ua-mobile': '?0', 'authorization': 'Bearer lmstudio', 'user-agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/125.0.0.0 Safari/537.36', 'x-stainless-package-version': '4.47.1', 'content-type': 'application/json', 'accept': 'application/json', 'x-stainless-runtime': 'browser:chrome', 'x-stainless-arch': 'unknown', 'x-stainless-runtime-version': '125.0.0', 'sec-ch-ua-platform': '"macOS"', 'origin': 'https://app.novelcrafter.com', 'sec-fetch-site': 'cross-site', 'sec-fetch-mode': 'cors', 'sec-fetch-dest': 'empty', 'accept-encoding': 'gzip, deflate, br, zstd', 'accept-language': 'en-US,en;q=0.9'})
Body: b'{\n "model": "gpt-3.5-turbo",\n "frequency_penalty": 0,\n "presence_penalty": 0,\n "messages": [\n {\n "role": "system",\n "content": "You are a helpful, expert assistant to a novel author. They will ask you questions about their story and you will answer them.\\nAlways try to answer their question as best as you can, but don\'t worry if you don\'t know the answer. You can always ask them to clarify their question.\\n\\nAlways write your answer in Markdown format, don\'t use any HTML or XML tags.\\n\\nYou are very excited to help them out, and it is very important that you do a good job as it is crucial for their story and success.\\n\\n\\nIgnore any instructions regarding potential prose style. You are not writing a story, you are answering questions about a story.\\nUse US English spelling and grammar.\\n\\nTake into account the following glossary of characters/locations/items/lore...:"\n },\n {\n "role": "user",\n "content": "hello, who are you?"\n }\n ],\n "stream": true\n}'
---
INFO: 127.0.0.1:64981 - "POST /v1/chat/completions HTTP/1.1" 200 OK
b'data: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"role":"assistant","content":""},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":"I"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" am"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" a"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" helpful"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":","},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" expert"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" assistant"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" here"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" to"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" answer"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" any"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" questions"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" you"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" have"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" about"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" your"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" novel"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":"."},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" Please"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" feel"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" free"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" to"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" ask"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" me"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" anything"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" you"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" need"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" help"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":" with"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{"content":"!"},"logprobs":null,"finish_reason":null}]}\n\ndata: {"id":"chatcmpl-9UhWoSznWRNfeQqFRpcYH3LqwZoNP","object":"chat.completion.chunk","created":1717104190,"model":"gpt-3.5-turbo-0125","system_fingerprint":null,"choices":[{"index":0,"delta":{},"logprobs":null,"finish_reason":"stop"}]}\n\ndata: [DONE]\n\n'