Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

demonstrate and guide chatGPT driven process editing #33

Open
ivy-rew opened this issue Aug 17, 2023 · 4 comments
Open

demonstrate and guide chatGPT driven process editing #33

ivy-rew opened this issue Aug 17, 2023 · 4 comments

Comments

@ivy-rew
Copy link
Member

ivy-rew commented Aug 17, 2023

  • highly reproducible examples to edit existing processes
    • nice template for 'inserting' new elements
    • hints for chat-gpt; use the schema or something the like
  • inform @andreasbalsiger
@ivy-rew
Copy link
Member Author

ivy-rew commented Aug 18, 2023

just invested a few minutes to find ways to make chatGPT supply more reliable results when being instructed to add new elements onto existing processes. In short, there is no fast and easy solution :)

  • we can improve the outcome by shipping constraints, that should always be respected. See this example: https://www.reddit.com/r/ChatGPT/comments/zlo9yv/json_as_prompts/
    • Now we can make use of this:
      • to get valid elementIds, we just have to tell chatGPT to make it as designed.
      • or to ensure that new elements will automatically be connected or inserted at the end of the existing landscape.
    • We could such a more complex request to chatGPT without making the users know. Its just to supply as much context that we already know as we can. taskrules.json.txt
  • new elements are added appropriately configured, if there are already other instances of such an element within the process. so maybe we should bend our promoted use-cases onto refactoring tasks, rather than adding completely new stuff onto virgin processes.
  • json-schema: unfortunately I could find no rock solid way to let chat-gpt interprete the json-schema which would help the AI to find all valid combinations. This is really cumbersome but maybe I just didn't try hard enough. However, basically anyone willing to help here can do it by using the playground. I just added an empty json.process of us into it and experimented with the different engines and its settings. https://platform.openai.com/playground?mode=complete&model=text-davinci-003
  • another way to proceed could be to submit concrete training data; which seems cumbersome to do, but would definitively help a lot for everyday AI requests. See https://platform.openai.com/docs/guides/fine-tuning to dive into that topic.

@ivy-rew
Copy link
Member Author

ivy-rew commented May 7, 2024

documenting past attempts to make chat GPT comply with our processes:

the naive approach

  1. use chat-gpt context-menu, ask to insert an element (hinting the json array name and the 'type') prompt-for-insert
  2. accept the incoming change chat-gpts-mail
  3. now we need to "fix" chat GPTs answer with a real editor, that has basic json-schema support. inserted-element-schema
  4. the process is back functional after this. fixed-output

@ivy-rew
Copy link
Member Author

ivy-rew commented Aug 13, 2024

looks as if openai finally support schema based outputs, definitively what were looking for in the past
https://openai.com/index/introducing-structured-outputs-in-the-api/?ck_subscriber_id=2712594844
maybe you want to plan another exploration story in this field @ivy-sgi ?

@ivy-sgi
Copy link
Member

ivy-sgi commented Aug 13, 2024

Thanks for the hint @ivy-rew We will have a deeper look into this.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants