"Human in a loop" / Skyvern as Copilot / "AI Driven iterative co-creation of workflows based on automatic collection of user stories traces"

[gwpl]

"Human in a loop" / Skyvern as Copilot / "AI Driven iterative co-creation of workflows based on automatic collection of user stories traces"

I would love to use skyvern in copilot way!

I.e. to be able to switch between "me driving it" and "skyvern driving it".

The other question would be probably how to make it work not only in headfull but also headless mode, in browsertab in skyvern cloud setting, but imagine this:

often in given workflows only some parts are tedious but simple and AI can help with easy prompting,
and other parts maybe so expensive to prompt/workaround to force ai to "fully autopilot" handle, that maybe easier, if system woudl pause and do "human in the loop" "copilot" style collaboration...

Now the best part, ability to opt-in to record details of this joined interaction and human actions , could allow to have traces that could be used to generate automatically suggestions which parts of workflow done by human can be automated,

allowing continous development from "mostly manual" to "more and more refined and automated" until "fully automated",
and if at any point one of the parts of workflow would start breaking (e.g. website change, requirements change, etc),

it could be first replaced with "human-in-a-loop" step, and then again continously refined with suggestions until fully automated again,

never breaking actual business workflows continuity! (for businesses, I am not talking latency critical SaaS offerings, but businesses that could be supported by skyvern)

[suchintan]

This is A good idea and something we've thought about building