Automatically transform a video into a step by step guide for export in PDF, Markdown, HTML

I would like the ability to record a screen recording, then screenstudio transcribes the video, takes screenshots from all of the clicks (with descriptions), and produces a step by step formatted guide ready for export into PDF, Markdown or HTML.

The way I envision this working is screenflow does the recording of each action on the users computer, the transcript (created by SS or Whipser API) is sent to Claude, OpenAI, or any LLM of our choice (local models also), then in Settings we can define our custom prompt on how to structure or format this transcript, then ScreenStudio combines the formatted artice/guide and the images it created from the clicks/interactions on our video, and makes a beautiful step by step guide we can export anywhere.

Wish List of Features:

• Automatic click/action recording with simple, accurate descriptions

  • Example: Open Google.com, Type in search “keyword”, Copy content from X.com and Paste to Google Sheet, etc.

• Use my own API key for AI models (hosted or Local using Ollama/LMStudio)

• Custom prompts for creating the guide

• Save prompts as Templates, ability to select Promp Template before Guide Creation.

• Automatically clean and cut out the ums and ahss using timestamps in the transcript and screenstudio cutting/editing features, making the final guide export clean and professional.

• Long Term: Automatically export published guide and send to webhook for integration with 1000s of services/publishing sites like DocMost, Wordpress, send to N8N, Make, Zapier, etc.
  

This feature would save me from subscribing to subscription services like ScribeHow or

https://getflowshare.com/ or https://screenapp.io/.

#guides #documentation