Architecture and data flow
See what runs on your iPhone, what runs online, and how a Shortcuts AI request becomes a device action.
Shortcuts AI has two working parts. The Agent shortcut runs on your Apple device. The Shortcuts AI service manages authentication, model reasoning, online tools, settings, sessions, and billing.
The AI model does not run inside the shortcut. Apple Shortcuts acts as the device-side runner while the service plans the work.
Request flow
- You start Agent. You can run the shortcut directly or pass supported content from a Shortcuts entry point such as the Share Sheet.
- The shortcut prepares context. It collects the request, supported shared input, and basic device context needed for the session.
- The service creates a session. It authenticates the setup key, loads your model, Instructions, and enabled tools, then starts the reasoning loop.
- The model chooses the next step. It can answer, ask a follow-up question, use an enabled online tool, or request a supported device action.
- Apple Shortcuts performs device actions. The service sends structured action details back to the shortcut. Your device runs the matching action with the permissions available to Shortcuts and the relevant app.
- A result can continue the loop. Some actions return a choice, location, file, or other result so the model can decide what to do next.
- Agent finishes the session. It confirms the outcome or stops when the task is complete.
This loop lets one request combine reasoning, online information, and actions in your apps without putting the entire agent inside the shortcut.
What runs where
| Part of the request | Where it runs | What it does |
|---|---|---|
| Request and shared context | Device, then Shortcuts AI service | Gives Agent the content and intent for the current session. |
| Model reasoning | Online | Interprets the request, plans steps, and selects enabled tools. |
| Web search and transcription | Online | Retrieves requested information or converts selected audio into text. |
| Notes, Calendar, Reminders, Messages, and other device actions | Apple Shortcuts on your device | Uses the app or system action supported by the shortcut. |
| Instructions, model choice, and enabled tools | Shortcuts AI service | Applies the settings saved to your account on each run. |
| Session usage and billing records | Shortcuts AI service | Records the model and billable online tools used by a session. |
Files and audio
The shortcut separates text-like input, links, and files before a session begins. Text and links can become request context. A selected file remains on the device until Agent needs an upload action.
When a file is needed, the service provides an upload destination and the shortcut sends the selected file. Audio must be uploaded and transcribed before the model can use its contents. Files, derived context, and transcription data are handled as described in the Privacy Policy.
Permissions and control
Shortcuts AI does not automatically read every item in your apps. It receives content you submit, context the shortcut sends for the current request, and results returned by actions or tools.
Apple Shortcuts and the relevant app control local permissions. A device action can fail or pause if permission is missing, the app is not installed, or the operating system does not support that action.
You control the model, recurring Instructions, and enabled tools from Settings. Disabling a tool removes it from the options Agent can choose on future runs.
Architecture questions
Does the AI model run on my iPhone?
No. The shortcut sends the request and relevant context to the Shortcuts AI service, where the selected model runs.
Does Shortcuts AI control my entire phone?
No. Agent can request only the actions supported by the shortcut and enabled in your settings. Your device and apps still enforce their permissions.
Why does a request sometimes pause?
Agent may need a missing detail, device permission, user confirmation, file upload, or the result of an earlier action before it can continue.
For a less technical walkthrough, read How Agent works. For failures and permission issues, see Troubleshooting.