{"type":"agent-native.clip.context","version":2,"webmcp":{"protocol":"WebMCP","scope":"page-local","tools":[{"name":"clips-get-context","title":"Get clip context","description":"Read clip metadata, readiness, transcript status, and the HTTP API URLs. This works without a browser.","inputSchema":{"type":"object","properties":{},"additionalProperties":false},"annotations":{"readOnlyHint":true,"untrustedContentHint":true}},{"name":"clips-get-transcript","title":"Get clip transcript","description":"Read bounded timestamped transcript segments. Use nextStartIndex to page through long transcripts without losing overlapping segments. For complete transcript text, follow sourceUrl to the HTTP transcript endpoint.","inputSchema":{"type":"object","properties":{"startMs":{"type":"number","minimum":0,"description":"Only return segments that overlap this start time."},"endMs":{"type":"number","minimum":0,"description":"Only return segments that overlap this end time."},"startIndex":{"type":"integer","minimum":0,"description":"Stable segment index for pagination; prefer nextStartIndex from the previous page."},"maxSegments":{"type":"integer","minimum":1,"maximum":50,"description":"Maximum number of transcript segments to return."}},"additionalProperties":false},"annotations":{"readOnlyHint":true,"untrustedContentHint":true}},{"name":"clips-get-frame","title":"Get clip frame","description":"Get the clip's JPEG frame URL at a requested timestamp. Fetch the returned imageUrl as an image to inspect the video; its scoped access query is already included. On an error, inspect the JSON failureKind and nextStep: access needs a Share with agents link, media means the stored recording media could not be retrieved, processing means the frame request failed and may be retried or reported, unsupported means this source cannot provide frames through Clips and must not be retried, and expired means the owner must update the clip expiry before creating another link.","inputSchema":{"type":"object","properties":{"atMs":{"type":"number","minimum":0,"description":"Video timestamp in milliseconds; fetch the returned imageUrl as an image to inspect the frame."}},"required":["atMs"],"additionalProperties":false},"availability":"ready","annotations":{"readOnlyHint":true,"untrustedContentHint":true}},{"name":"clips-get-frames","title":"Get clip frame sheet","description":"Get a URL for one JPEG contact sheet of up to 36 consecutive video frames, to watch motion such as an animation or a transition in a single image. Cells read left to right, then top to bottom; cell i shows the frame on screen at startMs + i * 1000 / fps. Solid black cells at the end of the grid hold no frame. The range can span at most 60 seconds. On an error, inspect the JSON failureKind and nextStep; failureKind=request means the range or fps was out of bounds, and nextStep names a request that fits.","inputSchema":{"type":"object","properties":{"startMs":{"type":"number","minimum":0,"description":"Time of the first frame, in milliseconds."},"endMs":{"type":"number","minimum":0,"description":"End of the range in milliseconds (exclusive). Omit it to get up to 36 frames from startMs, stopping at 60 seconds or the end of the clip."},"fps":{"type":"number","minimum":0.1,"maximum":60,"description":"Frames per second to sample. Omit it to use the video's own frame rate, so every frame in the range appears once."}},"required":["startMs"],"additionalProperties":false},"availability":"ready","annotations":{"readOnlyHint":true,"untrustedContentHint":true}}],"instructions":"For browser-independent access from any HTTP client, fetch the exact agentContextUrl and use its apis.context, apis.transcript, apis.frame, and apis.frames URLs. Keep the clip id and any agent_access query parameter exactly as provided on every request. Read the complete transcript from apis.transcript and fetch recommendedFrames[].url (or apis.frame.urlTemplate with atMs) as images to inspect the video. To watch motion, fetch apis.frames.urlTemplate: one contact-sheet image of consecutive frames. Do not stop at the transcript when frames are available. For any non-2xx response, inspect the JSON failureKind, error, and nextStep. If a context or transcript request has failureKind=access, explain that this link does not grant access; for a private clip, ask its owner to open the Clips Share menu, choose Share with agents, and send the generated link. If a frame request has failureKind=media while the context or transcript still works, explain that the stored recording media could not be retrieved and another share link will not fix it. If a frame request has failureKind=processing, follow nextStep; extraction or temporary storage failures do not mean the clip is missing or inaccessible. If a request has failureKind=expired, ask the owner to extend or remove the clip's expiry in the Share menu, save it, then create and send a new Share with agents link. If this clip page is already open in a WebMCP-capable browser, list its page tools for bounded read-only access; clips-get-transcript may omit fullText or return a truncated result, and its sourceUrl points to the HTTP transcript. Use nextStartIndex for transcript pagination so overlapping segments are not lost.","http":{"schema_version":"v1","browserRequired":false,"tools":[{"name":"clips-get-context","title":"Get clip context","description":"Read clip metadata, readiness, transcript status, and the HTTP API URLs. This works without a browser.","inputSchema":{"type":"object","properties":{},"additionalProperties":false},"annotations":{"readOnlyHint":true,"untrustedContentHint":true},"parameters":{"type":"object","properties":{},"additionalProperties":false},"endpoint":"https://clips.agent-native.com/api/agent-context.json?id=EIdS60KZPUWf","method":"GET","responseType":"application/json"},{"name":"clips-get-transcript","title":"Get clip transcript","description":"Read bounded timestamped transcript segments. Use nextStartIndex to page through long transcripts without losing overlapping segments. For complete transcript text, follow sourceUrl to the HTTP transcript endpoint.","inputSchema":{"type":"object","properties":{"startMs":{"type":"number","minimum":0,"description":"Only return segments that overlap this start time."},"endMs":{"type":"number","minimum":0,"description":"Only return segments that overlap this end time."},"startIndex":{"type":"integer","minimum":0,"description":"Stable segment index for pagination; prefer nextStartIndex from the previous page."},"maxSegments":{"type":"integer","minimum":1,"maximum":50,"description":"Maximum number of transcript segments to return."}},"additionalProperties":false},"annotations":{"readOnlyHint":true,"untrustedContentHint":true},"parameters":{"type":"object","properties":{"startMs":{"type":"number","minimum":0,"description":"Only return segments that overlap this start time."},"endMs":{"type":"number","minimum":0,"description":"Only return segments that overlap this end time."},"startIndex":{"type":"integer","minimum":0,"description":"Stable segment index for pagination; prefer nextStartIndex from the previous page."},"maxSegments":{"type":"integer","minimum":1,"maximum":50,"description":"Maximum number of transcript segments to return."}},"additionalProperties":false},"endpoint":"https://clips.agent-native.com/api/agent-transcript.json?id=EIdS60KZPUWf","method":"GET","responseType":"application/json"},{"name":"clips-get-frame","title":"Get clip frame","description":"Get the clip's JPEG frame URL at a requested timestamp. Fetch the returned imageUrl as an image to inspect the video; its scoped access query is already included. On an error, inspect the JSON failureKind and nextStep: access needs a Share with agents link, media means the stored recording media could not be retrieved, processing means the frame request failed and may be retried or reported, unsupported means this source cannot provide frames through Clips and must not be retried, and expired means the owner must update the clip expiry before creating another link.","inputSchema":{"type":"object","properties":{"atMs":{"type":"number","minimum":0,"description":"Video timestamp in milliseconds; fetch the returned imageUrl as an image to inspect the frame."}},"required":["atMs"],"additionalProperties":false},"availability":"ready","annotations":{"readOnlyHint":true,"untrustedContentHint":true},"parameters":{"type":"object","properties":{"atMs":{"type":"number","minimum":0,"description":"Video timestamp in milliseconds; fetch the returned imageUrl as an image to inspect the frame."}},"required":["atMs"],"additionalProperties":false},"endpoint":"https://clips.agent-native.com/api/agent-frame.jpg?id=EIdS60KZPUWf&atMs={atMs}","method":"GET","responseType":"image/jpeg"},{"name":"clips-get-frames","title":"Get clip frame sheet","description":"Get a URL for one JPEG contact sheet of up to 36 consecutive video frames, to watch motion such as an animation or a transition in a single image. Cells read left to right, then top to bottom; cell i shows the frame on screen at startMs + i * 1000 / fps. Solid black cells at the end of the grid hold no frame. The range can span at most 60 seconds. On an error, inspect the JSON failureKind and nextStep; failureKind=request means the range or fps was out of bounds, and nextStep names a request that fits.","inputSchema":{"type":"object","properties":{"startMs":{"type":"number","minimum":0,"description":"Time of the first frame, in milliseconds."},"endMs":{"type":"number","minimum":0,"description":"End of the range in milliseconds (exclusive). Omit it to get up to 36 frames from startMs, stopping at 60 seconds or the end of the clip."},"fps":{"type":"number","minimum":0.1,"maximum":60,"description":"Frames per second to sample. Omit it to use the video's own frame rate, so every frame in the range appears once."}},"required":["startMs"],"additionalProperties":false},"availability":"ready","annotations":{"readOnlyHint":true,"untrustedContentHint":true},"parameters":{"type":"object","properties":{"startMs":{"type":"number","minimum":0,"description":"Time of the first frame, in milliseconds."},"endMs":{"type":"number","minimum":0,"description":"End of the range in milliseconds (exclusive). Omit it to get up to 36 frames from startMs, stopping at 60 seconds or the end of the clip."},"fps":{"type":"number","minimum":0.1,"maximum":60,"description":"Frames per second to sample. Omit it to use the video's own frame rate, so every frame in the range appears once."}},"required":["startMs"],"additionalProperties":false},"endpoint":"https://clips.agent-native.com/api/agent-frames.jpg?id=EIdS60KZPUWf&startMs={startMs}&endMs={endMs}&fps={fps}","method":"GET","responseType":"image/jpeg"}]}},"instructions":["Use transcript.segments for timestamped spoken context.","Use the HTTP URLs in apis for browser-independent access. For complete transcript text, use apis.transcript. If this clip page is already open in a WebMCP-capable browser, list its read-only page tools for bounded access; WebMCP transcript results may omit fullText or be truncated, so follow sourceUrl for the complete transcript.","Keep the exact id and any agent_access query parameter from each supplied URL. When a frame request returns JSON, read failureKind, error, and nextStep. If failureKind=access, explain that the link does not grant access; for a private clip, ask the owner to open the Clips Share menu, choose Share with agents, and send the generated link. If failureKind=media, explain that the stored media could not be retrieved and another share link will not fix it. If failureKind=processing, follow nextStep. When clip.agentReadiness.state is preparing, wait clip.agentReadiness.retryAfterSeconds and fetch apis.context.url before retrying; do not treat the frame as missing media. If failureKind=expired, ask the owner to extend or remove the clip's expiry in the Share menu, save it, then create and send a new Share with agents link. Report the failing frame URL without its agent_access value.","Transcription failed with reason: No speech was detected because this recording has no audio track.. Explain this to the user and suggest retrying native capture or the Builder transcription fallback.","This clip is readable as both text (transcript) and images (JPEG frames) — you can hear AND see it.","To SEE the screen, GET apis.frame.urlTemplate with atMs (returns image/jpeg). Start with recommendedFrames, then fetch additional frames around transcript timestamps that matter for the task. Pass a comment's videoTimestampMs as atMs to see the frame its author was looking at. Older comments were saved rounded down to the whole second, so their frame can be up to a second early. To watch motion (an animation, a transition, a cursor path), GET apis.frames.urlTemplate with startMs, endMs and fps: one JPEG contact sheet of up to 36 consecutive frames, read left to right, then top to bottom. Cell i shows the frame on screen at startMs + i * 1000 / fps. Leave out fps to use the video's own frame rate, so every frame appears once; leave out endMs for up to 36 frames from startMs. Solid black cells at the end of the grid hold no frame. If it returns failureKind=request, follow nextStep."],"clip":{"id":"EIdS60KZPUWf","title":"VolunteerShift — Cover every shift fairly","description":"","publicPageUrl":"https://clips.agent-native.com/share/EIdS60KZPUWf","sourceProvider":null,"thumbnailUrl":"https://cdn.builder.io/api/v1/image/assets%2F295c49e31eb2474da8d7738d19f670e7%2Ff2e58680ccbe4bf0b876e34816b20f60","animatedThumbnailUrl":null,"durationMs":18640,"duration":"19s","width":1440,"height":900,"hasAudio":true,"hasCamera":false,"status":"ready","agentReadiness":{"state":"ready","retryAfterSeconds":null,"instruction":null},"createdAt":"2026-10-29T04:57:23.157Z","updatedAt":"2026-10-29T04:57:48.879Z"},"apis":{"context":{"method":"GET","url":"https://clips.agent-native.com/api/agent-context.json?id=EIdS60KZPUWf"},"transcript":{"method":"GET","url":"https://clips.agent-native.com/api/agent-transcript.json?id=EIdS60KZPUWf"},"frame":{"method":"GET","urlTemplate":"https://clips.agent-native.com/api/agent-frame.jpg?id=EIdS60KZPUWf&atMs={timestampMs}","responseType":"image/jpeg","query":{"atMs":"Video timestamp in milliseconds. The endpoint returns image/jpeg."}},"frames":{"method":"GET","urlTemplate":"https://clips.agent-native.com/api/agent-frames.jpg?id=EIdS60KZPUWf&startMs={startMs}&endMs={endMs}&fps={fps}","responseType":"image/jpeg","maxFrames":36,"maxSpanMs":60000,"query":{"startMs":"Time of the first frame, in milliseconds.","endMs":"Optional end of the range in milliseconds (exclusive). Without it, the sheet holds up to 36 frames from startMs, stopping at 60 seconds or the end of the clip.","fps":"Optional frames per second, from 0.1 to 60. Without it, the sheet uses the video's own frame rate."}}},"transcript":{"status":"failed","language":"en","failureReason":"No speech was detected because this recording has no audio track.","retryAfterSeconds":null,"fullText":"","segments":[],"segmentCount":0},"comments":[],"commentCount":0,"commentsTruncated":false,"reactions":[],"reactionCount":0,"reactionsTruncated":false,"chapters":[],"recommendedFrames":[{"atMs":350,"timestamp":"0:00","reason":"opening frame","url":"https://clips.agent-native.com/api/agent-frame.jpg?id=EIdS60KZPUWf&atMs=350"},{"atMs":4660,"timestamp":"0:04","reason":"25% mark","url":"https://clips.agent-native.com/api/agent-frame.jpg?id=EIdS60KZPUWf&atMs=4660"},{"atMs":9320,"timestamp":"0:09","reason":"50% mark","url":"https://clips.agent-native.com/api/agent-frame.jpg?id=EIdS60KZPUWf&atMs=9320"},{"atMs":13980,"timestamp":"0:13","reason":"75% mark","url":"https://clips.agent-native.com/api/agent-frame.jpg?id=EIdS60KZPUWf&atMs=13980"}],"bugReport":null,"browserDiagnostics":null,"appActivity":null,"ctas":[]}