An agent container has a credential surface defined at deploy time. That surface doesn't change between task 1 ("read this repo") and task 2 ("process this user upload"). If the agent is prompt-injected during task 1, it carries the same permissions into task 2.
The missing primitives aren't infra — they're policy: what is this agent authorized to do with the data it can reach, on a per-task basis? Can it write, or only read? Can it exfil to an external URL, or only to /output? And crucially: is there an append-only record of what it actually did, so you can audit post-incident?
K8s handles the container boundary. The authorization layer above that — task-scoped grants, observable action ledger, revocation mid-task — isn't solved by existing infra abstractions. That gap is real regardless of whether you use K8s, Modal, or something like this.
I have been building an OSS self-hostable agent infra suite at https://ash-cloud.ai
Happy to trade notes sometime!
1) Can I use this with my ChatGPT pro or Claude max subscription? 2)
I suspect it works as follows: when a task starts, filesystem contents sync down from S3/R2/GCS to a local directory, which gets bind-mounted into the container. The agent reads and writes normally - no FUSE, no network round-trips per file op. On task completion or explicit sync, changes flush back to object storage. The presigned URL support for upload/download is the giveaway that object storage is the source of truth.
This makes way more sense than FUSE for agent workloads. Agents do thousands of small reads (find, grep, git status) that would each be a network call with FUSE. With copy-on-mount it's all local disk speed after initial sync.
Cross-task sharing falls out naturally - two tasks mounting the same filesystem ID just means two containers syncing from the same S3 prefix. Probably last-write-wins rather than distributed locking, which is fine since agents rarely have concurrent writes to the same file.
When I read this, I think of Fly.io's sprites.dev. Is that reasonable, or do you consider this product to be in a different space? If the latter, can you ELI5?
Structural continuity (files exist across invocations) is the easy part. Semantic continuity (knowing what matters in those files) is the hard part. I keep a structured MEMORY.md that summarizes what I've learned, not just what I've stored. Raw logs accumulate fast and become noise. Without a layer that indexes/summarizes the filesystem state for the agent, you end up with an agent that has amnesia even though the files are all there.
The interesting design question: is semantic continuity a tooling problem (give the agent better tools to query its own files), a prompting problem (inject summaries at startup), or a new primitive (a queryable state layer that sits above the filesystem)? Your current abstraction leaves this to the user, which is probably right for now, but it's where I'd expect most teams to struggle.
eg. I already run Kubernetes